2024-03-27T21:18:42.359 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-27T21:18:42.359 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525 --description rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/orig.config.yaml 2024-03-27T21:18:42.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T21:18:42.485 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525 branch: wip-yuri4-testing-2024-03-26-1132-reef description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} email: yweinste@redhat.com first_in_suite: false job_id: '7626525' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri4-testing-2024-03-26-1132-reef ceph: conf: client: debug monc: 20 debug ms: 1 global: debug ms: 1 debug objecter: 20 debug rados: 20 mon client directed command retry: 5 mon election default strategy: 3 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 5 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - \(POOL_APP_NOT_ENABLED\) - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_FULL\) - \(SLOW_OPS\) - \(MON_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - slow request sha1: 7c37d80f7a88f4eb561c4fe02558660a650b10ac ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7c37d80f7a88f4eb561c4fe02558660a650b10ac thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2024-03-26-1132-reef sha1: 7c37d80f7a88f4eb561c4fe02558660a650b10ac owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 6904 sha1: 7c37d80f7a88f4eb561c4fe02558660a650b10ac sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2024-03-26-1132-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7c37d80f7a88f4eb561c4fe02558660a650b10ac targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2k0LwIjq/fgl0fdo5xEusdHz5tJkemKU4cg3A1mzgcunXPrxs+Y8QaeICjOSTPRMFUGMCIJPxld02Cy03Q7YQ= smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNouEqEVlmR8flsVmVtdMzxVEKwNhbUVb9+Ff0BZiAJRrQdKBZ0auUrtt31tPbbyACpWX3x7lTrhAJ0TNtqJtq8= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - rados/test.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_14:58:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-27T21:18:42.485 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa; will attempt to use it 2024-03-27T21:18:42.486 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks 2024-03-27T21:18:42.486 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-27T21:18:42.488 INFO:teuthology.task.internal:Checking packages... 2024-03-27T21:18:42.513 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7c37d80f7a88f4eb561c4fe02558660a650b10ac' 2024-03-27T21:18:42.513 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-27T21:18:42.514 INFO:teuthology.packaging:ref: None 2024-03-27T21:18:42.514 INFO:teuthology.packaging:tag: None 2024-03-27T21:18:42.514 INFO:teuthology.packaging:branch: wip-yuri4-testing-2024-03-26-1132-reef 2024-03-27T21:18:42.514 INFO:teuthology.packaging:sha1: 7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:18:42.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri4-testing-2024-03-26-1132-reef 2024-03-27T21:18:42.737 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1053.ge58b9979 2024-03-27T21:18:42.738 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-27T21:18:42.745 INFO:teuthology.task.internal:no buildpackages task found 2024-03-27T21:18:42.745 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-27T21:18:42.785 INFO:teuthology.task.internal:Saving configuration 2024-03-27T21:18:42.800 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-27T21:18:42.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T21:18:42.841 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 21:13:34.359988', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2k0LwIjq/fgl0fdo5xEusdHz5tJkemKU4cg3A1mzgcunXPrxs+Y8QaeICjOSTPRMFUGMCIJPxld02Cy03Q7YQ='} 2024-03-27T21:18:42.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 21:13:34.358445', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNouEqEVlmR8flsVmVtdMzxVEKwNhbUVb9+Ff0BZiAJRrQdKBZ0auUrtt31tPbbyACpWX3x7lTrhAJ0TNtqJtq8='} 2024-03-27T21:18:42.863 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-27T21:18:42.869 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-03-27T21:18:42.869 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-03-27T21:18:42.869 INFO:teuthology.run_tasks:Running task console_log... 2024-03-27T21:18:42.956 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f25d7ff5f70>, signals=[15]) 2024-03-27T21:18:42.957 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-27T21:18:42.962 INFO:teuthology.task.internal:Opening connections... 2024-03-27T21:18:42.963 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:18:42.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:18:43.071 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:18:43.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:18:43.171 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-27T21:18:43.178 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-03-27T21:18:43.197 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-03-27T21:18:43.197 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-03-27T21:18:43.255 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T21:18:43.256 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-03-27T21:18:43.257 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T21:18:43.257 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T21:18:43.257 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T21:18:43.257 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-03-27T21:18:43.287 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-03-27T21:18:43.306 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-03-27T21:18:43.306 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-03-27T21:18:43.365 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-03-27T21:18:43.365 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2024-03-27T21:18:43.365 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T21:18:43.366 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T21:18:43.367 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T21:18:43.367 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-03-27T21:18:43.411 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-27T21:18:43.430 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-27T21:18:43.482 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-27T21:18:43.483 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-03-27T21:18:43.486 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-03-27T21:18:43.503 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-27T21:18:43.509 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-27T21:18:43.509 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-03-27T21:18:43.544 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-03-27T21:18:43.568 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-27T21:18:43.621 INFO:teuthology.run_tasks:Running task kernel... 2024-03-27T21:18:43.636 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-27T21:18:43.636 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.f': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-27T21:18:43.636 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T21:18:43.637 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T21:18:43.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:18:43.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:18:43.655 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-03-27T21:18:43.655 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-03-27T21:18:43.711 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-361.el9.x86_64 2024-03-27T21:18:43.712 INFO:teuthology.task.kernel:Running kernel on smithi063: 5.14.0-361.el9.x86_64 2024-03-27T21:18:43.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-03-27T21:18:43.713 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-361.el9.x86_64 2024-03-27T21:18:43.713 INFO:teuthology.task.kernel:Running kernel on smithi028: 5.14.0-361.el9.x86_64 2024-03-27T21:18:43.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum install -y kernel 2024-03-27T21:18:45.922 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-27T21:18:45.982 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-27T21:18:47.431 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2024-03-27T21:18:47.499 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.0 MB 00:00 2024-03-27T21:18:48.597 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 8.0 MB 00:00 2024-03-27T21:18:51.473 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-03-27T21:18:53.672 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.0 MB 00:05 2024-03-27T21:19:04.306 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 683 kB/s | 6.1 MB 00:09 2024-03-27T21:19:05.998 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-03-27T21:19:09.058 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 7.0 MB/s | 21 MB 00:02 2024-03-27T21:19:14.182 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-03-27T21:19:16.398 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-27T21:19:16.398 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-27T21:19:16.515 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:19:16.526 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:19:16.526 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-03-27T21:19:16.526 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:19:16.527 INFO:teuthology.orchestra.run.smithi028.stdout:Install 4 Packages 2024-03-27T21:19:16.528 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:19:16.528 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 76 M 2024-03-27T21:19:16.528 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 123 M 2024-03-27T21:19:16.528 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:19:16.709 INFO:teuthology.orchestra.run.smithi028.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 688 kB/s | 66 kB 00:00 2024-03-27T21:19:17.026 INFO:teuthology.orchestra.run.smithi028.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 36 MB/s | 15 MB 00:00 2024-03-27T21:19:17.393 INFO:teuthology.orchestra.run.smithi028.stdout:(3/4): kernel-modules-core-5.14.0-432.el9.x86_6 40 MB/s | 27 MB 00:00 2024-03-27T21:19:17.521 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 851 kB/s | 19 MB 00:22 2024-03-27T21:19:17.735 INFO:teuthology.orchestra.run.smithi028.stdout:(4/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 30 MB/s | 33 MB 00:01 2024-03-27T21:19:17.735 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:19:17.735 INFO:teuthology.orchestra.run.smithi028.stdout:Total 63 MB/s | 76 MB 00:01 2024-03-27T21:19:18.432 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:19:18.881 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:19:18.881 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:19:19.937 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:19:19.938 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:19:21.746 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-27T21:19:22.551 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:19:23.176 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-27T21:19:23.269 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T21:19:23.414 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-03-27T21:19:25.065 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-27T21:19:26.162 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T21:19:26.295 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T21:19:30.165 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-27T21:19:31.407 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T21:19:31.446 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:19:32.447 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-27T21:19:32.447 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-27T21:19:32.543 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 5.14.0-432.el9 baseos 66 k 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 5.14.0-432.el9 baseos 15 M 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 5.14.0-432.el9 baseos 33 M 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core x86_64 5.14.0-432.el9 baseos 27 M 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:19:32.553 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:19:32.554 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:19:32.554 INFO:teuthology.orchestra.run.smithi063.stdout:Install 4 Packages 2024-03-27T21:19:32.554 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:19:32.554 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 76 M 2024-03-27T21:19:32.554 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 123 M 2024-03-27T21:19:32.554 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:19:32.950 INFO:teuthology.orchestra.run.smithi063.stdout:(1/4): kernel-5.14.0-432.el9.x86_64.rpm 196 kB/s | 66 kB 00:00 2024-03-27T21:19:36.570 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:19:39.391 INFO:teuthology.orchestra.run.smithi063.stdout:(2/4): kernel-core-5.14.0-432.el9.x86_64.rpm 2.2 MB/s | 15 MB 00:06 2024-03-27T21:19:41.599 INFO:teuthology.orchestra.run.smithi063.stdout:(3/4): kernel-modules-core-5.14.0-432.el9.x86_6 3.2 MB/s | 27 MB 00:08 2024-03-27T21:20:02.948 INFO:teuthology.orchestra.run.smithi063.stdout:(4/4): kernel-modules-5.14.0-432.el9.x86_64.rpm 1.1 MB/s | 33 MB 00:30 2024-03-27T21:20:02.948 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:20:02.948 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.5 MB/s | 76 MB 00:30 2024-03-27T21:20:03.638 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:20:04.079 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:20:04.079 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:20:05.120 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:20:05.121 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:20:07.444 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:07.444 INFO:teuthology.orchestra.run.smithi028.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T21:20:07.444 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:20:07.490 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:07.729 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:20:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-27T21:20:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T21:20:07.885 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T21:20:08.301 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:08.301 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:20:08.301 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:20:08.301 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-27T21:20:08.302 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-27T21:20:08.302 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-27T21:20:08.302 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-27T21:20:08.302 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:20:08.302 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:20:08.372 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-core-5.14.0-432.el9.x86_64 1/4 2024-03-27T21:20:08.455 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T21:20:08.624 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-03-27T21:20:08.723 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-27T21:20:08.723 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-27T21:20:08.723 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-27T21:20:08.724 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-27T21:20:08.724 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-27T21:20:08.724 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-27T21:20:08.724 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi028.front.sepia.ceph.com, path=None, version=distro) 2024-03-27T21:20:08.724 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-03-27T21:20:08.807 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-27T21:20:08.807 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-27T21:20:08.807 DEBUG:teuthology.orchestra.run.smithi028:> sudo rpm -qi grub2-tools 2024-03-27T21:20:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Name : grub2-tools 2024-03-27T21:20:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Epoch : 1 2024-03-27T21:20:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Version : 2.06 2024-03-27T21:20:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Release : 68.el9 2024-03-27T21:20:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: x86_64 2024-03-27T21:20:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Group : Unspecified 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Size : 8264254 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:License : GPLv3+ 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Packager : builder@centos.org 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Vendor : CentOS 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Summary : Support tools for GRUB. 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:Description : 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T21:20:08.846 INFO:teuthology.orchestra.run.smithi028.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T21:20:08.847 INFO:teuthology.orchestra.run.smithi028.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T21:20:08.847 INFO:teuthology.orchestra.run.smithi028.stdout:hardware devices. 2024-03-27T21:20:08.847 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:20:08.847 INFO:teuthology.orchestra.run.smithi028.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T21:20:08.847 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T21:20:08.848 INFO:teuthology.task.kernel:Updating grub on smithi028 to boot 5.14.0-432.el9.x86_64 2024-03-27T21:20:08.848 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T21:20:09.462 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-03-27T21:20:10.829 INFO:teuthology.orchestra.run.smithi028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T21:20:10.873 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-03-27T21:20:10.876 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-27T21:20:10.892 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.BzlY2e51H3 2024-03-27T21:20:10.892 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BzlY2e51H3 2024-03-27T21:20:10.987 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.BzlY2e51H3 2024-03-27T21:20:11.098 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.BzlY2e51H3 is 6KB 2024-03-27T21:20:11.147 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.BzlY2e51H3 2024-03-27T21:20:11.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T21:20:11.240 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T21:20:11.240 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T21:20:11.240 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T21:20:11.240 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-27T21:20:11.242 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-27T21:20:11.370 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T21:20:11.395 DEBUG:teuthology.orchestra.run.smithi028:> sudo shutdown -r now 2024-03-27T21:20:11.498 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T21:20:16.569 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T21:20:16.607 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:21.709 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:41.399 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-27T21:20:41.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-27T21:20:41.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:20:52.324 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:52.324 INFO:teuthology.orchestra.run.smithi063.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T21:20:52.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:20:52.370 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:52.777 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:52.777 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-5.14.0-432.el9.x86_64 1/4 2024-03-27T21:20:52.777 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-5.14.0-432.el9.x86_64 2/4 2024-03-27T21:20:52.777 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-5.14.0-432.el9.x86_64 3/4 2024-03-27T21:20:53.193 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-core-5.14.0-432.el9.x86_64 4/4 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-5.14.0-432.el9.x86_64 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core-5.14.0-432.el9.x86_64 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-5.14.0-432.el9.x86_64 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-core-5.14.0-432.el9.x86_64 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:20:53.194 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:20:53.566 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-03-27T21:20:53.672 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-27T21:20:53.673 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-27T21:20:53.673 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-432.el9.x86_64 2024-03-27T21:20:53.673 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-27T21:20:53.673 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-27T21:20:53.673 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2024-03-27T21:20:53.673 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-03-27T21:20:53.673 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-03-27T21:20:53.755 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-5.14.0-432.el9.x86_64 2024-03-27T21:20:53.755 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-432.el9.x86_64 2024-03-27T21:20:53.756 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-03-27T21:20:53.798 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-03-27T21:20:53.798 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-03-27T21:20:53.798 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2024-03-27T21:20:53.798 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 68.el9 2024-03-27T21:20:53.798 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8264254 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T21:20:53.799 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T21:20:53.800 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-03-27T21:20:53.800 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:20:53.800 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T21:20:53.801 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T21:20:53.801 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 5.14.0-432.el9.x86_64 2024-03-27T21:20:53.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T21:20:54.526 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-03-27T21:20:55.862 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T21:20:55.895 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-03-27T21:20:55.898 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-03-27T21:20:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.oLLoQG0qQU 2024-03-27T21:20:55.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oLLoQG0qQU 2024-03-27T21:20:55.989 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.oLLoQG0qQU 2024-03-27T21:20:56.129 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.oLLoQG0qQU is 6KB 2024-03-27T21:20:56.177 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.oLLoQG0qQU 2024-03-27T21:20:56.192 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T21:20:56.268 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T21:20:56.268 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T21:20:56.269 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T21:20:56.269 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64.conf 2024-03-27T21:20:56.270 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-432.el9.x86_64 2024-03-27T21:20:56.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-03-27T21:21:26.458 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2024-03-27T21:21:26.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:21:26.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:21:41.414 DEBUG:teuthology.orchestra.remote:timed out 2024-03-27T21:21:44.990 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-03-27T21:21:50.421 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-27T21:21:50.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:21:50.695 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-03-27T21:21:51.066 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-27T21:21:51.066 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-432.el9.x86_64"... 2024-03-27T21:21:51.066 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-03-27T21:21:51.082 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-432.el9.x86_64 2024-03-27T21:21:51.082 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-27T21:21:51.082 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T21:21:51.082 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T21:21:52.083 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-27T21:21:52.083 DEBUG:teuthology.orchestra.run.smithi028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T21:21:52.159 INFO:teuthology.orchestra.run.smithi028.stdout:ttyS1 2024-03-27T21:21:52.189 DEBUG:teuthology.parallel:result is None 2024-03-27T21:21:53.991 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:21:53.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:21:57.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-03-27T21:22:09.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:22:09.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:22:27.486 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-03-27T21:22:42.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:22:42.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:22:42.985 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-27T21:22:43.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:22:43.421 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.14.0-432.el9.x86_64"... 2024-03-27T21:22:43.421 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-03-27T21:22:43.435 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-432.el9.x86_64 2024-03-27T21:22:43.435 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-432.el9.x86_64 vs 5.14.0-432.el9.x86_64 2024-03-27T21:22:43.435 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T21:22:43.435 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T21:22:44.436 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-03-27T21:22:44.437 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T21:22:44.510 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-03-27T21:22:44.559 DEBUG:teuthology.parallel:result is None 2024-03-27T21:22:44.559 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-27T21:22:44.566 INFO:teuthology.task.internal:Creating test directory... 2024-03-27T21:22:44.567 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T21:22:44.569 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T21:22:44.585 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-27T21:22:44.608 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-27T21:22:44.659 INFO:teuthology.task.internal:Creating archive directory... 2024-03-27T21:22:44.659 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T21:22:44.661 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T21:22:44.690 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-27T21:22:44.712 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-27T21:22:44.712 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T21:22:44.728 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T21:22:44.768 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T21:22:44.769 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T21:22:44.782 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T21:22:44.783 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T21:22:44.785 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-27T21:22:44.792 INFO:teuthology.task.internal:Configuring sudo... 2024-03-27T21:22:44.793 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T21:22:44.827 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T21:22:44.855 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-27T21:22:44.865 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-27T21:22:44.865 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T21:22:44.897 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T21:22:44.913 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T21:22:44.994 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T21:22:45.042 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T21:22:45.126 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T21:22:45.168 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:22:45.168 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T21:22:45.236 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T21:22:45.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T21:22:45.329 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T21:22:45.411 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T21:22:45.460 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:22:45.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T21:22:45.529 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-03-27T21:22:45.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-03-27T21:22:45.581 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T21:22:45.617 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T21:22:46.086 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-27T21:22:46.094 INFO:teuthology.task.internal:Starting timer... 2024-03-27T21:22:46.094 INFO:teuthology.run_tasks:Running task pcp... 2024-03-27T21:22:46.137 INFO:teuthology.run_tasks:Running task selinux... 2024-03-27T21:22:46.186 DEBUG:teuthology.orchestra.run.smithi028:> sudo service auditd rotate 2024-03-27T21:22:46.239 INFO:teuthology.orchestra.run.smithi028.stdout:Rotating logs: 2024-03-27T21:22:46.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-03-27T21:22:46.325 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-03-27T21:22:46.326 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-27T21:22:46.327 DEBUG:teuthology.orchestra.run.smithi028:> /usr/sbin/getenforce 2024-03-27T21:22:46.352 INFO:teuthology.orchestra.run.smithi028.stdout:Permissive 2024-03-27T21:22:46.352 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-03-27T21:22:46.373 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-03-27T21:22:46.373 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi028.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi063.front.sepia.ceph.com': 'permissive'} 2024-03-27T21:22:46.373 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-27T21:22:46.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:22:46.421 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-27T21:22:46.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:22:46.449 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-27T21:22:46.449 DEBUG:teuthology.orchestra.run.smithi028:> sudo /usr/sbin/setenforce permissive 2024-03-27T21:22:46.497 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-03-27T21:22:46.551 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-27T21:22:46.564 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-27T21:22:46.580 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-27T21:22:46.582 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi063.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-27T21:27:28.473 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi063.front.sepia.ceph.com')] 2024-03-27T21:27:28.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-27T21:27:28.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:27:28.567 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-03-27T21:27:28.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-27T21:27:28.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:27:28.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T21:27:28.743 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-03-27T21:27:28.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-03-27T21:27:28.823 INFO:teuthology.run_tasks:Running task clock... 2024-03-27T21:27:28.835 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-27T21:27:28.835 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T21:27:28.836 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T21:27:28.838 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T21:27:28.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T21:27:28.867 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T21:27:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T21:27:28.896 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T21:27:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: ntpd: command not found 2024-03-27T21:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T21:27:28.926 INFO:teuthology.orchestra.run.smithi028.stdout:506 Cannot talk to daemon 2024-03-27T21:27:28.942 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T21:27:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-03-27T21:27:28.958 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T21:27:28.959 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-03-27T21:27:28.976 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T21:27:28.993 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T21:27:29.013 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-03-27T21:27:29.017 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T21:27:29.017 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-03-27T21:27:29.017 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.017 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.017 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.017 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.045 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-03-27T21:27:29.049 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T21:27:29.049 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-03-27T21:27:29.050 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.050 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.050 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.050 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:27:29.050 INFO:teuthology.run_tasks:Running task install... 2024-03-27T21:27:29.058 DEBUG:teuthology.task.install:project ceph 2024-03-27T21:27:29.058 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac'}} 2024-03-27T21:27:29.058 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac'} 2024-03-27T21:27:29.059 INFO:teuthology.task.install:Using flavor: default 2024-03-27T21:27:29.066 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-27T21:27:29.066 INFO:teuthology.task.install:extra packages: [] 2024-03-27T21:27:29.067 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac', 'tag': None, 'wait_for_package': False} 2024-03-27T21:27:29.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:27:29.069 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac', 'tag': None, 'wait_for_package': False} 2024-03-27T21:27:29.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:27:29.215 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/ 2024-03-27T21:27:29.215 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1021.g7c37d80f 2024-03-27T21:27:29.227 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/ 2024-03-27T21:27:29.227 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1021.g7c37d80f 2024-03-27T21:27:29.331 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T21:27:29.331 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:27:29.331 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T21:27:29.358 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-27T21:27:29.359 DEBUG:teuthology.orchestra.run.smithi028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7c37d80f7a88f4eb561c4fe02558660a650b10ac/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T21:27:29.394 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2024-03-26-1132-reef/7c37d80f7a88f4eb561c4fe02558660a650b10ac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T21:27:29.394 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:27:29.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T21:27:29.423 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-27T21:27:29.424 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7c37d80f7a88f4eb561c4fe02558660a650b10ac/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T21:27:29.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T21:27:29.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T21:27:29.508 DEBUG:teuthology.orchestra.run.smithi028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T21:27:29.571 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T21:27:29.577 INFO:teuthology.orchestra.run.smithi028.stdout:check_obsoletes = 1 2024-03-27T21:27:29.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum clean all 2024-03-27T21:27:29.637 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2024-03-27T21:27:29.639 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2024-03-27T21:27:29.824 INFO:teuthology.orchestra.run.smithi028.stdout:74 files removed 2024-03-27T21:27:29.851 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-radosgw 2024-03-27T21:27:29.901 INFO:teuthology.orchestra.run.smithi063.stdout:74 files removed 2024-03-27T21:27:29.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw 2024-03-27T21:27:30.571 INFO:teuthology.orchestra.run.smithi028.stdout:ceph packages for x86_64 186 kB/s | 77 kB 00:00 2024-03-27T21:27:30.580 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 223 kB/s | 77 kB 00:00 2024-03-27T21:27:30.897 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 37 kB/s | 9.9 kB 00:00 2024-03-27T21:27:31.213 INFO:teuthology.orchestra.run.smithi028.stdout:ceph noarch packages 17 kB/s | 9.9 kB 00:00 2024-03-27T21:27:31.382 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 4.2 kB/s | 1.8 kB 00:00 2024-03-27T21:27:31.522 INFO:teuthology.orchestra.run.smithi028.stdout:ceph source packages 6.9 kB/s | 1.8 kB 00:00 2024-03-27T21:27:31.817 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-03-27T21:27:31.949 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-03-27T21:27:33.326 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2024-03-27T21:27:33.408 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-27T21:27:34.166 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.0 MB 00:00 2024-03-27T21:27:34.975 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.0 MB 00:01 2024-03-27T21:27:36.210 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-03-27T21:27:37.028 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-03-27T21:27:40.553 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 8.2 MB/s | 6.1 MB 00:00 2024-03-27T21:27:41.452 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.1 MB 00:00 2024-03-27T21:27:42.118 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-03-27T21:27:43.061 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 16 kB 00:00 2024-03-27T21:27:43.078 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-03-27T21:27:45.132 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-27T21:27:48.304 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-27T21:27:50.321 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-27T21:27:50.878 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:27:50.882 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:27:50.882 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:27:50.882 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 7.7 M 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrading: 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: librados2 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 3.3 M 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 3.0 M 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 5.1 M 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 18 M 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 25 k 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T21:27:50.883 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 702 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 474 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 4.5 M 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 45 k 2024-03-27T21:27:50.884 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 129 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 162 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 321 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 298 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 99 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout:Install 28 Packages 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrade 2 Packages 2024-03-27T21:27:50.885 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:27:50.886 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 53 M 2024-03-27T21:27:50.886 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:27:51.996 INFO:teuthology.orchestra.run.smithi028.stdout:(1/30): ceph-base-18.2.2-1021.g7c37d80f.el9.x86 6.8 MB/s | 5.1 MB 00:00 2024-03-27T21:27:52.063 INFO:teuthology.orchestra.run.smithi028.stdout:(2/30): ceph-selinux-18.2.2-1021.g7c37d80f.el9. 378 kB/s | 25 kB 00:00 2024-03-27T21:27:52.164 INFO:teuthology.orchestra.run.smithi028.stdout:(3/30): libcephfs2-18.2.2-1021.g7c37d80f.el9.x8 6.9 MB/s | 702 kB 00:00 2024-03-27T21:27:52.264 INFO:teuthology.orchestra.run.smithi028.stdout:(4/30): libradosstriper1-18.2.2-1021.g7c37d80f. 4.6 MB/s | 474 kB 00:00 2024-03-27T21:27:52.697 INFO:teuthology.orchestra.run.smithi028.stdout:(5/30): ceph-common-18.2.2-1021.g7c37d80f.el9.x 13 MB/s | 18 MB 00:01 2024-03-27T21:27:52.756 INFO:teuthology.orchestra.run.smithi028.stdout:(6/30): python3-ceph-argparse-18.2.2-1021.g7c37 774 kB/s | 45 kB 00:00 2024-03-27T21:27:52.823 INFO:teuthology.orchestra.run.smithi028.stdout:(7/30): librgw2-18.2.2-1021.g7c37d80f.el9.x86_6 8.0 MB/s | 4.5 MB 00:00 2024-03-27T21:27:52.848 INFO:teuthology.orchestra.run.smithi028.stdout:(8/30): python3-ceph-common-18.2.2-1021.g7c37d8 1.4 MB/s | 129 kB 00:00 2024-03-27T21:27:52.874 INFO:teuthology.orchestra.run.smithi028.stdout:(9/30): python3-cephfs-18.2.2-1021.g7c37d80f.el 3.1 MB/s | 162 kB 00:00 2024-03-27T21:27:52.895 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:27:52.899 INFO:teuthology.orchestra.run.smithi028.stdout:(10/30): python3-rados-18.2.2-1021.g7c37d80f.el 6.2 MB/s | 321 kB 00:00 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 7.7 M 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 3.3 M 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 3.0 M 2024-03-27T21:27:52.911 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 5.1 M 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 18 M 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 25 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 702 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T21:27:52.912 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 474 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 4.5 M 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 45 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 129 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 162 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 321 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 298 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 99 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T21:27:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout:Install 28 Packages 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 2 Packages 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:27:52.914 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 53 M 2024-03-27T21:27:52.915 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:27:52.932 INFO:teuthology.orchestra.run.smithi028.stdout:(11/30): python3-rbd-18.2.2-1021.g7c37d80f.el9. 5.0 MB/s | 298 kB 00:00 2024-03-27T21:27:52.958 INFO:teuthology.orchestra.run.smithi028.stdout:(12/30): python3-rgw-18.2.2-1021.g7c37d80f.el9. 1.7 MB/s | 99 kB 00:00 2024-03-27T21:27:53.100 INFO:teuthology.orchestra.run.smithi028.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 634 kB/s | 106 kB 00:00 2024-03-27T21:27:53.142 INFO:teuthology.orchestra.run.smithi028.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 159 kB 00:00 2024-03-27T21:27:53.167 INFO:teuthology.orchestra.run.smithi028.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 662 kB/s | 44 kB 00:00 2024-03-27T21:27:53.284 INFO:teuthology.orchestra.run.smithi028.stdout:(16/30): ceph-radosgw-18.2.2-1021.g7c37d80f.el9 3.8 MB/s | 7.7 MB 00:02 2024-03-27T21:27:53.426 INFO:teuthology.orchestra.run.smithi028.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 2.3 MB/s | 661 kB 00:00 2024-03-27T21:27:53.476 INFO:teuthology.orchestra.run.smithi028.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 914 kB/s | 282 kB 00:00 2024-03-27T21:27:53.501 INFO:teuthology.orchestra.run.smithi028.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 190 kB/s | 41 kB 00:00 2024-03-27T21:27:53.527 INFO:teuthology.orchestra.run.smithi028.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-03-27T21:27:53.568 INFO:teuthology.orchestra.run.smithi028.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-03-27T21:27:53.602 INFO:teuthology.orchestra.run.smithi028.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-03-27T21:27:53.627 INFO:teuthology.orchestra.run.smithi028.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.0 MB/s | 309 kB 00:00 2024-03-27T21:27:53.653 INFO:teuthology.orchestra.run.smithi028.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-27T21:27:53.703 INFO:teuthology.orchestra.run.smithi028.stdout:(25/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 11 MB/s | 838 kB 00:00 2024-03-27T21:27:53.728 INFO:teuthology.orchestra.run.smithi028.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-27T21:27:53.787 INFO:teuthology.orchestra.run.smithi028.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-03-27T21:27:53.854 INFO:teuthology.orchestra.run.smithi028.stdout:(28/30): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-03-27T21:27:53.947 INFO:teuthology.orchestra.run.smithi063.stdout:(1/30): ceph-radosgw-18.2.2-1021.g7c37d80f.el9. 11 MB/s | 7.7 MB 00:00 2024-03-27T21:27:54.056 INFO:teuthology.orchestra.run.smithi063.stdout:(2/30): ceph-selinux-18.2.2-1021.g7c37d80f.el9. 232 kB/s | 25 kB 00:00 2024-03-27T21:27:54.137 INFO:teuthology.orchestra.run.smithi028.stdout:(29/30): librbd1-18.2.2-1021.g7c37d80f.el9.x86_ 8.6 MB/s | 3.0 MB 00:00 2024-03-27T21:27:54.148 INFO:teuthology.orchestra.run.smithi063.stdout:(3/30): libcephfs2-18.2.2-1021.g7c37d80f.el9.x8 7.5 MB/s | 702 kB 00:00 2024-03-27T21:27:54.198 INFO:teuthology.orchestra.run.smithi028.stdout:(30/30): librados2-18.2.2-1021.g7c37d80f.el9.x8 7.0 MB/s | 3.3 MB 00:00 2024-03-27T21:27:54.203 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:27:54.203 INFO:teuthology.orchestra.run.smithi028.stdout:Total 16 MB/s | 53 MB 00:03 2024-03-27T21:27:54.204 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:27:54.207 INFO:teuthology.orchestra.run.smithi063.stdout:(4/30): libradosstriper1-18.2.2-1021.g7c37d80f. 7.9 MB/s | 474 kB 00:00 2024-03-27T21:27:54.244 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:27:54.244 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:27:54.490 INFO:teuthology.orchestra.run.smithi063.stdout:(5/30): librgw2-18.2.2-1021.g7c37d80f.el9.x86_6 16 MB/s | 4.5 MB 00:00 2024-03-27T21:27:54.532 INFO:teuthology.orchestra.run.smithi063.stdout:(6/30): python3-ceph-argparse-18.2.2-1021.g7c37 1.1 MB/s | 45 kB 00:00 2024-03-27T21:27:54.591 INFO:teuthology.orchestra.run.smithi063.stdout:(7/30): python3-ceph-common-18.2.2-1021.g7c37d8 2.2 MB/s | 129 kB 00:00 2024-03-27T21:27:54.658 INFO:teuthology.orchestra.run.smithi063.stdout:(8/30): python3-cephfs-18.2.2-1021.g7c37d80f.el 2.4 MB/s | 162 kB 00:00 2024-03-27T21:27:54.707 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:27:54.707 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:27:54.725 INFO:teuthology.orchestra.run.smithi063.stdout:(9/30): ceph-base-18.2.2-1021.g7c37d80f.el9.x86 3.5 MB/s | 5.1 MB 00:01 2024-03-27T21:27:54.750 INFO:teuthology.orchestra.run.smithi063.stdout:(10/30): python3-rados-18.2.2-1021.g7c37d80f.el 3.4 MB/s | 321 kB 00:00 2024-03-27T21:27:54.792 INFO:teuthology.orchestra.run.smithi063.stdout:(11/30): python3-rgw-18.2.2-1021.g7c37d80f.el9. 2.3 MB/s | 99 kB 00:00 2024-03-27T21:27:54.818 INFO:teuthology.orchestra.run.smithi063.stdout:(12/30): python3-rbd-18.2.2-1021.g7c37d80f.el9. 3.2 MB/s | 298 kB 00:00 2024-03-27T21:27:54.943 INFO:teuthology.orchestra.run.smithi063.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 703 kB/s | 106 kB 00:00 2024-03-27T21:27:54.968 INFO:teuthology.orchestra.run.smithi063.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 159 kB 00:00 2024-03-27T21:27:54.985 INFO:teuthology.orchestra.run.smithi063.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-27T21:27:55.044 INFO:teuthology.orchestra.run.smithi063.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-27T21:27:55.069 INFO:teuthology.orchestra.run.smithi063.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-27T21:27:55.086 INFO:teuthology.orchestra.run.smithi063.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 989 kB/s | 41 kB 00:00 2024-03-27T21:27:55.286 INFO:teuthology.orchestra.run.smithi063.stdout:(19/30): fmt-8.1.1-5.el9.x86_64.rpm 510 kB/s | 111 kB 00:00 2024-03-27T21:27:55.336 INFO:teuthology.orchestra.run.smithi063.stdout:(20/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2024-03-27T21:27:55.462 INFO:teuthology.orchestra.run.smithi063.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-03-27T21:27:55.520 INFO:teuthology.orchestra.run.smithi063.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 842 kB/s | 49 kB 00:00 2024-03-27T21:27:55.571 INFO:teuthology.orchestra.run.smithi063.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-03-27T21:27:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:(24/30): libarrow-9.0.0-10.el9.x86_64.rpm 8.5 MB/s | 4.4 MB 00:00 2024-03-27T21:27:55.838 INFO:teuthology.orchestra.run.smithi063.stdout:(25/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2024-03-27T21:27:56.030 INFO:teuthology.orchestra.run.smithi063.stdout:(26/30): ceph-common-18.2.2-1021.g7c37d80f.el9. 6.7 MB/s | 18 MB 00:02 2024-03-27T21:27:56.064 INFO:teuthology.orchestra.run.smithi063.stdout:(27/30): re2-20211101-3.el9.x86_64.rpm 742 kB/s | 192 kB 00:00 2024-03-27T21:27:56.114 INFO:teuthology.orchestra.run.smithi063.stdout:(28/30): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-03-27T21:27:56.137 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:27:56.223 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-03-27T21:27:56.267 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-03-27T21:27:56.329 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-03-27T21:27:56.373 INFO:teuthology.orchestra.run.smithi063.stdout:(29/30): librbd1-18.2.2-1021.g7c37d80f.el9.x86_ 9.8 MB/s | 3.0 MB 00:00 2024-03-27T21:27:56.714 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-03-27T21:27:56.743 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/32 2024-03-27T21:27:56.819 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/32 2024-03-27T21:27:56.906 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 6/32 2024-03-27T21:27:56.936 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 7/32 2024-03-27T21:27:56.982 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 7/32 2024-03-27T21:27:57.011 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-03-27T21:27:57.055 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-argparse-2:18.2.2-1021.g7c37d80f.el9. 9/32 2024-03-27T21:27:57.123 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 10/32 2024-03-27T21:27:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:(30/30): librados2-18.2.2-1021.g7c37d80f.el9.x8 3.0 MB/s | 3.3 MB 00:01 2024-03-27T21:27:57.138 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:27:57.138 INFO:teuthology.orchestra.run.smithi063.stdout:Total 13 MB/s | 53 MB 00:04 2024-03-27T21:27:57.138 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:27:57.146 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_6 11/32 2024-03-27T21:27:57.179 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:27:57.179 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:27:57.212 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_6 11/32 2024-03-27T21:27:57.322 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-03-27T21:27:57.355 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-03-27T21:27:57.395 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-03-27T21:27:57.427 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-03-27T21:27:57.454 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-03-27T21:27:57.490 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-03-27T21:27:57.523 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-03-27T21:27:57.649 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:27:57.649 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:27:57.840 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-03-27T21:27:57.877 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 20/32 2024-03-27T21:27:57.952 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 20/32 2024-03-27T21:27:57.982 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 21/32 2024-03-27T21:27:58.028 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-03-27T21:27:58.451 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-03-27T21:27:58.480 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 24/32 2024-03-27T21:27:58.551 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 24/32 2024-03-27T21:27:58.622 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 25/32 2024-03-27T21:27:58.649 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-common-2:18.2.2-1021.g7c37d80f.el9.x8 26/32 2024-03-27T21:27:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:27:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-03-27T21:27:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-03-27T21:27:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-03-27T21:27:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-03-27T21:27:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/32 2024-03-27T21:27:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/32 2024-03-27T21:27:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 6/32 2024-03-27T21:27:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 7/32 2024-03-27T21:27:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 7/32 2024-03-27T21:27:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-03-27T21:27:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:18.2.2-1021.g7c37d80f.el9. 9/32 2024-03-27T21:28:00.007 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 10/32 2024-03-27T21:28:00.031 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_6 11/32 2024-03-27T21:28:00.097 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_6 11/32 2024-03-27T21:28:00.226 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-03-27T21:28:00.255 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-03-27T21:28:00.296 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-03-27T21:28:00.337 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-03-27T21:28:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-03-27T21:28:00.417 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-03-27T21:28:00.449 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-03-27T21:28:00.764 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-03-27T21:28:00.777 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 27/32 2024-03-27T21:28:00.796 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 20/32 2024-03-27T21:28:00.812 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 27/32 2024-03-27T21:28:00.887 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 20/32 2024-03-27T21:28:00.920 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 21/32 2024-03-27T21:28:00.970 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-03-27T21:28:01.387 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 27/32 2024-03-27T21:28:01.393 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-03-27T21:28:01.423 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 28/32 2024-03-27T21:28:01.424 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 24/32 2024-03-27T21:28:01.495 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 24/32 2024-03-27T21:28:01.515 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 28/32 2024-03-27T21:28:01.516 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T21:28:01.516 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T21:28:01.516 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:01.549 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/32 2024-03-27T21:28:01.565 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 25/32 2024-03-27T21:28:01.601 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:18.2.2-1021.g7c37d80f.el9.x8 26/32 2024-03-27T21:28:03.734 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 27/32 2024-03-27T21:28:03.765 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 27/32 2024-03-27T21:28:04.329 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 27/32 2024-03-27T21:28:04.393 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 28/32 2024-03-27T21:28:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 28/32 2024-03-27T21:28:04.485 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T21:28:04.485 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T21:28:04.485 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:04.520 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/32 2024-03-27T21:28:11.444 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/32 2024-03-27T21:28:11.444 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /sys 2024-03-27T21:28:11.444 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /proc 2024-03-27T21:28:11.444 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /mnt 2024-03-27T21:28:11.444 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /var/tmp 2024-03-27T21:28:11.444 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /home 2024-03-27T21:28:11.445 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /root 2024-03-27T21:28:11.445 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /tmp 2024-03-27T21:28:11.445 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:12.229 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/32 2024-03-27T21:28:12.253 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/32 2024-03-27T21:28:12.253 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:12.253 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T21:28:12.253 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T21:28:12.253 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T21:28:12.253 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:12.255 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-27T21:28:12.332 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-27T21:28:12.332 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 3/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 4/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_6 6/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 7/32 2024-03-27T21:28:13.329 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1021.g7c37d80f.el9. 8/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-common-2:18.2.2-1021.g7c37d80f.el9.x8 9/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 10/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 11/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 12/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 13/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-03-27T21:28:13.330 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/32 2024-03-27T21:28:13.331 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-03-27T21:28:13.332 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 31/32 2024-03-27T21:28:14.338 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-03-27T21:28:14.338 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:14.338 INFO:teuthology.orchestra.run.smithi028.stdout:Upgraded: 2024-03-27T21:28:14.338 INFO:teuthology.orchestra.run.smithi028.stdout: librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.338 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.338 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T21:28:14.339 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T21:28:14.340 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:14.341 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:14.684 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/32 2024-03-27T21:28:14.684 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2024-03-27T21:28:14.684 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2024-03-27T21:28:14.685 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2024-03-27T21:28:14.685 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2024-03-27T21:28:14.685 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2024-03-27T21:28:14.685 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2024-03-27T21:28:14.685 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2024-03-27T21:28:14.685 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:14.689 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-test 2024-03-27T21:28:15.283 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:27 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:15.438 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 40 M 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 166 k 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:15.439 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:Install 6 Packages 2024-03-27T21:28:15.440 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 41 M 2024-03-27T21:28:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 165 M 2024-03-27T21:28:15.440 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:15.460 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/32 2024-03-27T21:28:15.485 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/32 2024-03-27T21:28:15.485 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:15.485 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T21:28:15.485 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T21:28:15.485 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T21:28:15.485 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:15.487 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-27T21:28:15.563 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-03-27T21:28:15.563 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-27T21:28:15.642 INFO:teuthology.orchestra.run.smithi028.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-03-27T21:28:15.693 INFO:teuthology.orchestra.run.smithi028.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-03-27T21:28:15.735 INFO:teuthology.orchestra.run.smithi028.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-27T21:28:15.777 INFO:teuthology.orchestra.run.smithi028.stdout:(4/6): libcephsqlite-18.2.2-1021.g7c37d80f.el9. 554 kB/s | 166 kB 00:00 2024-03-27T21:28:15.927 INFO:teuthology.orchestra.run.smithi028.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 976 kB/s | 187 kB 00:00 2024-03-27T21:28:16.627 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 3/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 4/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_6 6/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 7/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1021.g7c37d80f.el9. 8/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:18.2.2-1021.g7c37d80f.el9.x8 9/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 10/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 11/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 12/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 13/32 2024-03-27T21:28:16.628 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-03-27T21:28:16.629 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/32 2024-03-27T21:28:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-03-27T21:28:16.630 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 31/32 2024-03-27T21:28:17.502 INFO:teuthology.orchestra.run.smithi028.stdout:(6/6): ceph-test-18.2.2-1021.g7c37d80f.el9.x86_ 20 MB/s | 40 MB 00:02 2024-03-27T21:28:17.505 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:17.506 INFO:teuthology.orchestra.run.smithi028.stdout:Total 20 MB/s | 41 MB 00:02 2024-03-27T21:28:17.520 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:28:17.543 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:28:17.543 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:28:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-03-27T21:28:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T21:28:17.585 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T21:28:17.586 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T21:28:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T21:28:17.587 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:17.587 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:17.900 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:28:17.900 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:28:17.914 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-test 2024-03-27T21:28:18.438 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:28:18.479 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:28 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:18.534 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-27T21:28:18.570 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-27T21:28:18.631 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-27T21:28:18.633 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:18.634 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 40 M 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 166 k 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:28:18.635 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:18.636 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2024-03-27T21:28:18.636 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:18.636 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 41 M 2024-03-27T21:28:18.636 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 165 M 2024-03-27T21:28:18.636 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:28:18.670 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-27T21:28:18.697 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/6 2024-03-27T21:28:19.056 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-03-27T21:28:19.106 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-03-27T21:28:19.140 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-03-27T21:28:19.373 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 802 kB/s | 187 kB 00:00 2024-03-27T21:28:19.398 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): libcephsqlite-18.2.2-1021.g7c37d80f.el9. 335 kB/s | 166 kB 00:00 2024-03-27T21:28:21.123 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): ceph-test-18.2.2-1021.g7c37d80f.el9.x86_ 18 MB/s | 40 MB 00:02 2024-03-27T21:28:21.127 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:21.127 INFO:teuthology.orchestra.run.smithi063.stdout:Total 16 MB/s | 41 MB 00:02 2024-03-27T21:28:21.141 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:28:21.164 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:28:21.164 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:28:21.522 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:28:21.523 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:28:22.096 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:28:22.175 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-27T21:28:22.216 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-27T21:28:22.261 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-27T21:28:22.299 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-27T21:28:22.326 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/6 2024-03-27T21:28:22.604 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/6 2024-03-27T21:28:22.681 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 6/6 2024-03-27T21:28:24.716 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 6/6 2024-03-27T21:28:24.716 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/6 2024-03-27T21:28:24.716 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/6 2024-03-27T21:28:24.716 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-27T21:28:24.716 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-27T21:28:24.717 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-27T21:28:25.096 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-27T21:28:25.096 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: jq-1.6-16.el9.x86_64 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:25.097 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:25.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph 2024-03-27T21:28:25.914 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:37 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:26.072 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:26.074 INFO:teuthology.orchestra.run.smithi028.stdout:========================================================================================= 2024-03-27T21:28:26.074 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:28:26.074 INFO:teuthology.orchestra.run.smithi028.stdout:========================================================================================= 2024-03-27T21:28:26.074 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:26.074 INFO:teuthology.orchestra.run.smithi028.stdout: ceph x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 6.5 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 2.1 M 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 1.4 M 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 245 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 4.7 M 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 16 M 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T21:28:26.075 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T21:28:26.076 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout:========================================================================================= 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout:Install 33 Packages 2024-03-27T21:28:26.077 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:26.078 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 29 M 2024-03-27T21:28:26.078 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 104 M 2024-03-27T21:28:26.078 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:26.247 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/6 2024-03-27T21:28:26.342 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 6/6 2024-03-27T21:28:26.512 INFO:teuthology.orchestra.run.smithi028.stdout:(1/33): ceph-18.2.2-1021.g7c37d80f.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2024-03-27T21:28:26.938 INFO:teuthology.orchestra.run.smithi028.stdout:(2/33): ceph-mon-18.2.2-1021.g7c37d80f.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-03-27T21:28:26.988 INFO:teuthology.orchestra.run.smithi028.stdout:(3/33): ceph-mds-18.2.2-1021.g7c37d80f.el9.x86_ 3.2 MB/s | 2.1 MB 00:00 2024-03-27T21:28:27.021 INFO:teuthology.orchestra.run.smithi028.stdout:(4/33): ceph-mgr-18.2.2-1021.g7c37d80f.el9.x86_ 2.1 MB/s | 1.4 MB 00:00 2024-03-27T21:28:27.088 INFO:teuthology.orchestra.run.smithi028.stdout:(5/33): ceph-mgr-modules-core-18.2.2-1021.g7c37 2.4 MB/s | 245 kB 00:00 2024-03-27T21:28:27.130 INFO:teuthology.orchestra.run.smithi028.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 785 kB/s | 32 kB 00:00 2024-03-27T21:28:27.163 INFO:teuthology.orchestra.run.smithi028.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 144 kB 00:00 2024-03-27T21:28:27.188 INFO:teuthology.orchestra.run.smithi028.stdout:(8/33): python3-pytz-2021.1-5.el9.noarch.rpm 811 kB/s | 47 kB 00:00 2024-03-27T21:28:27.214 INFO:teuthology.orchestra.run.smithi028.stdout:(9/33): python3-toml-0.10.2-6.el9.noarch.rpm 768 kB/s | 39 kB 00:00 2024-03-27T21:28:27.247 INFO:teuthology.orchestra.run.smithi028.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-03-27T21:28:27.298 INFO:teuthology.orchestra.run.smithi028.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 14 MB/s | 1.1 MB 00:00 2024-03-27T21:28:27.323 INFO:teuthology.orchestra.run.smithi028.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-27T21:28:27.348 INFO:teuthology.orchestra.run.smithi028.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-27T21:28:27.374 INFO:teuthology.orchestra.run.smithi028.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-03-27T21:28:27.532 INFO:teuthology.orchestra.run.smithi028.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 274 kB/s | 43 kB 00:00 2024-03-27T21:28:27.691 INFO:teuthology.orchestra.run.smithi028.stdout:(16/33): ceph-osd-18.2.2-1021.g7c37d80f.el9.x86 22 MB/s | 16 MB 00:00 2024-03-27T21:28:27.716 INFO:teuthology.orchestra.run.smithi028.stdout:(17/33): python3-requests-2.25.1-8.el9.noarch.r 340 kB/s | 125 kB 00:00 2024-03-27T21:28:27.741 INFO:teuthology.orchestra.run.smithi028.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 822 kB/s | 172 kB 00:00 2024-03-27T21:28:27.844 INFO:teuthology.orchestra.run.smithi028.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 83 kB/s | 11 kB 00:00 2024-03-27T21:28:27.867 INFO:teuthology.orchestra.run.smithi028.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 141 kB/s | 18 kB 00:00 2024-03-27T21:28:27.901 INFO:teuthology.orchestra.run.smithi028.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 412 kB/s | 23 kB 00:00 2024-03-27T21:28:27.934 INFO:teuthology.orchestra.run.smithi028.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 289 kB/s | 19 kB 00:00 2024-03-27T21:28:27.960 INFO:teuthology.orchestra.run.smithi028.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 335 kB/s | 20 kB 00:00 2024-03-27T21:28:27.985 INFO:teuthology.orchestra.run.smithi028.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-03-27T21:28:28.043 INFO:teuthology.orchestra.run.smithi028.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 426 kB/s | 46 kB 00:00 2024-03-27T21:28:28.068 INFO:teuthology.orchestra.run.smithi028.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 724 kB/s | 79 kB 00:00 2024-03-27T21:28:28.102 INFO:teuthology.orchestra.run.smithi028.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-03-27T21:28:28.127 INFO:teuthology.orchestra.run.smithi028.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-03-27T21:28:28.161 INFO:teuthology.orchestra.run.smithi028.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 975 kB/s | 90 kB 00:00 2024-03-27T21:28:28.245 INFO:teuthology.orchestra.run.smithi028.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 252 kB/s | 36 kB 00:00 2024-03-27T21:28:28.295 INFO:teuthology.orchestra.run.smithi028.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-03-27T21:28:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 6/6 2024-03-27T21:28:28.395 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/6 2024-03-27T21:28:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/6 2024-03-27T21:28:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-27T21:28:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-27T21:28:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-27T21:28:28.495 INFO:teuthology.orchestra.run.smithi028.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 80 kB/s | 20 kB 00:00 2024-03-27T21:28:28.562 INFO:teuthology.orchestra.run.smithi028.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.0 MB/s | 427 kB 00:00 2024-03-27T21:28:28.566 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:28.566 INFO:teuthology.orchestra.run.smithi028.stdout:Total 12 MB/s | 29 MB 00:02 2024-03-27T21:28:28.581 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:28:28.624 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:28:28.624 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:28:28.779 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-27T21:28:28.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:28.779 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:28:28.779 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout: jq-1.6-16.el9.x86_64 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:28.780 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:28.995 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:28:28.995 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:28:29.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph 2024-03-27T21:28:29.639 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:39 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:29.806 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:29.807 INFO:teuthology.orchestra.run.smithi063.stdout:========================================================================================= 2024-03-27T21:28:29.807 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:28:29.807 INFO:teuthology.orchestra.run.smithi063.stdout:========================================================================================= 2024-03-27T21:28:29.807 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:28:29.807 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 6.5 k 2024-03-27T21:28:29.807 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 2.1 M 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 1.4 M 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 245 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 4.7 M 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 16 M 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T21:28:29.808 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T21:28:29.809 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout:========================================================================================= 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout:Install 33 Packages 2024-03-27T21:28:29.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:29.811 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 29 M 2024-03-27T21:28:29.811 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 104 M 2024-03-27T21:28:29.811 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:28:30.260 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:28:30.315 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-03-27T21:28:30.347 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-03-27T21:28:30.380 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-03-27T21:28:30.458 INFO:teuthology.orchestra.run.smithi063.stdout:(1/33): ceph-18.2.2-1021.g7c37d80f.el9.x86_64.r 28 kB/s | 6.5 kB 00:00 2024-03-27T21:28:30.476 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-03-27T21:28:30.553 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-03-27T21:28:30.600 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-03-27T21:28:30.600 INFO:teuthology.orchestra.run.smithi063.stdout:(2/33): ceph-mds-18.2.2-1021.g7c37d80f.el9.x86_ 5.6 MB/s | 2.1 MB 00:00 2024-03-27T21:28:30.675 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-03-27T21:28:30.729 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-03-27T21:28:30.766 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-03-27T21:28:30.826 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-03-27T21:28:30.893 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-03-27T21:28:30.926 INFO:teuthology.orchestra.run.smithi063.stdout:(3/33): ceph-mgr-18.2.2-1021.g7c37d80f.el9.x86_ 2.1 MB/s | 1.4 MB 00:00 2024-03-27T21:28:31.042 INFO:teuthology.orchestra.run.smithi063.stdout:(4/33): ceph-mgr-modules-core-18.2.2-1021.g7c37 2.1 MB/s | 245 kB 00:00 2024-03-27T21:28:31.093 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-03-27T21:28:31.136 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-03-27T21:28:31.160 INFO:teuthology.orchestra.run.smithi063.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 144 kB 00:00 2024-03-27T21:28:31.183 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-03-27T21:28:31.193 INFO:teuthology.orchestra.run.smithi063.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 956 kB/s | 32 kB 00:00 2024-03-27T21:28:31.226 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-03-27T21:28:31.226 INFO:teuthology.orchestra.run.smithi063.stdout:(7/33): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-27T21:28:31.256 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-03-27T21:28:31.261 INFO:teuthology.orchestra.run.smithi063.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-27T21:28:31.334 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-03-27T21:28:31.374 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-27T21:28:31.408 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-03-27T21:28:31.419 INFO:teuthology.orchestra.run.smithi063.stdout:(9/33): ceph-osd-18.2.2-1021.g7c37d80f.el9.x86_ 20 MB/s | 16 MB 00:00 2024-03-27T21:28:31.444 INFO:teuthology.orchestra.run.smithi063.stdout:(10/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 241 kB 00:00 2024-03-27T21:28:31.448 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-03-27T21:28:31.483 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-03-27T21:28:31.517 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-03-27T21:28:31.553 INFO:teuthology.orchestra.run.smithi063.stdout:(11/33): python3-cryptography-36.0.1-4.el9.x86_ 8.6 MB/s | 1.1 MB 00:00 2024-03-27T21:28:31.578 INFO:teuthology.orchestra.run.smithi063.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 772 kB/s | 103 kB 00:00 2024-03-27T21:28:31.603 INFO:teuthology.orchestra.run.smithi063.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-03-27T21:28:31.609 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-03-27T21:28:31.656 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-03-27T21:28:31.670 INFO:teuthology.orchestra.run.smithi063.stdout:(14/33): python3-urllib3-1.26.5-5.el9.noarch.rp 2.0 MB/s | 187 kB 00:00 2024-03-27T21:28:31.732 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-03-27T21:28:31.770 INFO:teuthology.orchestra.run.smithi063.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 748 kB/s | 125 kB 00:00 2024-03-27T21:28:31.881 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-03-27T21:28:31.946 INFO:teuthology.orchestra.run.smithi063.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 158 kB/s | 43 kB 00:00 2024-03-27T21:28:32.013 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-27T21:28:32.088 INFO:teuthology.orchestra.run.smithi063.stdout:(17/33): ceph-mon-18.2.2-1021.g7c37d80f.el9.x86 2.9 MB/s | 4.7 MB 00:01 2024-03-27T21:28:32.172 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1021.g7c37d80f.el9. 28/33 2024-03-27T21:28:32.196 INFO:teuthology.orchestra.run.smithi063.stdout:(18/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 403 kB/s | 172 kB 00:00 2024-03-27T21:28:32.202 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/33 2024-03-27T21:28:32.222 INFO:teuthology.orchestra.run.smithi063.stdout:(19/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-03-27T21:28:32.227 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/33 2024-03-27T21:28:32.228 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:32.228 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T21:28:32.228 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T21:28:32.228 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T21:28:32.228 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:32.263 INFO:teuthology.orchestra.run.smithi063.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2024-03-27T21:28:32.289 INFO:teuthology.orchestra.run.smithi063.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 352 kB/s | 23 kB 00:00 2024-03-27T21:28:32.306 INFO:teuthology.orchestra.run.smithi063.stdout:(22/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 49 kB/s | 11 kB 00:00 2024-03-27T21:28:32.331 INFO:teuthology.orchestra.run.smithi063.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 289 kB/s | 19 kB 00:00 2024-03-27T21:28:32.356 INFO:teuthology.orchestra.run.smithi063.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 293 kB/s | 20 kB 00:00 2024-03-27T21:28:32.431 INFO:teuthology.orchestra.run.smithi063.stdout:(25/33): python3-more-itertools-8.12.0-2.el9.no 786 kB/s | 79 kB 00:00 2024-03-27T21:28:32.457 INFO:teuthology.orchestra.run.smithi063.stdout:(26/33): python3-logutils-0.3.5-21.el9.noarch.r 307 kB/s | 46 kB 00:00 2024-03-27T21:28:32.498 INFO:teuthology.orchestra.run.smithi063.stdout:(27/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-03-27T21:28:32.524 INFO:teuthology.orchestra.run.smithi063.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 178 kB/s | 16 kB 00:00 2024-03-27T21:28:32.574 INFO:teuthology.orchestra.run.smithi063.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-03-27T21:28:32.608 INFO:teuthology.orchestra.run.smithi063.stdout:(30/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 596 kB/s | 90 kB 00:00 2024-03-27T21:28:32.658 INFO:teuthology.orchestra.run.smithi063.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-03-27T21:28:32.691 INFO:teuthology.orchestra.run.smithi063.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-03-27T21:28:32.717 INFO:teuthology.orchestra.run.smithi063.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-03-27T21:28:32.723 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:32.724 INFO:teuthology.orchestra.run.smithi063.stdout:Total 9.9 MB/s | 29 MB 00:02 2024-03-27T21:28:32.738 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:28:32.782 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:28:32.782 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:28:33.145 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:28:33.146 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:28:33.736 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/33 2024-03-27T21:28:33.762 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/33 2024-03-27T21:28:33.762 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:33.762 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T21:28:33.762 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T21:28:33.763 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T21:28:33.763 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:34.228 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 31/33 2024-03-27T21:28:34.251 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 31/33 2024-03-27T21:28:34.251 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:34.251 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T21:28:34.251 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T21:28:34.251 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T21:28:34.251 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:34.426 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:28:34.462 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 32/33 2024-03-27T21:28:34.485 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 32/33 2024-03-27T21:28:34.485 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:34.485 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T21:28:34.485 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T21:28:34.485 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T21:28:34.485 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:34.494 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-03-27T21:28:34.527 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-03-27T21:28:34.545 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 33/33 2024-03-27T21:28:34.569 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-03-27T21:28:34.663 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-03-27T21:28:34.740 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-03-27T21:28:34.788 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-03-27T21:28:34.870 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-03-27T21:28:34.926 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-03-27T21:28:34.961 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-03-27T21:28:35.018 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-03-27T21:28:35.088 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-03-27T21:28:35.291 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-03-27T21:28:35.347 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-03-27T21:28:35.386 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-03-27T21:28:35.420 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-03-27T21:28:35.450 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-03-27T21:28:35.529 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-03-27T21:28:35.569 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-27T21:28:35.602 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-03-27T21:28:35.643 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-03-27T21:28:35.687 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-03-27T21:28:35.721 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-03-27T21:28:35.814 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-03-27T21:28:35.860 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-03-27T21:28:35.935 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-03-27T21:28:36.077 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-03-27T21:28:36.214 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 33/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 3/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 4/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/33 2024-03-27T21:28:36.236 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1021.g7c37d80f.el9. 6/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-03-27T21:28:36.237 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-03-27T21:28:36.238 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-03-27T21:28:36.377 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1021.g7c37d80f.el9. 28/33 2024-03-27T21:28:36.406 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/33 2024-03-27T21:28:36.433 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 29/33 2024-03-27T21:28:36.433 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:36.433 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T21:28:36.433 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T21:28:36.433 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T21:28:36.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:37.113 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T21:28:37.114 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T21:28:37.115 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:37.116 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:37.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-base 2024-03-27T21:28:37.932 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/33 2024-03-27T21:28:37.959 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 30/33 2024-03-27T21:28:37.960 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:37.960 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T21:28:37.960 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T21:28:37.960 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T21:28:37.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:38.044 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:50 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:38.145 INFO:teuthology.orchestra.run.smithi028.stdout:Package ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:28:38.199 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:38.200 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:28:38.201 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:38.263 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install cephadm 2024-03-27T21:28:38.424 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 31/33 2024-03-27T21:28:38.447 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 31/33 2024-03-27T21:28:38.447 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:38.447 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T21:28:38.447 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T21:28:38.447 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T21:28:38.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:38.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 32/33 2024-03-27T21:28:38.681 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 32/33 2024-03-27T21:28:38.681 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:38.681 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T21:28:38.681 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T21:28:38.681 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T21:28:38.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:38.750 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 33/33 2024-03-27T21:28:38.830 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:50 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:38.984 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 224 k 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:38.985 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:38.986 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:38.986 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:28:38.986 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:38.986 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 224 k 2024-03-27T21:28:38.986 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 216 k 2024-03-27T21:28:38.986 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:39.368 INFO:teuthology.orchestra.run.smithi028.stdout:cephadm-18.2.2-1021.g7c37d80f.el9.noarch.rpm 586 kB/s | 224 kB 00:00 2024-03-27T21:28:39.369 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:39.369 INFO:teuthology.orchestra.run.smithi028.stdout:Total 583 kB/s | 224 kB 00:00 2024-03-27T21:28:39.369 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:28:39.375 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:28:39.375 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:28:39.378 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:28:39.378 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:28:39.453 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:28:39.909 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:40.005 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:40.410 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:40.482 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 33/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 3/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 4/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 5/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1021.g7c37d80f.el9. 6/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-03-27T21:28:40.483 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 15/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-03-27T21:28:40.484 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-03-27T21:28:40.485 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-03-27T21:28:40.485 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-03-27T21:28:40.485 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-03-27T21:28:40.485 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-03-27T21:28:40.485 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-03-27T21:28:40.485 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-03-27T21:28:40.486 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-03-27T21:28:40.486 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-03-27T21:28:40.819 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:40.819 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:40.819 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:40.819 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:40.819 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:40.819 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:41.003 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-immutable-object-cache 2024-03-27T21:28:41.369 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-03-27T21:28:41.369 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:41.369 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T21:28:41.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T21:28:41.371 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:41.372 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:41.574 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:53 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:41.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-base 2024-03-27T21:28:41.732 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:41.732 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:41.732 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-27T21:28:41.732 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 142 k 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 142 k 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 395 k 2024-03-27T21:28:41.733 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:42.070 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-immutable-object-cache-18.2.2-1021.g7c37d8 423 kB/s | 142 kB 00:00 2024-03-27T21:28:42.071 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:42.071 INFO:teuthology.orchestra.run.smithi028.stdout:Total 421 kB/s | 142 kB 00:00 2024-03-27T21:28:42.071 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:28:42.079 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:28:42.079 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:28:42.135 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:28:42.135 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:28:42.231 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:52 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:42.280 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:28:42.330 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-base-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:28:42.338 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f. 1/1 2024-03-27T21:28:42.362 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f. 1/1 2024-03-27T21:28:42.362 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:42.362 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T21:28:42.362 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:42.385 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:42.386 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:28:42.386 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:42.453 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install cephadm 2024-03-27T21:28:43.017 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:53 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:43.171 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 224 k 2024-03-27T21:28:43.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 224 k 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 216 k 2024-03-27T21:28:43.173 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:28:43.319 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f. 1/1 2024-03-27T21:28:43.320 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:43.320 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:43.320 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:43.320 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:43.320 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:43.521 INFO:teuthology.orchestra.run.smithi063.stdout:cephadm-18.2.2-1021.g7c37d80f.el9.noarch.rpm 645 kB/s | 224 kB 00:00 2024-03-27T21:28:43.521 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:43.522 INFO:teuthology.orchestra.run.smithi063.stdout:Total 642 kB/s | 224 kB 00:00 2024-03-27T21:28:43.522 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:28:43.528 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:28:43.528 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:28:43.530 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:28:43.531 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:28:43.565 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr 2024-03-27T21:28:43.608 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:28:44.031 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:44.111 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:44.138 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:56 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:44.236 INFO:teuthology.orchestra.run.smithi028.stdout:Package ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:28:44.291 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:44.292 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:28:44.292 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:44.354 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-dashboard 2024-03-27T21:28:44.463 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/1 2024-03-27T21:28:44.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:44.761 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:28:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:44.761 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:44.761 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:44.922 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:56 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:44.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-immutable-object-cache 2024-03-27T21:28:45.077 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:45.078 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:45.078 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:28:45.078 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:45.078 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:45.078 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 1.8 M 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 23 k 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 15 k 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout:Install 5 Packages 2024-03-27T21:28:45.079 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:45.080 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 2.0 M 2024-03-27T21:28:45.080 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 8.6 M 2024-03-27T21:28:45.080 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:45.323 INFO:teuthology.orchestra.run.smithi028.stdout:(1/5): ceph-prometheus-alerts-18.2.2-1021.g7c37 77 kB/s | 15 kB 00:00 2024-03-27T21:28:45.374 INFO:teuthology.orchestra.run.smithi028.stdout:(2/5): ceph-grafana-dashboards-18.2.2-1021.g7c3 96 kB/s | 23 kB 00:00 2024-03-27T21:28:45.399 INFO:teuthology.orchestra.run.smithi028.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 410 kB/s | 31 kB 00:00 2024-03-27T21:28:45.482 INFO:teuthology.orchestra.run.smithi028.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 1.7 MB/s | 188 kB 00:00 2024-03-27T21:28:45.525 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:55 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:45.680 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:45.681 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:45.681 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-03-27T21:28:45.681 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:45.681 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 142 k 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 142 k 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 395 k 2024-03-27T21:28:45.682 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:28:45.699 INFO:teuthology.orchestra.run.smithi028.stdout:(5/5): ceph-mgr-dashboard-18.2.2-1021.g7c37d80f 3.1 MB/s | 1.8 MB 00:00 2024-03-27T21:28:45.700 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:45.701 INFO:teuthology.orchestra.run.smithi028.stdout:Total 3.3 MB/s | 2.0 MB 00:00 2024-03-27T21:28:45.701 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:28:45.708 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:28:45.708 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:28:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:28:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:28:46.006 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:28:46.026 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-immutable-object-cache-18.2.2-1021.g7c37d8 414 kB/s | 142 kB 00:00 2024-03-27T21:28:46.027 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:46.027 INFO:teuthology.orchestra.run.smithi063.stdout:Total 413 kB/s | 142 kB 00:00 2024-03-27T21:28:46.027 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:28:46.035 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:28:46.036 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:28:46.089 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-03-27T21:28:46.090 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:28:46.091 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:28:46.121 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-03-27T21:28:46.149 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1021.g7c37d80f.el9.n 3/5 2024-03-27T21:28:46.236 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:28:46.302 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f. 1/1 2024-03-27T21:28:46.326 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f. 1/1 2024-03-27T21:28:46.327 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:28:46.327 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T21:28:46.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:46.391 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1021.g7c37d80f.el9. 4/5 2024-03-27T21:28:46.418 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarc 5/5 2024-03-27T21:28:46.953 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarc 5/5 2024-03-27T21:28:46.953 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1021.g7c37d80f.el9. 1/5 2024-03-27T21:28:46.954 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarc 2/5 2024-03-27T21:28:46.954 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1021.g7c37d80f.el9.n 3/5 2024-03-27T21:28:46.954 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-03-27T21:28:47.260 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-03-27T21:28:47.260 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:47.261 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f. 1/1 2024-03-27T21:28:47.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:47.311 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:28:47.312 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:28:47.312 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:47.312 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:47.436 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-27T21:28:47.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr 2024-03-27T21:28:48.002 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:00 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:48.158 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:48.159 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================================ 2024-03-27T21:28:48.159 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:28:48.159 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================================ 2024-03-27T21:28:48.159 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:48.159 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 7.4 M 2024-03-27T21:28:48.159 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================================ 2024-03-27T21:28:48.160 INFO:teuthology.orchestra.run.smithi028.stdout:Install 12 Packages 2024-03-27T21:28:48.161 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:48.161 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 37 M 2024-03-27T21:28:48.161 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 209 M 2024-03-27T21:28:48.161 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:48.181 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:58 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:48.281 INFO:teuthology.orchestra.run.smithi063.stdout:Package ceph-mgr-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:28:48.336 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:48.337 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:28:48.337 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:48.412 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-dashboard 2024-03-27T21:28:48.513 INFO:teuthology.orchestra.run.smithi028.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 223 kB/s | 32 kB 00:00 2024-03-27T21:28:48.547 INFO:teuthology.orchestra.run.smithi028.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 523 kB/s | 17 kB 00:00 2024-03-27T21:28:48.588 INFO:teuthology.orchestra.run.smithi028.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 856 kB/s | 34 kB 00:00 2024-03-27T21:28:48.647 INFO:teuthology.orchestra.run.smithi028.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-27T21:28:48.831 INFO:teuthology.orchestra.run.smithi028.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-03-27T21:28:48.889 INFO:teuthology.orchestra.run.smithi028.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-03-27T21:28:48.914 INFO:teuthology.orchestra.run.smithi028.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.6 MB/s | 217 kB 00:00 2024-03-27T21:28:48.978 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:00:58 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:49.073 INFO:teuthology.orchestra.run.smithi028.stdout:(8/12): ceph-mgr-diskprediction-local-18.2.2-10 11 MB/s | 7.4 MB 00:00 2024-03-27T21:28:49.132 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 1.8 M 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 23 k 2024-03-27T21:28:49.133 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 15 k 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout:Install 5 Packages 2024-03-27T21:28:49.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:49.135 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 2.0 M 2024-03-27T21:28:49.135 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 8.6 M 2024-03-27T21:28:49.135 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:28:49.307 INFO:teuthology.orchestra.run.smithi028.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-03-27T21:28:49.365 INFO:teuthology.orchestra.run.smithi028.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-03-27T21:28:49.415 INFO:teuthology.orchestra.run.smithi028.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 575 kB/s | 195 kB 00:00 2024-03-27T21:28:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:(1/5): ceph-grafana-dashboards-18.2.2-1021.g7c3 121 kB/s | 23 kB 00:00 2024-03-27T21:28:49.497 INFO:teuthology.orchestra.run.smithi063.stdout:(2/5): ceph-prometheus-alerts-18.2.2-1021.g7c37 68 kB/s | 15 kB 00:00 2024-03-27T21:28:49.747 INFO:teuthology.orchestra.run.smithi063.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 112 kB/s | 31 kB 00:00 2024-03-27T21:28:49.789 INFO:teuthology.orchestra.run.smithi063.stdout:(4/5): ceph-mgr-dashboard-18.2.2-1021.g7c37d80f 3.5 MB/s | 1.8 MB 00:00 2024-03-27T21:28:49.897 INFO:teuthology.orchestra.run.smithi063.stdout:(5/5): python3-routes-2.5.1-5.el9.noarch.rpm 471 kB/s | 188 kB 00:00 2024-03-27T21:28:49.900 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:49.901 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.7 MB/s | 2.0 MB 00:00 2024-03-27T21:28:49.901 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:28:49.908 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:28:49.908 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:28:49.940 INFO:teuthology.orchestra.run.smithi028.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 387 kB/s | 245 kB 00:00 2024-03-27T21:28:49.944 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:49.944 INFO:teuthology.orchestra.run.smithi028.stdout:Total 21 MB/s | 37 MB 00:01 2024-03-27T21:28:49.969 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:28:49.969 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:28:49.987 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:28:50.012 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:28:50.012 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:28:50.204 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:28:50.296 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-03-27T21:28:50.327 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-03-27T21:28:50.356 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1021.g7c37d80f.el9.n 3/5 2024-03-27T21:28:50.462 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:28:50.462 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:28:50.604 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1021.g7c37d80f.el9. 4/5 2024-03-27T21:28:50.642 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarc 5/5 2024-03-27T21:28:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarc 5/5 2024-03-27T21:28:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1021.g7c37d80f.el9. 1/5 2024-03-27T21:28:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarc 2/5 2024-03-27T21:28:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1021.g7c37d80f.el9.n 3/5 2024-03-27T21:28:51.166 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-03-27T21:28:51.179 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:28:51.247 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-27T21:28:51.286 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-27T21:28:51.383 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-27T21:28:51.423 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:51.468 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:28:51.613 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-27T21:28:51.647 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-27T21:28:51.648 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-27T21:28:51.729 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-27T21:28:52.212 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:02 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:28:52.367 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:28:52.368 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 7.4 M 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T21:28:52.369 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout:Install 12 Packages 2024-03-27T21:28:52.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:28:52.371 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 37 M 2024-03-27T21:28:52.371 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 209 M 2024-03-27T21:28:52.371 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:28:52.407 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-27T21:28:52.530 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-27T21:28:52.586 INFO:teuthology.orchestra.run.smithi063.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 32 kB 00:00 2024-03-27T21:28:52.620 INFO:teuthology.orchestra.run.smithi063.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 524 kB/s | 17 kB 00:00 2024-03-27T21:28:52.654 INFO:teuthology.orchestra.run.smithi063.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-27T21:28:52.804 INFO:teuthology.orchestra.run.smithi063.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 32 MB/s | 4.7 MB 00:00 2024-03-27T21:28:52.929 INFO:teuthology.orchestra.run.smithi063.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-27T21:28:52.972 INFO:teuthology.orchestra.run.smithi063.stdout:(6/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.2 MB/s | 217 kB 00:00 2024-03-27T21:28:53.172 INFO:teuthology.orchestra.run.smithi063.stdout:(7/12): ceph-mgr-diskprediction-local-18.2.2-10 10 MB/s | 7.4 MB 00:00 2024-03-27T21:28:53.230 INFO:teuthology.orchestra.run.smithi063.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2024-03-27T21:28:53.464 INFO:teuthology.orchestra.run.smithi063.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-03-27T21:28:53.731 INFO:teuthology.orchestra.run.smithi063.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 392 kB/s | 195 kB 00:00 2024-03-27T21:28:53.838 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-27T21:28:53.998 INFO:teuthology.orchestra.run.smithi063.stdout:(11/12): libgfortran-11.4.1-3.el9.x86_64.rpm 975 kB/s | 803 kB 00:00 2024-03-27T21:28:54.389 INFO:teuthology.orchestra.run.smithi063.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 265 kB/s | 245 kB 00:00 2024-03-27T21:28:54.392 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:54.392 INFO:teuthology.orchestra.run.smithi063.stdout:Total 18 MB/s | 37 MB 00:02 2024-03-27T21:28:54.436 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:28:54.462 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:28:54.462 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:28:54.911 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-27T21:28:54.921 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:28:54.921 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:28:54.936 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d 12/12 2024-03-27T21:28:55.640 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:28:55.713 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-27T21:28:55.744 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-27T21:28:55.841 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-27T21:28:55.880 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-27T21:28:56.075 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-27T21:28:56.104 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-27T21:28:56.186 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-27T21:28:56.859 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-27T21:28:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-27T21:28:57.478 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d 12/12 2024-03-27T21:28:57.478 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d 1/12 2024-03-27T21:28:57.478 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-27T21:28:57.478 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-27T21:28:57.478 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-27T21:28:57.479 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T21:28:57.896 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:57.897 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:28:58.247 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-rook 2024-03-27T21:28:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-27T21:28:58.827 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:10 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:28:58.985 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 49 k 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T21:28:58.987 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout:Install 13 Packages 2024-03-27T21:28:58.988 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:28:58.989 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 2.0 M 2024-03-27T21:28:58.989 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 26 M 2024-03-27T21:28:58.989 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:28:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-27T21:28:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d 12/12 2024-03-27T21:28:59.477 INFO:teuthology.orchestra.run.smithi028.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 191 kB/s | 24 kB 00:00 2024-03-27T21:28:59.494 INFO:teuthology.orchestra.run.smithi028.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 125 kB/s | 18 kB 00:00 2024-03-27T21:28:59.544 INFO:teuthology.orchestra.run.smithi028.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-03-27T21:28:59.569 INFO:teuthology.orchestra.run.smithi028.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-27T21:28:59.594 INFO:teuthology.orchestra.run.smithi028.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-27T21:28:59.620 INFO:teuthology.orchestra.run.smithi028.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 852 kB/s | 43 kB 00:00 2024-03-27T21:28:59.637 INFO:teuthology.orchestra.run.smithi028.stdout:(7/13): ceph-mgr-rook-18.2.2-1021.g7c37d80f.el9 171 kB/s | 49 kB 00:00 2024-03-27T21:28:59.737 INFO:teuthology.orchestra.run.smithi028.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 128 kB/s | 15 kB 00:00 2024-03-27T21:28:59.771 INFO:teuthology.orchestra.run.smithi028.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 183 kB/s | 32 kB 00:00 2024-03-27T21:28:59.804 INFO:teuthology.orchestra.run.smithi028.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.2 MB/s | 203 kB 00:00 2024-03-27T21:28:59.872 INFO:teuthology.orchestra.run.smithi028.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-03-27T21:28:59.897 INFO:teuthology.orchestra.run.smithi028.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 472 kB/s | 59 kB 00:00 2024-03-27T21:28:59.988 INFO:teuthology.orchestra.run.smithi028.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.1 MB/s | 1.0 MB 00:00 2024-03-27T21:28:59.990 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:28:59.991 INFO:teuthology.orchestra.run.smithi028.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-03-27T21:28:59.992 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:00.005 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:00.005 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:00.100 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:00.101 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:00.620 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:00.801 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-27T21:29:00.858 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-27T21:29:00.913 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-27T21:29:00.949 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-27T21:29:00.991 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-27T21:29:01.090 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-27T21:29:01.199 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-27T21:29:01.260 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-27T21:29:02.029 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-27T21:29:02.080 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-27T21:29:02.114 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d 12/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d 1/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-27T21:29:02.143 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-27T21:29:02.162 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-27T21:29:02.191 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 13/13 2024-03-27T21:29:02.522 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T21:29:02.523 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T21:29:02.524 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T21:29:02.525 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:02.525 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:02.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-rook 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 13/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 1/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-27T21:29:02.913 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T21:29:03.269 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T21:29:03.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T21:29:03.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T21:29:03.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T21:29:03.270 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T21:29:03.270 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:03.270 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:03.453 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:13 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:03.493 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-cephadm 2024-03-27T21:29:03.609 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:03.610 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================== 2024-03-27T21:29:03.610 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================== 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 49 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T21:29:03.611 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================== 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:03.612 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 2.0 M 2024-03-27T21:29:03.613 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 26 M 2024-03-27T21:29:03.613 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:03.835 INFO:teuthology.orchestra.run.smithi063.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 173 kB/s | 24 kB 00:00 2024-03-27T21:29:03.860 INFO:teuthology.orchestra.run.smithi063.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 109 kB/s | 18 kB 00:00 2024-03-27T21:29:03.910 INFO:teuthology.orchestra.run.smithi063.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-27T21:29:03.927 INFO:teuthology.orchestra.run.smithi063.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-27T21:29:03.952 INFO:teuthology.orchestra.run.smithi063.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.9 MB/s | 211 kB 00:00 2024-03-27T21:29:03.978 INFO:teuthology.orchestra.run.smithi063.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 858 kB/s | 43 kB 00:00 2024-03-27T21:29:04.003 INFO:teuthology.orchestra.run.smithi063.stdout:(7/13): ceph-mgr-rook-18.2.2-1021.g7c37d80f.el9 159 kB/s | 49 kB 00:00 2024-03-27T21:29:04.064 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:16 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:04.078 INFO:teuthology.orchestra.run.smithi063.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 149 kB/s | 15 kB 00:00 2024-03-27T21:29:04.104 INFO:teuthology.orchestra.run.smithi063.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 213 kB/s | 32 kB 00:00 2024-03-27T21:29:04.180 INFO:teuthology.orchestra.run.smithi063.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 787 kB/s | 59 kB 00:00 2024-03-27T21:29:04.219 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:04.219 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-27T21:29:04.219 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 138 k 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout:Install 6 Packages 2024-03-27T21:29:04.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:04.221 INFO:teuthology.orchestra.run.smithi063.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 932 kB/s | 203 kB 00:00 2024-03-27T21:29:04.221 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 6.8 M 2024-03-27T21:29:04.221 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 33 M 2024-03-27T21:29:04.221 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:04.257 INFO:teuthology.orchestra.run.smithi063.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-03-27T21:29:04.321 INFO:teuthology.orchestra.run.smithi063.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.2 MB/s | 1.0 MB 00:00 2024-03-27T21:29:04.323 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:04.323 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.9 MB/s | 2.0 MB 00:00 2024-03-27T21:29:04.323 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:04.337 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:04.337 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:04.434 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:04.435 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:04.951 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:05.022 INFO:teuthology.orchestra.run.smithi028.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 5.8 MB 00:00 2024-03-27T21:29:05.047 INFO:teuthology.orchestra.run.smithi028.stdout:(2/6): ceph-mgr-cephadm-18.2.2-1021.g7c37d80f.e 421 kB/s | 138 kB 00:00 2024-03-27T21:29:05.089 INFO:teuthology.orchestra.run.smithi028.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 670 kB/s | 248 kB 00:00 2024-03-27T21:29:05.134 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-27T21:29:05.182 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-27T21:29:05.239 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-27T21:29:05.274 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-27T21:29:05.315 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-27T21:29:05.412 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-27T21:29:05.506 INFO:teuthology.orchestra.run.smithi028.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 122 kB/s | 51 kB 00:00 2024-03-27T21:29:05.522 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-27T21:29:05.531 INFO:teuthology.orchestra.run.smithi028.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 119 kB/s | 58 kB 00:00 2024-03-27T21:29:05.575 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-27T21:29:05.806 INFO:teuthology.orchestra.run.smithi028.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 699 kB/s | 548 kB 00:00 2024-03-27T21:29:05.809 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:05.809 INFO:teuthology.orchestra.run.smithi028.stdout:Total 4.3 MB/s | 6.8 MB 00:01 2024-03-27T21:29:05.823 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:05.835 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:05.835 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:05.930 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:05.931 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:06.246 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:06.333 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-27T21:29:06.388 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-27T21:29:06.422 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-27T21:29:06.427 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-27T21:29:06.470 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-27T21:29:06.492 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-27T21:29:06.499 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 13/13 2024-03-27T21:29:07.043 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-27T21:29:07.120 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-27T21:29:07.181 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-27T21:29:07.211 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 6/6 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 13/13 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 1/13 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-27T21:29:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-27T21:29:07.255 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-27T21:29:07.255 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-27T21:29:07.255 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-27T21:29:07.255 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-27T21:29:07.255 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-27T21:29:07.255 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-27T21:29:07.618 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-27T21:29:07.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:07.618 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:07.618 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:07.618 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:07.619 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:07.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-mgr-cephadm 2024-03-27T21:29:07.986 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 6/6 2024-03-27T21:29:07.986 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/6 2024-03-27T21:29:07.986 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-27T21:29:07.986 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-27T21:29:07.986 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-27T21:29:07.986 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T21:29:08.292 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:08.293 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:08.485 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:18 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:08.540 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-fuse 2024-03-27T21:29:08.642 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:08.642 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================== 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================== 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 138 k 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:======================================================================================== 2024-03-27T21:29:08.643 INFO:teuthology.orchestra.run.smithi063.stdout:Install 6 Packages 2024-03-27T21:29:08.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:08.644 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 6.8 M 2024-03-27T21:29:08.644 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 33 M 2024-03-27T21:29:08.644 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:09.116 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:21 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:09.181 INFO:teuthology.orchestra.run.smithi063.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-03-27T21:29:09.247 INFO:teuthology.orchestra.run.smithi063.stdout:(2/6): ceph-mgr-cephadm-18.2.2-1021.g7c37d80f.e 411 kB/s | 138 kB 00:00 2024-03-27T21:29:09.273 INFO:teuthology.orchestra.run.smithi063.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 686 kB/s | 248 kB 00:00 2024-03-27T21:29:09.277 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:09.277 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:09.277 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:29:09.277 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 844 k 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout:Install 2 Packages 2024-03-27T21:29:09.278 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:09.279 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 922 k 2024-03-27T21:29:09.279 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 2.7 M 2024-03-27T21:29:09.279 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:09.340 INFO:teuthology.orchestra.run.smithi063.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.2 MB/s | 51 kB 00:00 2024-03-27T21:29:09.390 INFO:teuthology.orchestra.run.smithi063.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 409 kB/s | 58 kB 00:00 2024-03-27T21:29:09.407 INFO:teuthology.orchestra.run.smithi028.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 614 kB/s | 79 kB 00:00 2024-03-27T21:29:09.440 INFO:teuthology.orchestra.run.smithi063.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.1 MB/s | 548 kB 00:00 2024-03-27T21:29:09.443 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:09.443 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.5 MB/s | 6.8 MB 00:00 2024-03-27T21:29:09.456 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:09.467 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:09.467 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:09.560 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:09.561 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:09.733 INFO:teuthology.orchestra.run.smithi028.stdout:(2/2): ceph-fuse-18.2.2-1021.g7c37d80f.el9.x86_ 1.8 MB/s | 844 kB 00:00 2024-03-27T21:29:09.734 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:09.734 INFO:teuthology.orchestra.run.smithi028.stdout:Total 2.0 MB/s | 922 kB 00:00 2024-03-27T21:29:09.734 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:09.757 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:09.757 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:09.835 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:09.835 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:09.886 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:10.034 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:10.065 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-27T21:29:10.117 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-27T21:29:10.168 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-27T21:29:10.243 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/2 2024-03-27T21:29:10.667 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-27T21:29:10.763 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-27T21:29:10.824 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-27T21:29:10.853 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 6/6 2024-03-27T21:29:10.928 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/2 2024-03-27T21:29:10.929 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/2 2024-03-27T21:29:11.215 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-27T21:29:11.215 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:11.215 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:11.215 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-27T21:29:11.215 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:11.216 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:11.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-volume 2024-03-27T21:29:11.663 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 6/6 2024-03-27T21:29:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 1/6 2024-03-27T21:29:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-27T21:29:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-27T21:29:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-27T21:29:11.664 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-27T21:29:11.966 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-27T21:29:11.966 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:11.966 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:11.966 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:11.966 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T21:29:11.967 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T21:29:11.967 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T21:29:11.967 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T21:29:11.967 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T21:29:11.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:11.967 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:12.032 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:24 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 264 k 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-27T21:29:12.192 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout:Install 2 Packages 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 332 k 2024-03-27T21:29:12.193 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 1.5 M 2024-03-27T21:29:12.194 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:12.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-fuse 2024-03-27T21:29:12.312 INFO:teuthology.orchestra.run.smithi028.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 583 kB/s | 69 kB 00:00 2024-03-27T21:29:12.461 INFO:teuthology.orchestra.run.smithi028.stdout:(2/2): ceph-volume-18.2.2-1021.g7c37d80f.el9.no 985 kB/s | 264 kB 00:00 2024-03-27T21:29:12.463 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:12.463 INFO:teuthology.orchestra.run.smithi028.stdout:Total 1.2 MB/s | 332 kB 00:00 2024-03-27T21:29:12.463 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:12.472 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:12.472 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:12.512 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:12.513 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:12.660 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:12.787 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:22 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:12.851 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-27T21:29:12.880 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 2/2 2024-03-27T21:29:12.896 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 2/2 2024-03-27T21:29:12.896 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:29:12.896 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T21:29:12.896 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:12.942 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 844 k 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T21:29:12.943 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:12.944 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:12.944 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:12.944 INFO:teuthology.orchestra.run.smithi063.stdout:Install 2 Packages 2024-03-27T21:29:12.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:12.944 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 922 k 2024-03-27T21:29:12.944 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 2.7 M 2024-03-27T21:29:12.945 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:13.066 INFO:teuthology.orchestra.run.smithi063.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 646 kB/s | 79 kB 00:00 2024-03-27T21:29:13.258 INFO:teuthology.orchestra.run.smithi063.stdout:(2/2): ceph-fuse-18.2.2-1021.g7c37d80f.el9.x86_ 2.6 MB/s | 844 kB 00:00 2024-03-27T21:29:13.259 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:13.260 INFO:teuthology.orchestra.run.smithi063.stdout:Total 2.9 MB/s | 922 kB 00:00 2024-03-27T21:29:13.260 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:13.280 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:13.281 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:13.355 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:13.356 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:13.547 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:13.614 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 1/2 2024-03-27T21:29:13.677 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-27T21:29:13.744 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/2 2024-03-27T21:29:13.994 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-27T21:29:13.994 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:13.995 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:13.995 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:13.995 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T21:29:13.995 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:13.995 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:14.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install librados-devel 2024-03-27T21:29:14.385 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2/2 2024-03-27T21:29:14.385 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/2 2024-03-27T21:29:14.684 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-27T21:29:14.684 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:14.684 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:14.684 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-27T21:29:14.684 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:14.685 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:14.889 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:26 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:14.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-volume 2024-03-27T21:29:15.043 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 127 k 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:15.044 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 127 k 2024-03-27T21:29:15.045 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 456 k 2024-03-27T21:29:15.045 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:15.367 INFO:teuthology.orchestra.run.smithi028.stdout:librados-devel-18.2.2-1021.g7c37d80f.el9.x86_64 394 kB/s | 127 kB 00:00 2024-03-27T21:29:15.368 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:15.368 INFO:teuthology.orchestra.run.smithi028.stdout:Total 392 kB/s | 127 kB 00:00 2024-03-27T21:29:15.368 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:15.373 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:15.373 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:15.431 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:15.543 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:25 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:15.581 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:15.684 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:15.698 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:15.698 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:18.2.2-1021.g7c37d80f.el9 ceph-noarch 264 k 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout:Install 2 Packages 2024-03-27T21:29:15.699 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:15.700 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 332 k 2024-03-27T21:29:15.700 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 1.5 M 2024-03-27T21:29:15.700 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:15.856 INFO:teuthology.orchestra.run.smithi063.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 443 kB/s | 69 kB 00:00 2024-03-27T21:29:16.064 INFO:teuthology.orchestra.run.smithi063.stdout:(2/2): ceph-volume-18.2.2-1021.g7c37d80f.el9.no 725 kB/s | 264 kB 00:00 2024-03-27T21:29:16.065 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:16.066 INFO:teuthology.orchestra.run.smithi063.stdout:Total 908 kB/s | 332 kB 00:00 2024-03-27T21:29:16.066 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:16.075 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:16.075 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:16.111 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:16.111 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:16.135 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:16.259 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:16.448 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-27T21:29:16.448 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:16.448 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:16.448 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:16.448 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:16.448 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:16.449 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:16.483 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 2/2 2024-03-27T21:29:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 2/2 2024-03-27T21:29:16.499 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:29:16.499 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T21:29:16.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:16.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install libcephfs2 2024-03-27T21:29:17.239 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 1/2 2024-03-27T21:29:17.243 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:29 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:17.344 INFO:teuthology.orchestra.run.smithi028.stdout:Package libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:17.400 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:17.401 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:17.401 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:17.474 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install libcephfs-devel 2024-03-27T21:29:17.571 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-27T21:29:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:17.572 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:18.2.2-1021.g7c37d80f.el9.noarch 2024-03-27T21:29:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T21:29:17.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:17.572 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:17.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados-devel 2024-03-27T21:29:18.046 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:30 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:18.200 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 31 k 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:18.201 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:29:18.202 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:18.202 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 31 k 2024-03-27T21:29:18.202 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 139 k 2024-03-27T21:29:18.202 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:18.452 INFO:teuthology.orchestra.run.smithi028.stdout:libcephfs-devel-18.2.2-1021.g7c37d80f.el9.x86_6 124 kB/s | 31 kB 00:00 2024-03-27T21:29:18.453 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:18.453 INFO:teuthology.orchestra.run.smithi028.stdout:Total 123 kB/s | 31 kB 00:00 2024-03-27T21:29:18.453 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:18.457 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:18.457 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:18.484 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:18.484 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:18.513 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:28 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:18.595 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:18.670 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 127 k 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:18.671 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:18.672 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:18.672 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:29:18.672 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:18.672 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 127 k 2024-03-27T21:29:18.672 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 456 k 2024-03-27T21:29:18.672 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:18.727 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:18.994 INFO:teuthology.orchestra.run.smithi063.stdout:librados-devel-18.2.2-1021.g7c37d80f.el9.x86_64 393 kB/s | 127 kB 00:00 2024-03-27T21:29:18.995 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:18.995 INFO:teuthology.orchestra.run.smithi063.stdout:Total 391 kB/s | 127 kB 00:00 2024-03-27T21:29:18.995 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:19.001 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:19.001 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:19.059 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:19.059 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:19.094 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:19.206 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:19.322 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:19.347 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:19.347 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:19.347 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:19.347 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:19.347 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:19.347 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:19.521 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install librados2 2024-03-27T21:29:19.813 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:20.092 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:32 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:20.126 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:20.126 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:20.126 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:20.126 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:20.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:20.127 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:20.191 INFO:teuthology.orchestra.run.smithi028.stdout:Package librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:20.246 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:20.247 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:20.247 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:20.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install librbd1 2024-03-27T21:29:20.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs2 2024-03-27T21:29:20.877 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:32 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:20.954 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:30 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:20.976 INFO:teuthology.orchestra.run.smithi028.stdout:Package librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:21.032 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:21.033 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:21.033 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:21.053 INFO:teuthology.orchestra.run.smithi063.stdout:Package libcephfs2-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:21.099 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-rados 2024-03-27T21:29:21.109 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:21.111 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:21.111 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:21.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install libcephfs-devel 2024-03-27T21:29:21.670 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:33 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:21.761 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:31 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:21.770 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:21.827 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:21.828 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:21.828 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:21.895 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-rgw 2024-03-27T21:29:21.915 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 31 k 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:29:21.916 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:21.917 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 31 k 2024-03-27T21:29:21.917 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 139 k 2024-03-27T21:29:21.917 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:22.156 INFO:teuthology.orchestra.run.smithi063.stdout:libcephfs-devel-18.2.2-1021.g7c37d80f.el9.x86_6 130 kB/s | 31 kB 00:00 2024-03-27T21:29:22.156 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:22.156 INFO:teuthology.orchestra.run.smithi063.stdout:Total 129 kB/s | 31 kB 00:00 2024-03-27T21:29:22.157 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:22.160 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:22.160 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:22.190 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:22.191 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:22.285 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:22.416 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:22.468 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:34 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:22.567 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:22.623 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:22.624 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:22.624 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:22.687 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-cephfs 2024-03-27T21:29:22.777 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:23.040 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:23.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:23.040 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:23.041 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:23.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:23.041 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:23.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librados2 2024-03-27T21:29:23.258 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:35 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:23.358 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:23.414 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:23.418 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:23.418 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:23.489 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-rbd 2024-03-27T21:29:23.801 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:33 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:23.900 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:23.956 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:23.957 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:23.957 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:24.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install librbd1 2024-03-27T21:29:24.058 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:36 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:24.158 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:24.214 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-27T21:29:24.215 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:24.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install rbd-fuse 2024-03-27T21:29:24.628 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:34 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:24.731 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:24.787 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:24.788 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:24.788 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:24.852 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:36 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:24.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rados 2024-03-27T21:29:25.007 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 87 k 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 87 k 2024-03-27T21:29:25.008 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 227 k 2024-03-27T21:29:25.009 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:25.338 INFO:teuthology.orchestra.run.smithi028.stdout:rbd-fuse-18.2.2-1021.g7c37d80f.el9.x86_64.rpm 262 kB/s | 87 kB 00:00 2024-03-27T21:29:25.339 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:25.339 INFO:teuthology.orchestra.run.smithi028.stdout:Total 261 kB/s | 87 kB 00:00 2024-03-27T21:29:25.339 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:25.347 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:25.347 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:25.403 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:25.404 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:25.438 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:35 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:25.537 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rados-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:25.548 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:25.593 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:25.594 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:25.594 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:25.647 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:25.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rgw 2024-03-27T21:29:26.024 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:26.250 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:36 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:26.322 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:26.323 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:26.323 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:26.323 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:26.323 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:26.323 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:26.350 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rgw-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:26.406 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:26.407 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:26.407 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:26.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-cephfs 2024-03-27T21:29:26.538 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install rbd-mirror 2024-03-27T21:29:27.061 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:37 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:27.110 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:39 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:27.159 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-cephfs-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:27.215 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:27.216 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:27.216 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:27.265 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:27.266 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 3.0 M 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 3.0 M 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 12 M 2024-03-27T21:29:27.267 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:27.298 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install python3-rbd 2024-03-27T21:29:27.632 INFO:teuthology.orchestra.run.smithi028.stdout:rbd-mirror-18.2.2-1021.g7c37d80f.el9.x86_64.rpm 8.2 MB/s | 3.0 MB 00:00 2024-03-27T21:29:27.633 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:27.633 INFO:teuthology.orchestra.run.smithi028.stdout:Total 8.2 MB/s | 3.0 MB 00:00 2024-03-27T21:29:27.633 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:27.644 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:27.644 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:27.717 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:27.718 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:27.865 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:37 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:27.964 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-rbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 is already installed. 2024-03-27T21:29:28.020 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:28.021 INFO:teuthology.orchestra.run.smithi063.stdout:Nothing to do. 2024-03-27T21:29:28.021 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:28.094 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-fuse 2024-03-27T21:29:28.155 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:28.217 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:28.241 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:28.241 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:29:28.241 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T21:29:28.241 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T21:29:28.241 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T21:29:28.241 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:28.666 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:38 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:28.821 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 87 k 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:28.822 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:28.823 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:29:28.823 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:28.823 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 87 k 2024-03-27T21:29:28.823 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 227 k 2024-03-27T21:29:28.823 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:29.267 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-fuse-18.2.2-1021.g7c37d80f.el9.x86_64.rpm 195 kB/s | 87 kB 00:00 2024-03-27T21:29:29.268 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:29.268 INFO:teuthology.orchestra.run.smithi063.stdout:Total 194 kB/s | 87 kB 00:00 2024-03-27T21:29:29.268 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:29.275 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:29.275 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:29.333 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:29.333 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:29.472 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:29.488 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:29.488 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:29.488 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:29.488 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:29.488 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:29.488 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:29.584 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:29.720 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install rbd-nbd 2024-03-27T21:29:29.967 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:30.248 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:30.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:30.249 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:30.300 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:42 ago on Wed 27 Mar 2024 09:27:48 PM UTC. 2024-03-27T21:29:30.455 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 172 k 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:30.456 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-27T21:29:30.457 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-27T21:29:30.457 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-27T21:29:30.457 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:30.457 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 172 k 2024-03-27T21:29:30.457 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 494 k 2024-03-27T21:29:30.457 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-27T21:29:30.494 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-mirror 2024-03-27T21:29:30.688 INFO:teuthology.orchestra.run.smithi028.stdout:rbd-nbd-18.2.2-1021.g7c37d80f.el9.x86_64.rpm 747 kB/s | 172 kB 00:00 2024-03-27T21:29:30.688 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:30.689 INFO:teuthology.orchestra.run.smithi028.stdout:Total 742 kB/s | 172 kB 00:00 2024-03-27T21:29:30.689 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-27T21:29:30.697 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-27T21:29:30.697 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-27T21:29:30.755 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-27T21:29:30.755 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-27T21:29:30.908 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-27T21:29:31.005 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:31.066 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:41 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:31.222 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:31.223 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-03-27T21:29:31.223 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:31.223 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 3.0 M 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 3.0 M 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 12 M 2024-03-27T21:29:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:31.448 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:31.594 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-mirror-18.2.2-1021.g7c37d80f.el9.x86_64.rpm 8.1 MB/s | 3.0 MB 00:00 2024-03-27T21:29:31.595 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:31.595 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.0 MB/s | 3.0 MB 00:00 2024-03-27T21:29:31.595 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:31.606 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:31.606 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:31.680 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:31.681 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:31.746 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:31.747 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:31.747 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-27T21:29:31.747 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:31.747 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:31.747 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-27T21:29:31.991 DEBUG:teuthology.parallel:result is None 2024-03-27T21:29:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:32.336 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T21:29:32.336 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T21:29:32.336 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T21:29:32.336 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T21:29:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:33.406 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:33.406 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:33.407 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:33.407 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:33.407 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:33.407 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:33.683 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install rbd-nbd 2024-03-27T21:29:34.260 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:01:44 ago on Wed 27 Mar 2024 09:27:50 PM UTC. 2024-03-27T21:29:34.415 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-03-27T21:29:34.415 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:18.2.2-1021.g7c37d80f.el9 ceph 172 k 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout:Install 1 Package 2024-03-27T21:29:34.416 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:34.417 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 172 k 2024-03-27T21:29:34.417 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 494 k 2024-03-27T21:29:34.417 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-03-27T21:29:34.647 INFO:teuthology.orchestra.run.smithi063.stdout:rbd-nbd-18.2.2-1021.g7c37d80f.el9.x86_64.rpm 746 kB/s | 172 kB 00:00 2024-03-27T21:29:34.648 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-03-27T21:29:34.648 INFO:teuthology.orchestra.run.smithi063.stdout:Total 742 kB/s | 172 kB 00:00 2024-03-27T21:29:34.649 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-03-27T21:29:34.657 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-03-27T21:29:34.657 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-03-27T21:29:34.715 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-03-27T21:29:34.716 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-03-27T21:29:34.865 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-03-27T21:29:34.973 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:35.516 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:35.797 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 1/1 2024-03-27T21:29:35.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:35.798 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-03-27T21:29:35.798 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:18.2.2-1021.g7c37d80f.el9.x86_64 2024-03-27T21:29:35.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:35.798 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-03-27T21:29:36.084 DEBUG:teuthology.parallel:result is None 2024-03-27T21:29:36.163 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:29:36.392 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T21:29:36.417 INFO:teuthology.orchestra.run.smithi028.stdout:18.2.2-1021.g7c37d80f.el9 2024-03-27T21:29:36.418 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1021.g7c37d80f.el9 2024-03-27T21:29:36.418 INFO:teuthology.task.install:The correct ceph version 18.2.2-1021.g7c37d80f is installed. 2024-03-27T21:29:36.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:29:36.672 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T21:29:36.700 INFO:teuthology.orchestra.run.smithi063.stdout:18.2.2-1021.g7c37d80f.el9 2024-03-27T21:29:36.701 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1021.g7c37d80f.el9 2024-03-27T21:29:36.701 INFO:teuthology.task.install:The correct ceph version 18.2.2-1021.g7c37d80f is installed. 2024-03-27T21:29:36.703 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-27T21:29:36.703 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:36.704 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T21:29:36.756 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:36.756 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T21:29:36.788 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-27T21:29:36.789 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:36.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T21:29:36.834 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T21:29:36.909 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:36.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T21:29:36.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T21:29:37.014 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-27T21:29:37.014 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:37.014 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T21:29:37.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T21:29:37.121 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:37.121 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T21:29:37.152 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T21:29:37.221 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-27T21:29:37.221 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:37.221 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T21:29:37.253 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T21:29:37.327 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:37.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T21:29:37.354 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T21:29:37.425 INFO:teuthology.run_tasks:Running task ceph... 2024-03-27T21:29:37.521 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-27T21:29:37.525 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2024-03-27T21:29:37.531 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-03-27T21:29:37.560 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-27T21:29:37.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-27T21:29:37.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-27T21:29:37.631 INFO:tasks.ceph:Creating extra log directories... 2024-03-27T21:29:37.631 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-27T21:29:37.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-27T21:29:37.713 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-27T21:29:37.713 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 5}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-27T21:29:37.714 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525', 'branch': 'wip-yuri4-testing-2024-03-26-1132-reef', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7626525', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2024-03-26-1132-reef'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 5}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2024-03-26-1132-reef', 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 6904, 'sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2024-03-26-1132-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7c37d80f7a88f4eb561c4fe02558660a650b10ac', 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2k0LwIjq/fgl0fdo5xEusdHz5tJkemKU4cg3A1mzgcunXPrxs+Y8QaeICjOSTPRMFUGMCIJPxld02Cy03Q7YQ=', 'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNouEqEVlmR8flsVmVtdMzxVEKwNhbUVb9+Ff0BZiAJRrQdKBZ0auUrtt31tPbbyACpWX3x7lTrhAJ0TNtqJtq8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-27_14:58:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-27T21:29:37.714 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-27T21:29:37.744 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-27T21:29:37.759 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2024-03-27T21:29:37.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-03-27T21:29:37.828 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:37.828 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T21:29:37.885 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T21:29:37.885 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-27 21:29:28.491244307 +0000 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-27 21:26:42.758302144 +0000 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-27 21:26:42.758302144 +0000 2024-03-27T21:29:37.941 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-27 21:26:42.758302144 +0000 2024-03-27T21:29:37.942 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T21:29:38.008 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-27T21:29:38.008 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-27T21:29:38.008 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 8.5707e-05 s, 6.0 MB/s 2024-03-27T21:29:38.009 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T21:29:38.065 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-03-27T21:29:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T21:29:38.122 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:38.122 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-27T21:29:38.122 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-27 21:29:28.491244307 +0000 2024-03-27T21:29:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-27 21:26:43.082292985 +0000 2024-03-27T21:29:38.123 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-27 21:26:43.082292985 +0000 2024-03-27T21:29:38.123 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-27 21:26:43.082292985 +0000 2024-03-27T21:29:38.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T21:29:38.188 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-27T21:29:38.188 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-27T21:29:38.188 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.9664e-05 s, 5.1 MB/s 2024-03-27T21:29:38.189 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T21:29:38.246 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-03-27T21:29:38.300 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-27 21:29:28.492244279 +0000 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-27 21:26:43.426283259 +0000 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-27 21:26:43.426283259 +0000 2024-03-27T21:29:38.301 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-27 21:26:43.426283259 +0000 2024-03-27T21:29:38.301 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T21:29:38.366 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-27T21:29:38.367 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-27T21:29:38.367 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.6563e-05 s, 5.3 MB/s 2024-03-27T21:29:38.368 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T21:29:38.423 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-03-27T21:29:38.478 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-27 21:29:28.492244279 +0000 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-27 21:26:43.755273958 +0000 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-27 21:26:43.755273958 +0000 2024-03-27T21:29:38.479 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-27 21:26:43.755273958 +0000 2024-03-27T21:29:38.479 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T21:29:38.545 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-27T21:29:38.545 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-27T21:29:38.545 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 8.4027e-05 s, 6.1 MB/s 2024-03-27T21:29:38.546 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T21:29:38.601 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:38.602 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:38.602 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T21:29:38.619 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T21:29:38.619 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-03-27T21:29:38.675 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T21:29:38.675 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-27 21:29:32.587847239 +0000 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-27 21:26:42.774348101 +0000 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-27 21:26:42.774348101 +0000 2024-03-27T21:29:38.676 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-27 21:26:42.774348101 +0000 2024-03-27T21:29:38.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T21:29:38.743 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-27T21:29:38.744 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-27T21:29:38.744 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000193091 s, 2.7 MB/s 2024-03-27T21:29:38.745 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T21:29:38.803 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-27 21:29:32.588847229 +0000 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-27 21:26:43.121344689 +0000 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-27 21:26:43.121344689 +0000 2024-03-27T21:29:38.859 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-27 21:26:43.121344689 +0000 2024-03-27T21:29:38.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T21:29:38.925 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-27T21:29:38.926 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-27T21:29:38.926 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000206818 s, 2.5 MB/s 2024-03-27T21:29:38.927 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T21:29:38.983 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-27 21:29:32.588847229 +0000 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-27 21:26:43.485341109 +0000 2024-03-27T21:29:39.039 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-27 21:26:43.485341109 +0000 2024-03-27T21:29:39.040 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-27 21:26:43.485341109 +0000 2024-03-27T21:29:39.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T21:29:39.105 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-27T21:29:39.105 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-27T21:29:39.105 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000211325 s, 2.4 MB/s 2024-03-27T21:29:39.106 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T21:29:39.163 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-03-27 21:29:32.589847219 +0000 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-03-27 21:26:43.838337638 +0000 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-03-27 21:26:43.838337638 +0000 2024-03-27T21:29:39.218 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-03-27 21:26:43.838337638 +0000 2024-03-27T21:29:39.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T21:29:39.284 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-03-27T21:29:39.284 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-03-27T21:29:39.284 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000226468 s, 2.3 MB/s 2024-03-27T21:29:39.285 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T21:29:39.342 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:39.342 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-03-27T21:29:39.342 INFO:tasks.ceph:Generating config... 2024-03-27T21:29:39.343 INFO:tasks.ceph:[client] debug monc = 20 2024-03-27T21:29:39.343 INFO:tasks.ceph:[client] debug ms = 1 2024-03-27T21:29:39.343 INFO:tasks.ceph:[global] debug ms = 1 2024-03-27T21:29:39.344 INFO:tasks.ceph:[global] debug objecter = 20 2024-03-27T21:29:39.344 INFO:tasks.ceph:[global] debug rados = 20 2024-03-27T21:29:39.344 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-03-27T21:29:39.344 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-03-27T21:29:39.344 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-03-27T21:29:39.344 INFO:tasks.ceph:[global] ms type = async 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-03-27T21:29:39.344 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-03-27T21:29:39.345 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-03-27T21:29:39.345 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-03-27T21:29:39.345 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-03-27T21:29:39.345 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-27T21:29:39.345 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd class default list = * 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd class load list = * 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-03-27T21:29:39.346 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-03-27T21:29:39.346 INFO:tasks.ceph:Setting up mon.a... 2024-03-27T21:29:39.347 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-27T21:29:39.403 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2024-03-27T21:29:39.405 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-27T21:29:39.451 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-27T21:29:39.479 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.b', '[v2:172.21.15.28:3301,v1:172.21.15.28:6790]'), ('mon.c', '[v2:172.21.15.28:3302,v1:172.21.15.28:6791]'), ('mon.d', '[v2:172.21.15.28:3303,v1:172.21.15.28:6792]'), ('mon.e', '[v2:172.21.15.28:3304,v1:172.21.15.28:6793]'), ('mon.f', '172.21.15.63'), ('mon.g', '[v2:172.21.15.63:3301,v1:172.21.15.63:6790]'), ('mon.h', '[v2:172.21.15.63:3302,v1:172.21.15.63:6791]'), ('mon.i', '[v2:172.21.15.63:3303,v1:172.21.15.63:6792]')] 2024-03-27T21:29:39.479 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,[v2:172.21.15.28:3301,v1:172.21.15.28:6790],[v2:172.21.15.28:3302,v1:172.21.15.28:6791],[v2:172.21.15.28:3303,v1:172.21.15.28:6792],[v2:172.21.15.28:3304,v1:172.21.15.28:6793],172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791],[v2:172.21.15.63:3303,v1:172.21.15.63:6792]', 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-03-27T21:29:39.480 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:39.480 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-27T21:29:39.534 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --addv b '[v2:172.21.15.28:3301,v1:172.21.15.28:6790]' --addv c '[v2:172.21.15.28:3302,v1:172.21.15.28:6791]' --addv d '[v2:172.21.15.28:3303,v1:172.21.15.28:6792]' --addv e '[v2:172.21.15.28:3304,v1:172.21.15.28:6793]' --add f 172.21.15.63 --addv g '[v2:172.21.15.63:3301,v1:172.21.15.63:6790]' --addv h '[v2:172.21.15.63:3302,v1:172.21.15.63:6791]' --addv i '[v2:172.21.15.63:3303,v1:172.21.15.63:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = pacific 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 16 (pacific) 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 3 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:29:39.638 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:3: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:4: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:5: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:6: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:7: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:8: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:29:39.639 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-03-27T21:29:39.640 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-27T21:29:39.655 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4104f5c5-b145-4d95-98f1-cb5df7cc2f83... 2024-03-27T21:29:39.656 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-27T21:29:39.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.744 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2024-03-27T21:29:39.745 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.746 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,[v2:172.21.15.28:3301,v1:172.21.15.28:6790],[v2:172.21.15.28:3302,v1:172.21.15.28:6791],[v2:172.21.15.28:3303,v1:172.21.15.28:6792],[v2:172.21.15.28:3304,v1:172.21.15.28:6793],172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791],[v2:172.21.15.63:3303,v1:172.21.15.63:6792]" 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: debug objecter = 20 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: debug rados = 20 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: mon client directed command retry = 5 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: mon election default strategy = 3 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: ms inject socket failures = 5000 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: ms type = async 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2024-03-27T21:29:39.747 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.748 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: bluefs allocator = hybrid 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = hybrid 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2024-03-27T21:29:39.749 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore zero block detection = True 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 20 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 20 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 10 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd class default list = * 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd class load list = * 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify cached snaps = True 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify missing on start = True 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock override recovery settings = True 2024-03-27T21:29:39.750 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: osd op queue = debug_random 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: osd op queue cut off = debug_random 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-03-27T21:29:39.751 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-27T21:29:39.752 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon min osdmap epochs = 25 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon osdmap full prune interval = 2 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon osdmap full prune min = 15 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon osdmap full prune txsize = 2 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon scrub inject crc mismatch = 0.01 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon scrub inject missing keys = 0.05 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon scrub interval = 300 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on pool no app = False 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: paxos service trim min = 5 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2024-03-27T21:29:39.753 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout: debug monc = 20 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.d] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.e] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.f] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.g] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.h] 2024-03-27T21:29:39.754 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.i] 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.755 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-03-27T21:29:39.756 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-03-27T21:29:39.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.28,[v2:172.21.15.28:3301,v1:172.21.15.28:6790],[v2:172.21.15.28:3302,v1:172.21.15.28:6791],[v2:172.21.15.28:3303,v1:172.21.15.28:6792],[v2:172.21.15.28:3304,v1:172.21.15.28:6793],172.21.15.63,[v2:172.21.15.63:3301,v1:172.21.15.63:6790],[v2:172.21.15.63:3302,v1:172.21.15.63:6791],[v2:172.21.15.63:3303,v1:172.21.15.63:6792]" 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: debug objecter = 20 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: debug rados = 20 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: mon client directed command retry = 5 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: mon election default strategy = 3 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject socket failures = 5000 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: ms type = async 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-03-27T21:29:39.758 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-03-27T21:29:39.759 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: bluefs allocator = hybrid 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore allocator = hybrid 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-03-27T21:29:39.760 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore zero block detection = True 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: osd class default list = * 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: osd class load list = * 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify cached snaps = True 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify missing on start = True 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-03-27T21:29:39.761 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock override recovery settings = True 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: osd op queue = debug_random 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: osd op queue cut off = debug_random 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.762 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.763 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon min osdmap epochs = 25 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon osdmap full prune interval = 2 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon osdmap full prune min = 15 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon osdmap full prune txsize = 2 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon scrub inject crc mismatch = 0.01 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon scrub inject missing keys = 0.05 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon scrub interval = 300 2024-03-27T21:29:39.764 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on pool no app = False 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: paxos service trim min = 5 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: debug monc = 20 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.d] 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.e] 2024-03-27T21:29:39.765 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.f] 2024-03-27T21:29:39.766 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.g] 2024-03-27T21:29:39.766 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.h] 2024-03-27T21:29:39.766 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.i] 2024-03-27T21:29:39.767 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-27T21:29:39.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-27T21:29:39.826 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-27T21:29:39.826 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:39.826 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-27T21:29:39.841 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:39.841 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-27T21:29:39.895 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:29:39.895 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:39.895 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-27T21:29:39.895 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-27T21:29:39.974 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:29:39.974 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:40.028 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:29:40.028 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:40.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-27T21:29:40.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-27T21:29:40.069 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:29:40.069 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:40.123 INFO:tasks.ceph:Setting up mon nodes... 2024-03-27T21:29:40.123 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-27T21:29:40.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-27T21:29:40.225 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-27T21:29:40.227 INFO:tasks.ceph:Setting up mds nodes... 2024-03-27T21:29:40.227 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-27T21:29:40.228 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-27T21:29:40.268 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-27T21:29:40.284 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-27T21:29:40.284 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-03-27T21:29:40.284 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-27T21:29:40.311 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:40.311 INFO:tasks.ceph:role: osd.0 2024-03-27T21:29:40.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:29:40.312 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-27T21:29:40.378 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T21:29:40.378 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T21:29:40.378 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T21:29:40.378 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T21:29:40.378 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T21:29:40.379 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-03-27T21:29:40.379 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T21:29:40.379 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T21:29:40.381 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T21:29:40.381 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T21:29:40.413 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-03-27T21:29:40.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-03-27T21:29:40.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-27T21:29:40.487 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-27T21:29:40.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-27T21:29:40.625 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:40.625 INFO:tasks.ceph:role: osd.1 2024-03-27T21:29:40.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:29:40.625 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-27T21:29:40.693 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T21:29:40.693 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T21:29:40.693 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T21:29:40.693 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T21:29:40.694 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T21:29:40.694 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-03-27T21:29:40.694 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T21:29:40.694 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T21:29:40.694 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T21:29:40.694 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T21:29:40.729 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-03-27T21:29:40.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-03-27T21:29:40.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-27T21:29:40.813 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-27T21:29:40.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-27T21:29:40.953 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:40.953 INFO:tasks.ceph:role: osd.2 2024-03-27T21:29:40.953 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:29:40.954 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T21:29:41.020 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T21:29:41.021 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T21:29:41.021 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T21:29:41.056 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-03-27T21:29:41.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-03-27T21:29:41.059 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-27T21:29:41.130 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-27T21:29:41.201 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:41.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:41.372+0000 7ff8b8611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-27T21:29:41.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:41.372+0000 7ff8b8611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-27T21:29:41.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:41.372+0000 7ff8b8611640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-27T21:29:41.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:41.372+0000 7ff8b8611640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-27T21:29:41.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:41.372+0000 7ff8b8611640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-27T21:29:41.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:41.373+0000 7ff8b8611640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-27T21:29:44.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-27T21:29:44.244 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:44.346+0000 7f8ba700d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-27T21:29:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:44.347+0000 7f8ba700d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-27T21:29:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:44.347+0000 7f8ba700d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-27T21:29:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:44.347+0000 7f8ba700d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-27T21:29:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:44.347+0000 7f8ba700d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-27T21:29:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:44.347+0000 7f8ba700d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-27T21:29:47.184 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-27T21:29:47.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:47.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:47.320+0000 7f17ac123640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-27T21:29:47.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:47.320+0000 7f17ac123640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-27T21:29:47.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:47.320+0000 7f17ac123640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-27T21:29:47.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:47.320+0000 7f17ac123640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-27T21:29:47.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:47.320+0000 7f17ac123640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-27T21:29:47.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:29:47.321+0000 7f17ac123640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-27T21:29:50.155 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-27T21:29:50.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-27T21:29:50.216 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:50.216 INFO:tasks.ceph:role: osd.3 2024-03-27T21:29:50.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:29:50.217 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T21:29:50.294 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T21:29:50.295 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T21:29:50.295 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T21:29:50.803 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-27T21:29:50.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-27T21:29:50.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-03-27T21:29:50.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-27T21:29:50.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-27T21:29:51.038 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:51.038 INFO:tasks.ceph:role: osd.4 2024-03-27T21:29:51.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:29:51.038 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-27T21:29:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T21:29:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T21:29:51.114 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T21:29:51.115 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T21:29:51.563 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-27T21:29:51.566 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-27T21:29:51.566 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-03-27T21:29:51.649 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-27T21:29:51.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-27T21:29:51.790 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-03-27T21:29:51.790 INFO:tasks.ceph:role: osd.5 2024-03-27T21:29:51.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:29:51.790 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-27T21:29:51.864 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T21:29:51.864 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T21:29:51.864 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T21:29:51.864 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T21:29:51.864 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T21:29:51.864 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-03-27T21:29:51.865 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T21:29:51.865 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T21:29:51.865 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T21:29:51.865 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T21:29:52.363 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-03-27T21:29:52.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-03-27T21:29:52.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-03-27T21:29:52.494 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-27T21:29:52.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:52.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:52.635+0000 7ff8176bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-27T21:29:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:52.641+0000 7ff8176bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-27T21:29:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:52.641+0000 7ff8176bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-27T21:29:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:52.641+0000 7ff8176bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-27T21:29:52.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:52.641+0000 7ff8176bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-27T21:29:52.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:52.646+0000 7ff8176bd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-27T21:29:55.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-27T21:29:55.509 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:55.611+0000 7fe283d21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-27T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:55.611+0000 7fe283d21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-27T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:55.611+0000 7fe283d21640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-27T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:55.611+0000 7fe283d21640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-27T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:55.611+0000 7fe283d21640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-27T21:29:55.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:55.612+0000 7fe283d21640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-27T21:29:58.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-27T21:29:58.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:29:58.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:58.585+0000 7f630080e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-27T21:29:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:58.585+0000 7f630080e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-27T21:29:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:58.585+0000 7f630080e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-27T21:29:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:58.585+0000 7f630080e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-27T21:29:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:58.585+0000 7f630080e640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-27T21:29:58.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:29:58.586+0000 7f630080e640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-27T21:30:01.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-27T21:30:01.469 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-27T21:30:01.470 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:30:01.470 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-27T21:30:01.503 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:30:01.503 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-27T21:30:01.574 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:30:01.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-27T21:30:01.644 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:01.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-27T21:30:01.675 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:01.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-27T21:30:01.745 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:01.745 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-27T21:30:01.817 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:01.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-27T21:30:01.885 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:01.885 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-27T21:30:01.942 INFO:tasks.ceph:Adding keys to all mons... 2024-03-27T21:30:01.942 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-27T21:30:01.945 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDFjwRm5MZPFhAAtGqnyOIUffX5FkzHQPe6mQ== 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDIjwRm/hnHFBAAXv5MrVcFt7W3HZr3iY5o7Q== 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDLjwRmiAImExAAr1qT+SQYqNeCLmfUF6CC1A== 2024-03-27T21:30:01.986 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDEjwRmDrghDhAA/vhYV++WzufRSP9ve97tdA== 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDQjwRmCyDuJRAAIsJSky3IS+cjEAe+EvwWlg== 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDTjwRmzxaAJBAArUm39ie5uSjKsozN0e/T2A== 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDWjwRmkpHxIhAAig9RBqnWz558hgimW59vng== 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-03-27T21:30:01.987 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDEjwRmH+G8EBAAplb0E1lHU49iWuR2DIT94w== 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDFjwRm5MZPFhAAtGqnyOIUffX5FkzHQPe6mQ== 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDIjwRm/hnHFBAAXv5MrVcFt7W3HZr3iY5o7Q== 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDLjwRmiAImExAAr1qT+SQYqNeCLmfUF6CC1A== 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDEjwRmDrghDhAA/vhYV++WzufRSP9ve97tdA== 2024-03-27T21:30:02.009 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDQjwRmCyDuJRAAIsJSky3IS+cjEAe+EvwWlg== 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDTjwRmzxaAJBAArUm39ie5uSjKsozN0e/T2A== 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDWjwRmkpHxIhAAig9RBqnWz558hgimW59vng== 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-03-27T21:30:02.010 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQDEjwRmH+G8EBAAplb0E1lHU49iWuR2DIT94w== 2024-03-27T21:30:02.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.031 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.108 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.164 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.167 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.218 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-27T21:30:02.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-27T21:30:02.272 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.326 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.383 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.385 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T21:30:02.437 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T21:30:02.439 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T21:30:02.493 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-27T21:30:02.493 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-27T21:30:02.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:02.615 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-27T21:30:02.641 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-27T21:30:02.708 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:02.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-27T21:30:02.832 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-27T21:30:02.899 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:02.995 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-27T21:30:03.021 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-03-27T21:30:03.088 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:03.185 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-03-27T21:30:03.211 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-03-27T21:30:03.278 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:03.374 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-03-27T21:30:03.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-03-27T21:30:03.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:03.536 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-03-27T21:30:03.565 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-03-27T21:30:03.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:03.730 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-03-27T21:30:03.758 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-03-27T21:30:03.826 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:03.923 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-03-27T21:30:03.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-03-27T21:30:04.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T21:30:04.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-03-27T21:30:04.139 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:30:04.141 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-27T21:30:04.195 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-27T21:30:04.195 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-27T21:30:04.196 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-27T21:30:04.199 INFO:tasks.ceph.mon.a:Started 2024-03-27T21:30:04.199 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-27T21:30:04.199 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-27T21:30:04.201 INFO:tasks.ceph.mon.b:Started 2024-03-27T21:30:04.201 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-27T21:30:04.201 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-27T21:30:04.204 INFO:tasks.ceph.mon.c:Started 2024-03-27T21:30:04.204 INFO:tasks.ceph.mon.d:Restarting daemon 2024-03-27T21:30:04.204 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-03-27T21:30:04.206 INFO:tasks.ceph.mon.d:Started 2024-03-27T21:30:04.206 INFO:tasks.ceph.mon.e:Restarting daemon 2024-03-27T21:30:04.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-03-27T21:30:04.209 INFO:tasks.ceph.mon.e:Started 2024-03-27T21:30:04.209 INFO:tasks.ceph.mon.f:Restarting daemon 2024-03-27T21:30:04.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-03-27T21:30:04.237 INFO:tasks.ceph.mon.f:Started 2024-03-27T21:30:04.237 INFO:tasks.ceph.mon.g:Restarting daemon 2024-03-27T21:30:04.237 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-03-27T21:30:04.239 INFO:tasks.ceph.mon.g:Started 2024-03-27T21:30:04.239 INFO:tasks.ceph.mon.h:Restarting daemon 2024-03-27T21:30:04.239 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-03-27T21:30:04.241 INFO:tasks.ceph.mon.h:Started 2024-03-27T21:30:04.241 INFO:tasks.ceph.mon.i:Restarting daemon 2024-03-27T21:30:04.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-03-27T21:30:04.243 INFO:tasks.ceph.mon.i:Started 2024-03-27T21:30:04.244 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-27T21:30:04.244 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-27T21:30:04.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-27T21:30:04.247 INFO:tasks.ceph.mgr.x:Started 2024-03-27T21:30:04.247 INFO:tasks.ceph:Setting crush tunables to default 2024-03-27T21:30:04.247 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.391+0000 7fd295d73640 10 monclient: get_monmap_and_config 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.391+0000 7fd295d73640 10 monclient: build_initial_monmap 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.391+0000 7fd295d73640 10 monclient: monmap: 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:04.391853+0000 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:04.391853+0000 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:04.380 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:04.381 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:04.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.391+0000 7fd295d73640 1 Processor -- start 2024-03-27T21:30:04.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.391+0000 7fd295d73640 1 -- start start 2024-03-27T21:30:04.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.391+0000 7fd295d73640 10 monclient: init 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient: _add_conns ranks=[8,9,7,0,10,6,5,3,1,2,4] 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): picked mon.noname-e con 0x7fd290133870 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): picked mon.noname-a con 0x7fd2901331c0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): picked mon.noname-i con 0x7fd290130200 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd290134190 con 0x7fd2901331c0 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900a1b00 con 0x7fd290130200 2024-03-27T21:30:04.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fd29009e090 con 0x7fd290133870 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd295d73640 10 monclient(hunting): authenticate will time out at 826.699270s 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48186/0 (socket says 172.21.15.28:48186) 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 learned_addr learned my addr 172.21.15.28:0/1910577097 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 10 monclient(hunting): get_auth_request con 0x7fd2901331c0 auth_method 0 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd290133870 auth_method 0 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd290130200 auth_method 0 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:04.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:04.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:04.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.392+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 10 monclient(hunting): get_auth_request con 0x7fd2901331c0 auth_method 0 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd290133870 auth_method 0 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:04.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd290130200 auth_method 0 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:04.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.593+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd290133870 auth_method 0 2024-03-27T21:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 10 monclient(hunting): get_auth_request con 0x7fd2901331c0 auth_method 0 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:04.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd290130200 auth_method 0 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:04.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:04.994+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd290133870 auth_method 0 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 10 monclient(hunting): get_auth_request con 0x7fd2901331c0 auth_method 0 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:05.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd290130200 auth_method 0 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:05.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:05.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:30:05.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-27T21:30:05.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:30:05.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:05.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:05.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:05.795+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:30:07.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): tick 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): _check_auth_tickets 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 monclient(hunting): continuing hunt 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): _reopen_session rank -1 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 msgr2=0x7fd290133c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd290133870 0x7fd290133c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd290130200 0x7fd2901306b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 -- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 msgr2=0x7fd29012fcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 --2- 172.21.15.28:0/1910577097 >> v2:172.21.15.28:3300/0 conn(0x7fd2901331c0 0x7fd29012fcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient: _add_conns ranks=[6,1,4,3,5,10,0,2] 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): picked mon.noname-d con 0x7fd2780037f0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd278006180 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:07.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): picked mon.noname-c con 0x7fd278009e50 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 -- 172.21.15.28:0/1910577097 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2900618f0 con 0x7fd278006180 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 -- 172.21.15.28:0/1910577097 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd290134190 con 0x7fd278009e50 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 1 -- 172.21.15.28:0/1910577097 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900a1b00 con 0x7fd2780037f0 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28d7fa640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd2780037f0 auth_method 0 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:07.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd278009e50 auth_method 0 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.392+0000 7fd28ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:07.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.393+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:07.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:07.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:07.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd2780037f0 auth_method 0 2024-03-27T21:30:07.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:07.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:07.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd278009e50 auth_method 0 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:07.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.594+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd2780037f0 auth_method 0 2024-03-27T21:30:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:07.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd278009e50 auth_method 0 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:07.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:07.995+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:08.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd2780037f0 auth_method 0 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd278009e50 auth_method 0 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:08.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:08.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:08.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:08.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:08.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:08.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:30:08.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:08.796+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:30:09.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.611+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380588404 0 0) 0x7fd2900618f0 con 0x7fd278006180 2024-03-27T21:30:09.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.611+0000 7fd28e7fc640 10 monclient(hunting): _negotiate 2024-03-27T21:30:09.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.611+0000 7fd28e7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.611+0000 7fd28e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:09.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.611+0000 7fd28e7fc640 10 monclient(hunting): my global_id is 4105 2024-03-27T21:30:09.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.611+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c003520 con 0x7fd278006180 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 <== mon.1 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 779776912 0 0) 0x7fd27c003520 con 0x7fd278006180 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 msgr2=0x7fd278005c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd2780037f0 0x7fd278005c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 msgr2=0x7fd27800c2f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd278009e50 0x7fd27800c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 monclient: found mon.noname-f-legacy 2024-03-27T21:30:09.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 1 -- 172.21.15.28:0/1910577097 reap_dead start 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:172.21.15.63:6789/0 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27800dc00 con 0x7fd278006180 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 <== mon.1 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (unknown 3833802671 0 0) 0x7fd28400b9d0 con 0x7fd278006180 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd295d73640 5 monclient: authenticate success, global_id 4105 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd295d73640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: dump: 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:09.616 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:09.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 monclient: mon.f has (v2) addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] but i'm connected to v1:172.21.15.63:6789/0, reconnecting 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 >> v1:172.21.15.63:6789/0 conn(0x7fd278006180 legacy=0x7fd278008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient: _add_conns ranks=[8,4,5,3,1,6,0,7,2] 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd27c0041c0 0x7fd27c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): picked mon.e con 0x7fd27c0041c0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c004dd0 0x7fd27c005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): picked mon.c con 0x7fd27c004dd0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fd27c009bb0 0x7fd27c00c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): picked mon.h con 0x7fd27c009bb0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:09.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd290134190 con 0x7fd27c004dd0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2900a1b00 con 0x7fd27c009bb0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c00c950 con 0x7fd27c0041c0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28e7fc640 10 monclient(hunting): _finish_auth 0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd295d73640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd27c0041c0 0x7fd27c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c004dd0 0x7fd27c005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd27c0041c0 auth_method 0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): get_auth_request con 0x7fd27c004dd0 auth_method 0 2024-03-27T21:30:09.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fd27c009bb0 0x7fd27c00c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd27c009bb0 auth_method 0 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:30:09.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28ffff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_done global_id 4105 payload 293 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fd27c009bb0 msgr2=0x7fd27c00c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fd27c009bb0 0x7fd27c00c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c004dd0 msgr2=0x7fd27c005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c004dd0 0x7fd27c005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 monclient: found mon.e 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 1 -- 172.21.15.28:0/1910577097 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c003520 con 0x7fd27c0041c0 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:09.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.617+0000 7fd28effd640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c004dd0 0x7fd27c005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd27c0041c0 0x7fd27c0047c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd280019ce0 tx=0x7fd27c0057f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=bc8f049230b11874 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd28002f970 con 0x7fd27c0041c0 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 10 monclient: dump: 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:09.622 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28002fb10 con 0x7fd27c0041c0 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd295d73640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd295d73640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd295d73640 4 set_mon_vals no callback set 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 1 -- 172.21.15.28:0/1910577097 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd28002fc80 con 0x7fd27c0041c0 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.618+0000 7fd28e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:09.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd28e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd28e7fc640 10 monclient: dump: 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:09.624 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 10 monclient: shutdown 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 -- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd27c0041c0 msgr2=0x7fd27c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd27c0041c0 0x7fd27c0047c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd280019ce0 tx=0x7fd27c0057f0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 -- 172.21.15.28:0/1910577097 shutdown_connections 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fd27c009bb0 0x7fd27c00c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c004dd0 0x7fd27c005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 --2- 172.21.15.28:0/1910577097 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd27c0041c0 0x7fd27c0047c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 -- 172.21.15.28:0/1910577097 >> 172.21.15.28:0/1910577097 conn(0x7fd2900a2040 msgr2=0x7fd2900a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 -- 172.21.15.28:0/1910577097 shutdown_connections 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.619+0000 7fd295d73640 1 -- 172.21.15.28:0/1910577097 wait complete. 2024-03-27T21:30:09.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.620+0000 7fd295d73640 10 monclient: build_initial_monmap 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.620+0000 7fd295d73640 10 monclient: monmap: 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:09.626 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.620+0000 7fd295d73640 1 librados: starting msgr at 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.620+0000 7fd295d73640 1 librados: starting objecter 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 Processor -- start 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 -- start start 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 librados: setting wanted keys 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 librados: calling monclient init 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient: init 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient: _add_conns ranks=[6,4,0,2,7,8,3,5,1] 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd278006180 0x7fd2901c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): picked mon.noname-d con 0x7fd278006180 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 0x7fd2901c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:09.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): picked mon.noname-c con 0x7fd27c0041c0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd27c004dd0 0x7fd2901c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): picked mon.noname-a con 0x7fd27c004dd0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29012cf20 con 0x7fd27c004dd0 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd29012d5d0 con 0x7fd27c0041c0 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd29012a600 con 0x7fd278006180 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd295d73640 10 monclient(hunting): authenticate will time out at 831.928524s 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 0x7fd2901c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28f7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd278006180 0x7fd2901c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd27c004dd0 0x7fd2901c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 0x7fd2901c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:50274/0 (socket says 172.21.15.28:50274) 2024-03-27T21:30:09.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request con 0x7fd278006180 auth_method 0 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 1 -- 172.21.15.28:0/2960653556 learned_addr learned my addr 172.21.15.28:0/2960653556 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28ffff640 10 monclient(hunting): get_auth_request con 0x7fd27c004dd0 auth_method 0 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 10 monclient(hunting): get_auth_request con 0x7fd27c0041c0 auth_method 0 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.621+0000 7fd28effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:09.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 10 monclient(hunting): handle_auth_done global_id 4110 payload 824 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 -- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 msgr2=0x7fd2901c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 0x7fd2901c7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 -- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd27c004dd0 msgr2=0x7fd2901c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd27c004dd0 0x7fd2901c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 monclient: found mon.noname-d 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:09.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 -- 172.21.15.28:0/2960653556 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29009de80 con 0x7fd278006180 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28ffff640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd27c004dd0 0x7fd2901c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28effd640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 0x7fd2901c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd28f7fe640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd278006180 0x7fd2901c70c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd280036000 tx=0x7fd2800046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd277fff640 10 client.?.objecter ms_handle_connect 0x7fd278006180 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.622+0000 7fd277fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd280048070 con 0x7fd278006180 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: dump: 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.631 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:09.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 5 monclient: authenticate success, global_id 4110 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280018450 con 0x7fd278006180 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 10 monclient: _renew_subs 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29006faa0 con 0x7fd278006180 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd280018a70 con 0x7fd278006180 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd28dffb640 4 set_mon_vals no callback set 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 monclient: dump: 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:09.633 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 10 client.4110.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 10 monclient: _renew_subs 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:09.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29006e350 con 0x7fd278006180 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd295d73640 1 librados: init done 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd280018bd0 con 0x7fd278006180 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd280044780 con 0x7fd278006180 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 10 client.4110.objecter ms_dispatch 0x7fd290000b90 osd_map(1..1 src has 1..1) v4 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 3 client.4110.objecter handle_osd_map got epochs [1,1] > 0 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 3 client.4110.objecter handle_osd_map decoding full epoch 1 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.624+0000 7fd277fff640 20 client.4110.objecter dump_active .. 0 homeless 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.625+0000 7fd295d73640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.625+0000 7fd295d73640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.625+0000 7fd295d73640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:09.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.625+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29009e940 con 0x7fd278006180 2024-03-27T21:30:09.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.627+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fd29009e940 con 0x7fd278006180 2024-03-27T21:30:09.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.627+0000 7fd277fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:09.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.627+0000 7fd277fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:09.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.694+0000 7fd295d73640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-03-27T21:30:09.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.694+0000 7fd295d73640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-03-27T21:30:09.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.694+0000 7fd295d73640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:09.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.694+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd29006f670 con 0x7fd278006180 2024-03-27T21:30:09.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.699+0000 7fd277fff640 1 -- 172.21.15.28:0/2960653556 <== mon.6 v2:172.21.15.28:3303/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd28003e040 con 0x7fd278006180 2024-03-27T21:30:09.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.699+0000 7fd277fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-03-27T21:30:09.688 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.699+0000 7fd277fff640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-03-27T21:30:09.688 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 10 librados: watch_flush enter 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 10 librados: watch_flush exit 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 20 client.4110.objecter shutdown clearing up homeless session... 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 10 client.4110.objecter successfully canceled tick 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 10 monclient: shutdown 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd278006180 msgr2=0x7fd2901c70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd278006180 0x7fd2901c70c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd280036000 tx=0x7fd2800046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 shutdown_connections 2024-03-27T21:30:09.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd27c004dd0 0x7fd2901c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd27c0041c0 0x7fd2901c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 --2- 172.21.15.28:0/2960653556 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fd278006180 0x7fd2901c70c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:09.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 >> 172.21.15.28:0/2960653556 conn(0x7fd2900a2040 msgr2=0x7fd2901306b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:09.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 shutdown_connections 2024-03-27T21:30:09.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 -- 172.21.15.28:0/2960653556 wait complete. 2024-03-27T21:30:09.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:09.700+0000 7fd295d73640 1 librados: shutdown 2024-03-27T21:30:09.700 INFO:tasks.ceph:check_enable_crimson: False 2024-03-27T21:30:09.700 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-27T21:30:09.700 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:30:09.700 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-27T21:30:09.727 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:30:09.727 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-27T21:30:09.794 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-27T21:30:09.794 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-27T21:30:09.861 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:09.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-27T21:30:09.894 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:09.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-27T21:30:09.965 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-03-27T21:30:09.965 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-27T21:30:10.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 37060d25-81fc-4070-99eb-bbe68095b643 0 2024-03-27T21:30:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.191+0000 7f80f342f640 10 monclient: get_monmap_and_config 2024-03-27T21:30:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.191+0000 7f80f342f640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.191+0000 7f80f342f640 10 monclient: monmap: 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:30:10.191910+0000 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:30:10.191910+0000 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:10.192 INFO:teuthology.orchestra.run.smithi063.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:10.193 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.191+0000 7f80f342f640 1 Processor -- start 2024-03-27T21:30:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.191+0000 7f80f342f640 1 -- start start 2024-03-27T21:30:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.191+0000 7f80f342f640 10 monclient: init 2024-03-27T21:30:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient: _add_conns ranks=[1,3,0,5,6,10,7,8,2,4,9] 2024-03-27T21:30:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f80ec098c20 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f80ec0a1660 0x7f80ec13c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient(hunting): picked mon.noname-g con 0x7f80ec0a1660 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f80ec0a1a60 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec0618f0 con 0x7f80ec0a1a60 2024-03-27T21:30:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80ec099000 con 0x7f80ec098c20 2024-03-27T21:30:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec09b190 con 0x7f80ec0a1660 2024-03-27T21:30:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f342f640 10 monclient(hunting): authenticate will time out at 769.520088s 2024-03-27T21:30:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f80ec0a1660 0x7f80ec13c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f11cb640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f80ec098c20 0x7f80ec0a0f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59806/0 (socket says 172.21.15.63:59806) 2024-03-27T21:30:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): get_auth_request con 0x7f80ec0a1660 auth_method 0 2024-03-27T21:30:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f11cb640 1 -- 172.21.15.63:0/1436471940 learned_addr learned my addr 172.21.15.63:0/1436471940 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-27T21:30:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80ebfff640 1 -- 172.21.15.63:0/1436471940 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780555586 0 0) 0x7f80ec099000 con 0x7f80ec098c20 2024-03-27T21:30:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80ebfff640 10 monclient(hunting): _negotiate 2024-03-27T21:30:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80ebfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80ebfff640 10 monclient(hunting): my global_id is 4114 2024-03-27T21:30:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80ebfff640 1 -- 172.21.15.63:0/1436471940 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d4003520 con 0x7f80ec098c20 2024-03-27T21:30:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient(hunting): handle_auth_done global_id 4107 payload 274 2024-03-27T21:30:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 1 -- 172.21.15.63:0/1436471940 >> v1:172.21.15.63:6789/0 conn(0x7f80ec098c20 legacy=0x7f80ec0a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 1 -- 172.21.15.63:0/1436471940 >> v1:172.21.15.28:6789/0 conn(0x7f80ec0a1a60 legacy=0x7f80ec13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 1 monclient: found mon.noname-g 2024-03-27T21:30:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.192+0000 7f80f09ca640 1 -- 172.21.15.63:0/1436471940 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ec099ec0 con 0x7f80ec0a1660 2024-03-27T21:30:10.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80f09ca640 1 --2- 172.21.15.63:0/1436471940 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f80ec0a1660 0x7f80ec13c700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097d0 tx=0x7f80e002b810 comp rx=0 tx=0).ready entity=mon.3 client_cookie=e36b2df195821b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 1 -- 172.21.15.63:0/1436471940 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f80e00319e0 con 0x7f80ec0a1660 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: dump: 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.200 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 1 -- 172.21.15.63:0/1436471940 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0031b60 con 0x7f80ec0a1660 2024-03-27T21:30:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80f342f640 5 monclient: authenticate success, global_id 4107 2024-03-27T21:30:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80f342f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:10.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80f342f640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 1 -- 172.21.15.63:0/1436471940 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f80e0031cd0 con 0x7f80ec0a1660 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80f342f640 4 set_mon_vals no callback set 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.193+0000 7f80ebfff640 10 monclient: dump: 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.204 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.205 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 10 monclient: shutdown 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 -- 172.21.15.63:0/1436471940 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f80ec0a1660 msgr2=0x7f80ec13c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 --2- 172.21.15.63:0/1436471940 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f80ec0a1660 0x7f80ec13c700 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097d0 tx=0x7f80e002b810 comp rx=0 tx=0).stop 2024-03-27T21:30:10.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 -- 172.21.15.63:0/1436471940 shutdown_connections 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 --2- 172.21.15.63:0/1436471940 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f80ec0a1660 0x7f80ec13c700 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 -- 172.21.15.63:0/1436471940 >> 172.21.15.63:0/1436471940 conn(0x7f80ec0a2040 msgr2=0x7f80ec0a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 -- 172.21.15.63:0/1436471940 shutdown_connections 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 1 -- 172.21.15.63:0/1436471940 wait complete. 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.194+0000 7f80f342f640 10 monclient: monmap: 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 0.000000 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:created 0.000000 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 1 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:10.207 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 librados: starting msgr at 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 librados: starting objecter 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 Processor -- start 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 -- start start 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 librados: setting wanted keys 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 librados: calling monclient init 2024-03-27T21:30:10.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient: init 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient: _add_conns ranks=[7,1,5,3,8,2,4,0,6] 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f80ec098c20 0x7f80ec1cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): picked mon.noname-i con 0x7f80ec098c20 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 0x7f80ec1cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): picked mon.noname-f con 0x7f80ec0a1660 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f80ec0a1a60 0x7f80ec06fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): picked mon.noname-h con 0x7f80ec0a1a60 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec099c00 con 0x7f80ec0a1660 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0977e0 con 0x7f80ec0a1a60 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec0901e0 con 0x7f80ec098c20 2024-03-27T21:30:10.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f342f640 10 monclient(hunting): authenticate will time out at 769.523523s 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 0x7f80ec1cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 0x7f80ec1cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41510/0 (socket says 172.21.15.63:41510) 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 1 -- 172.21.15.63:0/3299853010 learned_addr learned my addr 172.21.15.63:0/3299853010 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): get_auth_request con 0x7f80ec0a1660 auth_method 0 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f80ec098c20 0x7f80ec1cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f80ec0a1a60 0x7f80ec06fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 10 monclient(hunting): get_auth_request con 0x7f80ec098c20 auth_method 0 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): get_auth_request con 0x7f80ec0a1a60 auth_method 0 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f09ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f19cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.195+0000 7f80f11cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f11cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 10 monclient(hunting): handle_auth_done global_id 4123 payload 824 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 -- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f80ec098c20 msgr2=0x7f80ec1cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f80ec098c20 0x7f80ec1cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 -- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f80ec0a1a60 msgr2=0x7f80ec06fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f80ec0a1a60 0x7f80ec06fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 monclient: found mon.noname-f 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 -- 172.21.15.63:0/3299853010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e0009400 con 0x7f80ec0a1660 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f09ca640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 0x7f80ec1cbef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097d0 tx=0x7f80e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 client.?.objecter ms_handle_connect 0x7f80ec0a1660 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f80e0006e10 con 0x7f80ec0a1660 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: dump: 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.213 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 5 monclient: authenticate success, global_id 4123 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0040070 con 0x7f80ec0a1660 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 10 monclient: _renew_subs 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f80e0047480 con 0x7f80ec0a1660 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec071800 con 0x7f80ec0a1660 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80eb7fe640 4 set_mon_vals no callback set 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 10 monclient: dump: 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.215 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 10 client.4123.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 10 monclient: _renew_subs 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec0907a0 con 0x7f80ec0a1660 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80f342f640 1 librados: init done 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f80e0003910 con 0x7f80ec0a1660 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.196+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f80e0042070 con 0x7f80ec0a1660 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80e9ffb640 10 client.4123.objecter ms_dispatch 0x7f80ec000b90 osd_map(2..2 src has 1..2) v4 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80e9ffb640 3 client.4123.objecter handle_osd_map got epochs [2,2] > 0 2024-03-27T21:30:10.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80e9ffb640 3 client.4123.objecter handle_osd_map decoding full epoch 2 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80e9ffb640 20 client.4123.objecter dump_active .. 0 homeless 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80f342f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80f342f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80f342f640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.197+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec074b30 con 0x7f80ec0a1660 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.199+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f80e004c020 con 0x7f80ec0a1660 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.199+0000 7f80e9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.199+0000 7f80e9ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.271+0000 7f80f342f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "37060d25-81fc-4070-99eb-bbe68095b643", "id": 0}] 2024-03-27T21:30:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.271+0000 7f80f342f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "37060d25-81fc-4070-99eb-bbe68095b643", "id": 0}] 2024-03-27T21:30:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.271+0000 7f80f342f640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.271+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37060d25-81fc-4070-99eb-bbe68095b643", "id": 0} v 0) v1 -- 0x7f80ec08feb0 con 0x7f80ec0a1660 2024-03-27T21:30:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.277+0000 7f80e9ffb640 1 -- 172.21.15.63:0/3299853010 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37060d25-81fc-4070-99eb-bbe68095b643", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f80e0003da0 con 0x7f80ec0a1660 2024-03-27T21:30:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.277+0000 7f80e9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "37060d25-81fc-4070-99eb-bbe68095b643", "id": 0}] 2024-03-27T21:30:10.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.277+0000 7f80e9ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:10.266 INFO:teuthology.orchestra.run.smithi063.stdout:0 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 10 librados: watch_flush enter 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 10 librados: watch_flush exit 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 20 client.4123.objecter shutdown clearing up homeless session... 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 10 client.4123.objecter successfully canceled tick 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 10 monclient: shutdown 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 msgr2=0x7f80ec1cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 0x7f80ec1cbef0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f80e00097d0 tx=0x7f80e00046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 shutdown_connections 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f80ec0a1a60 0x7f80ec06fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80ec0a1660 0x7f80ec1cbef0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 --2- 172.21.15.63:0/3299853010 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f80ec098c20 0x7f80ec1cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 >> 172.21.15.63:0/3299853010 conn(0x7f80ec0a2040 msgr2=0x7f80ec1bcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 shutdown_connections 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 -- 172.21.15.63:0/3299853010 wait complete. 2024-03-27T21:30:10.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.278+0000 7f80f342f640 1 librados: shutdown 2024-03-27T21:30:10.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 461efe32-03d3-4689-8ae7-d205f89a38d3 1 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.388+0000 7f94f1c13640 10 monclient: get_monmap_and_config 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.388+0000 7f94f1c13640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.388+0000 7f94f1c13640 10 monclient: monmap: 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:30:10.388939+0000 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:30:10.388939+0000 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.377 INFO:teuthology.orchestra.run.smithi063.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:10.378 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.388+0000 7f94f1c13640 1 Processor -- start 2024-03-27T21:30:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.388+0000 7f94f1c13640 1 -- start start 2024-03-27T21:30:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.388+0000 7f94f1c13640 10 monclient: init 2024-03-27T21:30:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient: _add_conns ranks=[7,10,3,5,4,6,0,2,9,1,8] 2024-03-27T21:30:10.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f94ec09ece0 0x7f94ec134e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): picked mon.noname-i con 0x7f94ec09ece0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f94ec09f0c0 0x7f94ec0a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): picked mon.noname-f con 0x7f94ec09f0c0 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 0x7f94ec0a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): picked mon.noname-g con 0x7f94ec09f4e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec1353c0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec09cfc0 con 0x7f94ec09f4e0 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec09bdf0 con 0x7f94ec09ece0 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94f1c13640 10 monclient(hunting): authenticate will time out at 769.717149s 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f94ec09ece0 0x7f94ec134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f94ec09f0c0 0x7f94ec0a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 0x7f94ec0a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f94ec09f0c0 0x7f94ec0a0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41534/0 (socket says 172.21.15.63:41534) 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 -- 172.21.15.63:0/8778621 learned_addr learned my addr 172.21.15.63:0/8778621 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): get_auth_request con 0x7f94ec09ece0 auth_method 0 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 0x7f94ec0a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.63:38750/0 (socket says 172.21.15.63:38750) 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): get_auth_request con 0x7f94ec09f0c0 auth_method 0 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): get_auth_request con 0x7f94ec09f4e0 auth_method 0 2024-03-27T21:30:10.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient(hunting): handle_auth_done global_id 4141 payload 274 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 -- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f94ec09ece0 msgr2=0x7f94ec134e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:10.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f94ec09ece0 0x7f94ec134e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 -- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 msgr2=0x7f94ec0a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 0x7f94ec0a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 monclient: found mon.noname-f 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eaffd640 1 -- 172.21.15.63:0/8778621 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0618f0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94eb7fe640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f94ec09ece0 0x7f94ec134e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.389+0000 7f94ebfff640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 0x7f94ec0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94eaffd640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94ec09f0c0 0x7f94ec0a0fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009870 tx=0x7f94dc02b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c6378737b8dc55 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 1 -- 172.21.15.63:0/8778621 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f94dc031990 con 0x7f94ec09f0c0 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:10.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: dump: 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94f1c13640 5 monclient: authenticate success, global_id 4141 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 1 -- 172.21.15.63:0/8778621 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc031b10 con 0x7f94ec09f0c0 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94f1c13640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94f1c13640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94f1c13640 4 set_mon_vals no callback set 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 1 -- 172.21.15.63:0/8778621 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f94dc031cc0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.390+0000 7f94ea7fc640 10 monclient: dump: 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.394 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 10 monclient: shutdown 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 -- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94ec09f0c0 msgr2=0x7f94ec0a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94ec09f0c0 0x7f94ec0a0fe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009870 tx=0x7f94dc02b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 -- 172.21.15.63:0/8778621 shutdown_connections 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f4e0 0x7f94ec0a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f94ec09f0c0 0x7f94ec0a0fe0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 --2- 172.21.15.63:0/8778621 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f94ec09ece0 0x7f94ec134e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 -- 172.21.15.63:0/8778621 >> 172.21.15.63:0/8778621 conn(0x7f94ec0a20d0 msgr2=0x7f94ec0a24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 -- 172.21.15.63:0/8778621 shutdown_connections 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 1 -- 172.21.15.63:0/8778621 wait complete. 2024-03-27T21:30:10.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.391+0000 7f94f1c13640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient: monmap: 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 0.000000 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:created 0.000000 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 1 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 librados: starting msgr at 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 librados: starting objecter 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 Processor -- start 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 -- start start 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 librados: setting wanted keys 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 librados: calling monclient init 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient: init 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient: _add_conns ranks=[2,3,5,1,0,4,7,6,8] 2024-03-27T21:30:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f94ec09ece0 0x7f94ec12d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): picked mon.noname-b con 0x7f94ec09ece0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 0x7f94ec12c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): picked mon.noname-g con 0x7f94ec09f0c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f94ec09f4e0 0x7f94ec133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): picked mon.noname-h con 0x7f94ec09f4e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec12c930 con 0x7f94ec09ece0 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec12f360 con 0x7f94ec09f0c0 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec12f080 con 0x7f94ec09f4e0 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.392+0000 7f94f1c13640 10 monclient(hunting): authenticate will time out at 769.720778s 2024-03-27T21:30:10.398 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 0x7f94ec12c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f94ec09f4e0 0x7f94ec133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 0x7f94ec12c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.63:38766/0 (socket says 172.21.15.63:38766) 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f94ec09f4e0 0x7f94ec133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.63:48802/0 (socket says 172.21.15.63:48802) 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 -- 172.21.15.63:0/524538824 learned_addr learned my addr 172.21.15.63:0/524538824 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): get_auth_request con 0x7f94ec09f0c0 auth_method 0 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): get_auth_request con 0x7f94ec09f4e0 auth_method 0 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.399 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94ebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eb7fe640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f94ec09ece0 0x7f94ec12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eb7fe640 10 monclient(hunting): get_auth_request con 0x7f94ec09ece0 auth_method 0 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient(hunting): handle_auth_done global_id 4125 payload 824 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 -- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f94ec09f4e0 msgr2=0x7f94ec133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f94ec09f4e0 0x7f94ec133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 -- 172.21.15.63:0/524538824 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f94ec09ece0 msgr2=0x7f94ec12d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f94ec09ece0 0x7f94ec12d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 monclient: found mon.noname-g 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 -- 172.21.15.63:0/524538824 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009400 con 0x7f94ec09f0c0 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eb7fe640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f94ec09ece0 0x7f94ec12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94eaffd640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 0x7f94ec12c270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0090b0 tx=0x7f94dc0046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 client.?.objecter ms_handle_connect 0x7f94ec09f0c0 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f94dc031950 con 0x7f94ec09f0c0 2024-03-27T21:30:10.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: dump: 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.402 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc003a80 con 0x7f94ec09f0c0 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 5 monclient: authenticate success, global_id 4125 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 10 monclient: _renew_subs 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4009a70 con 0x7f94ec09f0c0 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.403 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f94dc003bf0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 10 client.4125.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94d3fff640 10 monclient: dump: 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.404 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94e9ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 10 monclient: _renew_subs 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc0094d0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.393+0000 7f94f1c13640 1 librados: init done 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f94dc03a040 con 0x7f94ec09f0c0 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f94dc047bc0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94d3fff640 10 client.4125.objecter ms_dispatch 0x7f94ec000b90 osd_map(3..3 src has 1..3) v4 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94d3fff640 3 client.4125.objecter handle_osd_map got epochs [3,3] > 0 2024-03-27T21:30:10.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94d3fff640 3 client.4125.objecter handle_osd_map decoding full epoch 3 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94d3fff640 20 client.4125.objecter dump_active .. 0 homeless 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.394+0000 7f94f1c13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.395+0000 7f94f1c13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.395+0000 7f94f1c13640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.395+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec12eed0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.397+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f94dc066b50 con 0x7f94ec09f0c0 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.397+0000 7f94d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.406 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.397+0000 7f94d3fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.469+0000 7f94f1c13640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "461efe32-03d3-4689-8ae7-d205f89a38d3", "id": 1}] 2024-03-27T21:30:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.469+0000 7f94f1c13640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "461efe32-03d3-4689-8ae7-d205f89a38d3", "id": 1}] 2024-03-27T21:30:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.469+0000 7f94f1c13640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.469+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_command({"prefix": "osd new", "uuid": "461efe32-03d3-4689-8ae7-d205f89a38d3", "id": 1} v 0) v1 -- 0x7f94ec12f4a0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.478+0000 7f94d3fff640 1 -- 172.21.15.63:0/524538824 <== mon.3 v2:172.21.15.63:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "461efe32-03d3-4689-8ae7-d205f89a38d3", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f94ec12f4a0 con 0x7f94ec09f0c0 2024-03-27T21:30:10.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.478+0000 7f94d3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "461efe32-03d3-4689-8ae7-d205f89a38d3", "id": 1}] 2024-03-27T21:30:10.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.478+0000 7f94d3fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:10.467 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-03-27T21:30:10.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 10 librados: watch_flush enter 2024-03-27T21:30:10.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 10 librados: watch_flush exit 2024-03-27T21:30:10.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 20 client.4125.objecter shutdown clearing up homeless session... 2024-03-27T21:30:10.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 10 client.4125.objecter successfully canceled tick 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 10 monclient: shutdown 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 msgr2=0x7f94ec12c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 0x7f94ec12c270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0090b0 tx=0x7f94dc0046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 shutdown_connections 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f94ec09f4e0 0x7f94ec133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f94ec09f0c0 0x7f94ec12c270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 --2- 172.21.15.63:0/524538824 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f94ec09ece0 0x7f94ec12d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 >> 172.21.15.63:0/524538824 conn(0x7f94ec0a20d0 msgr2=0x7f94ec0a4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 shutdown_connections 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 -- 172.21.15.63:0/524538824 wait complete. 2024-03-27T21:30:10.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.479+0000 7f94f1c13640 1 librados: shutdown 2024-03-27T21:30:10.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 4bd58f9d-27f7-4792-8e8b-453d689eae46 2 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.589+0000 7f0287388640 10 monclient: get_monmap_and_config 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.589+0000 7f0287388640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.589+0000 7f0287388640 10 monclient: monmap: 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:30:10.590724+0000 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:30:10.590724+0000 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:10.579 INFO:teuthology.orchestra.run.smithi063.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.590+0000 7f0287388640 1 Processor -- start 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.590+0000 7f0287388640 1 -- start start 2024-03-27T21:30:10.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.590+0000 7f0287388640 10 monclient: init 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient: _add_conns ranks=[1,10,9,3,2,4,7,0,5,6,8] 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0280133b90 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0280071590 0x7f0280138b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): picked mon.noname-f con 0x7f0280071590 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f02801390c0 0x7f028013b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): picked mon.noname-a con 0x7f02801390c0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02800618f0 con 0x7f0280133b90 2024-03-27T21:30:10.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028009ded0 con 0x7f02801390c0 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028009f180 con 0x7f0280071590 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0287388640 10 monclient(hunting): authenticate will time out at 769.918930s 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0280071590 0x7f0280138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285124640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0280133b90 0x7f0280133f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59812/0 (socket says 172.21.15.63:59812) 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0280071590 0x7f0280138b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41542/0 (socket says 172.21.15.63:41542) 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285124640 1 -- 172.21.15.63:0/3594291915 learned_addr learned my addr 172.21.15.63:0/3594291915 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): get_auth_request con 0x7f0280071590 auth_method 0 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285925640 1 --2- 172.21.15.63:0/3594291915 >> v2:172.21.15.28:3300/0 conn(0x7f02801390c0 0x7f028013b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285925640 10 monclient(hunting): get_auth_request con 0x7f02801390c0 auth_method 0 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285925640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285925640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0285925640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient(hunting): handle_auth_done global_id 4150 payload 274 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 -- 172.21.15.63:0/3594291915 >> v2:172.21.15.28:3300/0 conn(0x7f02801390c0 msgr2=0x7f028013b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:10.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 --2- 172.21.15.63:0/3594291915 >> v2:172.21.15.28:3300/0 conn(0x7f02801390c0 0x7f028013b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 -- 172.21.15.63:0/3594291915 >> v1:172.21.15.63:6789/0 conn(0x7f0280133b90 legacy=0x7f0280133f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 monclient: found mon.noname-f 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0277fff640 1 -- 172.21.15.63:0/3594291915 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1521520513 0 0) 0x7f02800618f0 con 0x7f0280133b90 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0284923640 1 -- 172.21.15.63:0/3594291915 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028009f460 con 0x7f0280071590 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.591+0000 7f0277fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0284923640 1 --2- 172.21.15.63:0/3594291915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0280071590 0x7f0280138b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f028006e360 tx=0x7f027002b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd3d2342bcbaedcb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 1 -- 172.21.15.63:0/3594291915 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0270031980 con 0x7f0280071590 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:10.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: dump: 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.594 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 1 -- 172.21.15.63:0/3594291915 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027002f050 con 0x7f0280071590 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0287388640 5 monclient: authenticate success, global_id 4150 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0287388640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0287388640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 1 -- 172.21.15.63:0/3594291915 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f02700323a0 con 0x7f0280071590 2024-03-27T21:30:10.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0287388640 4 set_mon_vals no callback set 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.592+0000 7f0277fff640 10 monclient: dump: 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.596 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 10 monclient: shutdown 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 -- 172.21.15.63:0/3594291915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0280071590 msgr2=0x7f0280138b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 --2- 172.21.15.63:0/3594291915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0280071590 0x7f0280138b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f028006e360 tx=0x7f027002b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 -- 172.21.15.63:0/3594291915 shutdown_connections 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 --2- 172.21.15.63:0/3594291915 >> v2:172.21.15.28:3300/0 conn(0x7f02801390c0 0x7f028013b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 --2- 172.21.15.63:0/3594291915 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0280071590 0x7f0280138b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 -- 172.21.15.63:0/3594291915 >> 172.21.15.63:0/3594291915 conn(0x7f02800a65f0 msgr2=0x7f02800a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 -- 172.21.15.63:0/3594291915 shutdown_connections 2024-03-27T21:30:10.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 1 -- 172.21.15.63:0/3594291915 wait complete. 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.593+0000 7f0287388640 10 monclient: monmap: 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 0.000000 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:created 0.000000 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 1 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.598 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 librados: starting msgr at 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 librados: starting objecter 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 Processor -- start 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 -- start start 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 librados: setting wanted keys 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 librados: calling monclient init 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient: init 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient: _add_conns ranks=[0,7,1,5,3,2,8,4,6] 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0280071590 0x7f028009bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): picked mon.noname-a con 0x7f0280071590 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0280133b90 0x7f028012bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): picked mon.noname-i con 0x7f0280133b90 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 0x7f028012c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): picked mon.noname-f con 0x7f02801390c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0280071390 con 0x7f0280071590 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028009e6b0 con 0x7f02801390c0 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f02800719e0 con 0x7f0280133b90 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0287388640 10 monclient(hunting): authenticate will time out at 769.922503s 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 0x7f028012c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0280133b90 0x7f028012bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 0x7f028012c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41556/0 (socket says 172.21.15.63:41556) 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 1 -- 172.21.15.63:0/397111469 learned_addr learned my addr 172.21.15.63:0/397111469 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): get_auth_request con 0x7f02801390c0 auth_method 0 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): get_auth_request con 0x7f0280133b90 auth_method 0 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285925640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0284923640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285124640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0280071590 0x7f028009bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285124640 10 monclient(hunting): get_auth_request con 0x7f0280071590 auth_method 0 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285124640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285124640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.594+0000 7f0285124640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 10 monclient(hunting): handle_auth_done global_id 4168 payload 824 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 -- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0280133b90 msgr2=0x7f028012bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0280133b90 0x7f028012bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 -- 172.21.15.63:0/397111469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0280071590 msgr2=0x7f028009bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0280071590 0x7f028009bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 monclient: found mon.noname-f 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 -- 172.21.15.63:0/397111469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270009400 con 0x7f02801390c0 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285124640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0280071590 0x7f028009bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0285925640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 0x7f028012c1b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f02780070b0 tx=0x7f02780085d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 client.?.objecter ms_handle_connect 0x7f02801390c0 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0278010070 con 0x7f02801390c0 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: dump: 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.603 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0278008e00 con 0x7f02801390c0 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 5 monclient: authenticate success, global_id 4168 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0278003e00 con 0x7f02801390c0 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 10 monclient: _renew_subs 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028009aad0 con 0x7f02801390c0 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f02777fe640 4 set_mon_vals no callback set 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 monclient: dump: 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.605 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0278014030 con 0x7f02801390c0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 10 client.4168.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 10 monclient: _renew_subs 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0280070ba0 con 0x7f02801390c0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0287388640 1 librados: init done 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0278004030 con 0x7f02801390c0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 10 client.4168.objecter ms_dispatch 0x7f0280000b90 osd_map(4..4 src has 1..4) v4 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 3 client.4168.objecter handle_osd_map got epochs [4,4] > 0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 3 client.4168.objecter handle_osd_map decoding full epoch 4 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.595+0000 7f0275ffb640 20 client.4168.objecter dump_active .. 0 homeless 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.596+0000 7f0287388640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.596+0000 7f0287388640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.596+0000 7f0287388640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.596+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028009ae20 con 0x7f02801390c0 2024-03-27T21:30:10.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.598+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f02780041f0 con 0x7f02801390c0 2024-03-27T21:30:10.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.598+0000 7f0275ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.598+0000 7f0275ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.673+0000 7f0287388640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4bd58f9d-27f7-4792-8e8b-453d689eae46", "id": 2}] 2024-03-27T21:30:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.673+0000 7f0287388640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4bd58f9d-27f7-4792-8e8b-453d689eae46", "id": 2}] 2024-03-27T21:30:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.673+0000 7f0287388640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.673+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4bd58f9d-27f7-4792-8e8b-453d689eae46", "id": 2} v 0) v1 -- 0x7f0280133820 con 0x7f02801390c0 2024-03-27T21:30:10.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.677+0000 7f0275ffb640 1 -- 172.21.15.63:0/397111469 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4bd58f9d-27f7-4792-8e8b-453d689eae46", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0278003bb0 con 0x7f02801390c0 2024-03-27T21:30:10.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.677+0000 7f0275ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4bd58f9d-27f7-4792-8e8b-453d689eae46", "id": 2}] 2024-03-27T21:30:10.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.677+0000 7f0275ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:10.666 INFO:teuthology.orchestra.run.smithi063.stdout:2 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 10 librados: watch_flush enter 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 10 librados: watch_flush exit 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 20 client.4168.objecter shutdown clearing up homeless session... 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 10 client.4168.objecter successfully canceled tick 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 10 monclient: shutdown 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 msgr2=0x7f028012c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 0x7f028012c1b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f02780070b0 tx=0x7f02780085d0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 shutdown_connections 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0280133b90 0x7f028012bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f02801390c0 0x7f028012c1b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 --2- 172.21.15.63:0/397111469 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0280071590 0x7f028009bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 >> 172.21.15.63:0/397111469 conn(0x7f02800a65f0 msgr2=0x7f02800a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 shutdown_connections 2024-03-27T21:30:10.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 -- 172.21.15.63:0/397111469 wait complete. 2024-03-27T21:30:10.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.678+0000 7f0287388640 1 librados: shutdown 2024-03-27T21:30:10.677 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new b15adb32-5d9e-4bc8-9258-a46cfd3c8a13 3 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.788+0000 7f7ceb1a9640 10 monclient: get_monmap_and_config 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.788+0000 7f7ceb1a9640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.788+0000 7f7ceb1a9640 10 monclient: monmap: 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:30:10.789151+0000 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:30:10.789151+0000 2024-03-27T21:30:10.777 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:10.778 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 Processor -- start 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 -- start start 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient: init 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient: _add_conns ranks=[1,2,10,7,8,9,6,3,0,4,5] 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7ce4069c80 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ce40a1050 0x7f7ce409bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): picked mon.noname-b con 0x7f7ce40a1050 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ce409c270 0x7f7ce413e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): picked mon.noname-f con 0x7f7ce409c270 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce40618f0 con 0x7f7ce4069c80 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce409b290 con 0x7f7ce409c270 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce406a060 con 0x7f7ce40a1050 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ceb1a9640 10 monclient(hunting): authenticate will time out at 770.117431s 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ce409c270 0x7f7ce413e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce8f45640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7ce4069c80 0x7f7ce409b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:59818/0 (socket says 172.21.15.63:59818) 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7ce409c270 0x7f7ce413e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41562/0 (socket says 172.21.15.63:41562) 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce8f45640 1 -- 172.21.15.63:0/1137811691 learned_addr learned my addr 172.21.15.63:0/1137811691 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): get_auth_request con 0x7f7ce409c270 auth_method 0 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce9746640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.789+0000 7f7ce3fff640 1 --2- 172.21.15.63:0/1137811691 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ce40a1050 0x7f7ce409bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce3fff640 10 monclient(hunting): get_auth_request con 0x7f7ce40a1050 auth_method 0 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 10 monclient(hunting): handle_auth_done global_id 4177 payload 274 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 1 -- 172.21.15.63:0/1137811691 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ce40a1050 msgr2=0x7f7ce409bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 1 --2- 172.21.15.63:0/1137811691 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ce40a1050 0x7f7ce409bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 1 -- 172.21.15.63:0/1137811691 >> v1:172.21.15.63:6789/0 conn(0x7f7ce4069c80 legacy=0x7f7ce409b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 1 monclient: found mon.noname-f 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:10.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 1 -- 172.21.15.63:0/1137811691 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce409a960 con 0x7f7ce409c270 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce37fe640 1 -- 172.21.15.63:0/1137811691 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249268880 0 0) 0x7f7ce40618f0 con 0x7f7ce4069c80 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce37fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce9746640 1 --2- 172.21.15.63:0/1137811691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ce409c270 0x7f7ce413e810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009d90 tx=0x7f7cdc02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c2bd568930c208 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce37fe640 1 -- 172.21.15.63:0/1137811691 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7cdc02cda0 con 0x7f7ce409c270 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.790+0000 7f7ce37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: dump: 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.794 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 5 monclient: authenticate success, global_id 4177 2024-03-27T21:30:10.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 1 -- 172.21.15.63:0/1137811691 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc032340 con 0x7f7ce409c270 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 4 set_mon_vals no callback set 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 1 -- 172.21.15.63:0/1137811691 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7cdc032920 con 0x7f7ce409c270 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ce37fe640 10 monclient: dump: 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.796 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 10 monclient: shutdown 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/1137811691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ce409c270 msgr2=0x7f7ce413e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/1137811691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ce409c270 0x7f7ce413e810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc009d90 tx=0x7f7cdc02bd80 comp rx=0 tx=0).stop 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/1137811691 shutdown_connections 2024-03-27T21:30:10.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/1137811691 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7ce409c270 0x7f7ce413e810 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/1137811691 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ce40a1050 0x7f7ce409bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/1137811691 >> 172.21.15.63:0/1137811691 conn(0x7f7ce40a2140 msgr2=0x7f7ce40a2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/1137811691 shutdown_connections 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.791+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/1137811691 wait complete. 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 10 monclient: monmap: 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 0.000000 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:created 0.000000 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 1 2024-03-27T21:30:10.798 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 1 librados: starting msgr at 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 1 librados: starting objecter 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 1 Processor -- start 2024-03-27T21:30:10.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 1 -- start start 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 1 librados: setting wanted keys 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 1 librados: calling monclient init 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.792+0000 7f7ceb1a9640 10 monclient: init 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient: _add_conns ranks=[4,6,0,7,5,3,8,2,1] 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ce4069c80 0x7f7ce4090eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): picked mon.noname-c con 0x7f7ce4069c80 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7ce409c270 0x7f7ce41c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): picked mon.noname-d con 0x7f7ce409c270 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 0x7f7ce4097c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): picked mon.noname-a con 0x7f7ce40a1050 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce409a1a0 con 0x7f7ce40a1050 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce4099be0 con 0x7f7ce4069c80 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce4091830 con 0x7f7ce409c270 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ceb1a9640 10 monclient(hunting): authenticate will time out at 770.121049s 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ce4069c80 0x7f7ce4090eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 0x7f7ce4097c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7ce409c270 0x7f7ce41c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ce4069c80 0x7f7ce4090eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.63:36418/0 (socket says 172.21.15.63:36418) 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 0x7f7ce4097c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.63:32940/0 (socket says 172.21.15.63:32940) 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 1 -- 172.21.15.63:0/3054181122 learned_addr learned my addr 172.21.15.63:0/3054181122 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): get_auth_request con 0x7f7ce4069c80 auth_method 0 2024-03-27T21:30:10.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): get_auth_request con 0x7f7ce409c270 auth_method 0 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): get_auth_request con 0x7f7ce40a1050 auth_method 0 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce8f45640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient(hunting): handle_auth_done global_id 4149 payload 824 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 -- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7ce409c270 msgr2=0x7f7ce41c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7ce409c270 0x7f7ce41c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 -- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ce4069c80 msgr2=0x7f7ce4090eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ce4069c80 0x7f7ce4090eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 monclient: found mon.noname-a 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:10.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.793+0000 7f7ce9746640 1 -- 172.21.15.63:0/3054181122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc009a70 con 0x7f7ce40a1050 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce9746640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 0x7f7ce4097c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ce406d100 tx=0x7f7cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 client.?.objecter ms_handle_connect 0x7f7ce40a1050 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7cdc0046c0 con 0x7f7ce40a1050 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: dump: 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.804 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 5 monclient: authenticate success, global_id 4149 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc004840 con 0x7f7ce40a1050 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 10 monclient: _renew_subs 2024-03-27T21:30:10.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce41c8df0 con 0x7f7ce40a1050 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7cdc032920 con 0x7f7ce40a1050 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce2ffd640 4 set_mon_vals no callback set 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 monclient: dump: 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.806 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 10 client.4149.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 10 monclient: _renew_subs 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce41c8470 con 0x7f7ce40a1050 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ceb1a9640 1 librados: init done 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7cdc004250 con 0x7f7ce40a1050 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7cdc004500 con 0x7f7ce40a1050 2024-03-27T21:30:10.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 10 client.4149.objecter ms_dispatch 0x7f7ce4000b90 osd_map(5..5 src has 1..5) v4 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 3 client.4149.objecter handle_osd_map got epochs [5,5] > 0 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 3 client.4149.objecter handle_osd_map decoding full epoch 5 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.794+0000 7f7ce17fa640 20 client.4149.objecter dump_active .. 0 homeless 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.795+0000 7f7ceb1a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.795+0000 7f7ceb1a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.795+0000 7f7ceb1a9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.795+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce4074b30 con 0x7f7ce40a1050 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.797+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f7cdc044030 con 0x7f7ce40a1050 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.797+0000 7f7ce17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:10.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.797+0000 7f7ce17fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:10.842 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:10.853+0000 7faf7b00e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T21:30:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.870+0000 7f7ceb1a9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b15adb32-5d9e-4bc8-9258-a46cfd3c8a13", "id": 3}] 2024-03-27T21:30:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.870+0000 7f7ceb1a9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b15adb32-5d9e-4bc8-9258-a46cfd3c8a13", "id": 3}] 2024-03-27T21:30:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.870+0000 7f7ceb1a9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:10.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.870+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b15adb32-5d9e-4bc8-9258-a46cfd3c8a13", "id": 3} v 0) v1 -- 0x7f7ce409edd0 con 0x7f7ce40a1050 2024-03-27T21:30:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.876+0000 7f7ce17fa640 1 -- 172.21.15.63:0/3054181122 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b15adb32-5d9e-4bc8-9258-a46cfd3c8a13", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7cdc039070 con 0x7f7ce40a1050 2024-03-27T21:30:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.876+0000 7f7ce17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b15adb32-5d9e-4bc8-9258-a46cfd3c8a13", "id": 3}] 2024-03-27T21:30:10.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.876+0000 7f7ce17fa640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:10.865 INFO:teuthology.orchestra.run.smithi063.stdout:3 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 10 librados: watch_flush enter 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 10 librados: watch_flush exit 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 20 client.4149.objecter shutdown clearing up homeless session... 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 10 client.4149.objecter successfully canceled tick 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 10 monclient: shutdown 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.867 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 msgr2=0x7f7ce4097c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 0x7f7ce4097c20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7ce406d100 tx=0x7f7cdc004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 shutdown_connections 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ce40a1050 0x7f7ce4097c20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7ce409c270 0x7f7ce41c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 --2- 172.21.15.63:0/3054181122 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ce4069c80 0x7f7ce4090eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 >> 172.21.15.63:0/3054181122 conn(0x7f7ce40a2140 msgr2=0x7f7ce41be9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 shutdown_connections 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 -- 172.21.15.63:0/3054181122 wait complete. 2024-03-27T21:30:10.868 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.877+0000 7f7ceb1a9640 1 librados: shutdown 2024-03-27T21:30:10.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 0b12f436-1c7e-425d-9ee7-23f2ead1f828 4 2024-03-27T21:30:10.902 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:10.913+0000 7faf7b00e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T21:30:10.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.986+0000 7faace674640 10 monclient: get_monmap_and_config 2024-03-27T21:30:10.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.986+0000 7faace674640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.986+0000 7faace674640 10 monclient: monmap: 2024-03-27T21:30:10.975 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.975 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:30:10.987515+0000 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:30:10.987515+0000 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:10.976 INFO:teuthology.orchestra.run.smithi063.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:10.977 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 Processor -- start 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 -- start start 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient: init 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient: _add_conns ranks=[3,8,6,1,9,4,7,10,5,0,2] 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 0x7faac8071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient(hunting): picked mon.noname-g con 0x7faac8071a50 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faac809f8b0 0x7faac806a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient(hunting): picked mon.noname-e con 0x7faac809f8b0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7faac806aa30 0x7faac806aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient(hunting): picked mon.noname-d con 0x7faac806aa30 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac809ebe0 con 0x7faac8071a50 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7faac809e690 con 0x7faac806aa30 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.987+0000 7faace674640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7faac809e900 con 0x7faac809f8b0 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faace674640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faace674640 10 monclient(hunting): authenticate will time out at 770.315808s 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 0x7faac8071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 0x7faac8071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.63:38770/0 (socket says 172.21.15.63:38770) 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 -- 172.21.15.63:0/4013517759 learned_addr learned my addr 172.21.15.63:0/4013517759 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): get_auth_request con 0x7faac8071a50 auth_method 0 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac77fe640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faac809f8b0 0x7faac806a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac77fe640 10 monclient(hunting): get_auth_request con 0x7faac809f8b0 auth_method 0 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faaccc11640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7faac806aa30 0x7faac806aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faaccc11640 10 monclient(hunting): get_auth_request con 0x7faac806aa30 auth_method 0 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faaccc11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faaccc11640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faaccc11640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient(hunting): handle_auth_done global_id 4134 payload 274 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 -- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faac809f8b0 msgr2=0x7faac806a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faac809f8b0 0x7faac806a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 -- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7faac806aa30 msgr2=0x7faac806aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7faac806aa30 0x7faac806aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 monclient: found mon.noname-g 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac7fff640 1 -- 172.21.15.63:0/4013517759 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80618f0 con 0x7faac8071a50 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faac77fe640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faac809f8b0 0x7faac806a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.988+0000 7faaccc11640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7faac806aa30 0x7faac806aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac7fff640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 0x7faac8071e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faabc0098a0 tx=0x7faabc02b7a0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=ac778d8a87ff87a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:10.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 1 -- 172.21.15.63:0/4013517759 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faabc02f050 con 0x7faac8071a50 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: dump: 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.992 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:10.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 1 -- 172.21.15.63:0/4013517759 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc031970 con 0x7faac8071a50 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 5 monclient: authenticate success, global_id 4134 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 1 -- 172.21.15.63:0/4013517759 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faabc032390 con 0x7faac8071a50 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 4 set_mon_vals no callback set 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faac6ffd640 10 monclient: dump: 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.994 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 10 monclient: shutdown 2024-03-27T21:30:10.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 -- 172.21.15.63:0/4013517759 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 msgr2=0x7faac8071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 0x7faac8071e30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faabc0098a0 tx=0x7faabc02b7a0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 -- 172.21.15.63:0/4013517759 shutdown_connections 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7faac806aa30 0x7faac806aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faac809f8b0 0x7faac806a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 --2- 172.21.15.63:0/4013517759 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faac8071a50 0x7faac8071e30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 -- 172.21.15.63:0/4013517759 >> 172.21.15.63:0/4013517759 conn(0x7faac80a2e50 msgr2=0x7faac80a3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 -- 172.21.15.63:0/4013517759 shutdown_connections 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.989+0000 7faace674640 1 -- 172.21.15.63:0/4013517759 wait complete. 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.990+0000 7faace674640 10 monclient: build_initial_monmap 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.990+0000 7faace674640 10 monclient: monmap: 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:10.996 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 0.000000 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:created 0.000000 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 1 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.990+0000 7faace674640 1 librados: starting msgr at 2024-03-27T21:30:10.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.990+0000 7faace674640 1 librados: starting objecter 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.990+0000 7faace674640 1 Processor -- start 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 -- start start 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 librados: setting wanted keys 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 librados: calling monclient init 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient: init 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient: _add_conns ranks=[1,0,5,8,2,4,3,6,7] 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 0x7faac81cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): picked mon.noname-f con 0x7faac806aa30 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac8071a50 0x7faac81bb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): picked mon.noname-a con 0x7faac8071a50 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faac809f8b0 0x7faac81bbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): picked mon.noname-h con 0x7faac809f8b0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:10.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac80a01a0 con 0x7faac8071a50 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac809d9c0 con 0x7faac806aa30 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faac81a9360 con 0x7faac809f8b0 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faace674640 10 monclient(hunting): authenticate will time out at 770.319247s 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 0x7faac81cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 0x7faac81cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:41570/0 (socket says 172.21.15.63:41570) 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 -- 172.21.15.63:0/4061000641 learned_addr learned my addr 172.21.15.63:0/4061000641 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): get_auth_request con 0x7faac806aa30 auth_method 0 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:10.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faac809f8b0 0x7faac81bbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): get_auth_request con 0x7faac809f8b0 auth_method 0 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac8071a50 0x7faac81bb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faaccc11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): get_auth_request con 0x7faac8071a50 auth_method 0 2024-03-27T21:30:11.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient(hunting): handle_auth_done global_id 4195 payload 824 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 -- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faac809f8b0 msgr2=0x7faac81bbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faac809f8b0 0x7faac81bbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 -- 172.21.15.63:0/4061000641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac8071a50 msgr2=0x7faac81bb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac8071a50 0x7faac81bb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 monclient: found mon.noname-f 2024-03-27T21:30:11.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.991+0000 7faac7fff640 1 -- 172.21.15.63:0/4061000641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0094d0 con 0x7faac806aa30 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac7fff640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 0x7faac81cb560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faabc0090b0 tx=0x7faabc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 client.?.objecter ms_handle_connect 0x7faac806aa30 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faabc031eb0 con 0x7faac806aa30 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: dump: 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.002 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.003 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 5 monclient: authenticate success, global_id 4195 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faabc003a80 con 0x7faac806aa30 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 10 monclient: _renew_subs 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac81a78e0 con 0x7faac806aa30 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faabc003bf0 con 0x7faac806aa30 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:11.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 10 client.4195.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac67fc640 4 set_mon_vals no callback set 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 monclient: dump: 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.005 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 10 monclient: _renew_subs 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac81a6f90 con 0x7faac806aa30 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faace674640 1 librados: init done 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faabc03a040 con 0x7faac806aa30 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7faabc003d50 con 0x7faac806aa30 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 10 client.4195.objecter ms_dispatch 0x7faac8000b90 osd_map(6..6 src has 1..6) v4 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 3 client.4195.objecter handle_osd_map got epochs [6,6] > 0 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 3 client.4195.objecter handle_osd_map decoding full epoch 6 2024-03-27T21:30:11.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.992+0000 7faac4ff9640 20 client.4195.objecter dump_active .. 0 homeless 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.993+0000 7faace674640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.993+0000 7faace674640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.993+0000 7faace674640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.993+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8074b30 con 0x7faac806aa30 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.995+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7faabc042070 con 0x7faac806aa30 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.995+0000 7faac4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:10.995+0000 7faac4ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.067+0000 7faace674640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0b12f436-1c7e-425d-9ee7-23f2ead1f828", "id": 4}] 2024-03-27T21:30:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.067+0000 7faace674640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0b12f436-1c7e-425d-9ee7-23f2ead1f828", "id": 4}] 2024-03-27T21:30:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.067+0000 7faace674640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:11.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.067+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b12f436-1c7e-425d-9ee7-23f2ead1f828", "id": 4} v 0) v1 -- 0x7faac81a8d00 con 0x7faac806aa30 2024-03-27T21:30:11.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.072+0000 7faac4ff9640 1 -- 172.21.15.63:0/4061000641 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b12f436-1c7e-425d-9ee7-23f2ead1f828", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7faabc038070 con 0x7faac806aa30 2024-03-27T21:30:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.072+0000 7faac4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0b12f436-1c7e-425d-9ee7-23f2ead1f828", "id": 4}] 2024-03-27T21:30:11.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.072+0000 7faac4ff9640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:11.061 INFO:teuthology.orchestra.run.smithi063.stdout:4 2024-03-27T21:30:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 10 librados: watch_flush enter 2024-03-27T21:30:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 10 librados: watch_flush exit 2024-03-27T21:30:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 20 client.4195.objecter shutdown clearing up homeless session... 2024-03-27T21:30:11.062 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 10 client.4195.objecter successfully canceled tick 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 10 monclient: shutdown 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 msgr2=0x7faac81cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 0x7faac81cb560 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faabc0090b0 tx=0x7faabc0046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 shutdown_connections 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faac809f8b0 0x7faac81bbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faac8071a50 0x7faac81bb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 --2- 172.21.15.63:0/4061000641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faac806aa30 0x7faac81cb560 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 >> 172.21.15.63:0/4061000641 conn(0x7faac80a2e50 msgr2=0x7faac81bed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 shutdown_connections 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 -- 172.21.15.63:0/4061000641 wait complete. 2024-03-27T21:30:11.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.073+0000 7faace674640 1 librados: shutdown 2024-03-27T21:30:11.072 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd new 51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93 5 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.222+0000 7ff71fde7640 10 monclient: get_monmap_and_config 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.222+0000 7ff71fde7640 10 monclient: build_initial_monmap 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.222+0000 7ff71fde7640 10 monclient: monmap: 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:30:11.222964+0000 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:30:11.222964+0000 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:11.211 INFO:teuthology.orchestra.run.smithi063.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.222+0000 7ff71fde7640 1 Processor -- start 2024-03-27T21:30:11.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.222+0000 7ff71fde7640 1 -- start start 2024-03-27T21:30:11.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.222+0000 7ff71fde7640 10 monclient: init 2024-03-27T21:30:11.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:11.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient: _add_conns ranks=[2,5,9,4,3,8,0,7,6,1,10] 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff718070b50 0x7ff718070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): picked mon.noname-b con 0x7ff718070b50 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 0x7ff7180a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): picked mon.noname-h con 0x7ff718071470 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff718137090 0x7ff7180a2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): picked mon.noname-a con 0x7ff718137090 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71806f620 con 0x7ff718137090 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71806bae0 con 0x7ff718070b50 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff71806d0c0 con 0x7ff718071470 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:11.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71fde7640 10 monclient(hunting): authenticate will time out at 770.551228s 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 0x7ff7180a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 0x7ff7180a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.63:48828/0 (socket says 172.21.15.63:48828) 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 -- 172.21.15.63:0/2792272383 learned_addr learned my addr 172.21.15.63:0/2792272383 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): get_auth_request con 0x7ff718071470 auth_method 0 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71db83640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff718070b50 0x7ff718070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71db83640 10 monclient(hunting): get_auth_request con 0x7ff718070b50 auth_method 0 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71db83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71db83640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71db83640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71e384640 1 --2- 172.21.15.63:0/2792272383 >> v2:172.21.15.28:3300/0 conn(0x7ff718137090 0x7ff7180a2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71e384640 10 monclient(hunting): get_auth_request con 0x7ff718137090 auth_method 0 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71e384640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71e384640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71e384640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient(hunting): handle_auth_done global_id 4145 payload 274 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 -- 172.21.15.63:0/2792272383 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff718070b50 msgr2=0x7ff718070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff718070b50 0x7ff718070f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 -- 172.21.15.63:0/2792272383 >> v2:172.21.15.28:3300/0 conn(0x7ff718137090 msgr2=0x7ff7180a2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 --2- 172.21.15.63:0/2792272383 >> v2:172.21.15.28:3300/0 conn(0x7ff718137090 0x7ff7180a2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient: _finish_hunting 0 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 monclient: found mon.noname-h 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71d382640 1 -- 172.21.15.63:0/2792272383 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7180618f0 con 0x7ff718071470 2024-03-27T21:30:11.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71db83640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff718070b50 0x7ff718070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.223+0000 7ff71e384640 1 --2- 172.21.15.63:0/2792272383 >> v2:172.21.15.28:3300/0 conn(0x7ff718137090 0x7ff7180a2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71d382640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 0x7ff7180a2a30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff708009870 tx=0x7ff70802b7c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=af28a986f083d6e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 1 -- 172.21.15.63:0/2792272383 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff708031990 con 0x7ff718071470 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: dump: 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.225 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: _finish_auth 0 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: _check_auth_tickets 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 1 -- 172.21.15.63:0/2792272383 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708031b10 con 0x7ff718071470 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71fde7640 5 monclient: authenticate success, global_id 4145 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71fde7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71fde7640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 1 -- 172.21.15.63:0/2792272383 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff708031cc0 con 0x7ff718071470 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71fde7640 4 set_mon_vals no callback set 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.224+0000 7ff71cb81640 10 monclient: dump: 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.227 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.228 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 10 monclient: shutdown 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 -- 172.21.15.63:0/2792272383 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 msgr2=0x7ff7180a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 0x7ff7180a2a30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff708009870 tx=0x7ff70802b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 -- 172.21.15.63:0/2792272383 shutdown_connections 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2792272383 >> v2:172.21.15.28:3300/0 conn(0x7ff718137090 0x7ff7180a2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7ff718071470 0x7ff7180a2a30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2792272383 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff718070b50 0x7ff718070f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 -- 172.21.15.63:0/2792272383 >> 172.21.15.63:0/2792272383 conn(0x7ff7180a78a0 msgr2=0x7ff7180a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 -- 172.21.15.63:0/2792272383 shutdown_connections 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 1 -- 172.21.15.63:0/2792272383 wait complete. 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 10 monclient: build_initial_monmap 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.225+0000 7ff71fde7640 10 monclient: monmap: 2024-03-27T21:30:11.229 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 0 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 0.000000 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:created 0.000000 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 1 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:11.230 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 librados: starting msgr at 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 librados: starting objecter 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 Processor -- start 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 -- start start 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 librados: setting wanted keys 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 librados: calling monclient init 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient: init 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient: _add_conns ranks=[8,3,1,6,2,7,0,4,5] 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff718070b50 0x7ff718120060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): picked mon.noname-e con 0x7ff718070b50 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 0x7ff7181205a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): picked mon.noname-g con 0x7ff718071470 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff718137090 0x7ff718120ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): picked mon.noname-f con 0x7ff718137090 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff718123620 con 0x7ff718137090 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff718124000 con 0x7ff718071470 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7ff71806c8a0 con 0x7ff718070b50 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71fde7640 10 monclient(hunting): authenticate will time out at 770.554470s 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 0x7ff7181205a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff718137090 0x7ff718120ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 0x7ff7181205a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.63:38774/0 (socket says 172.21.15.63:38774) 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): get_auth_request con 0x7ff718137090 auth_method 0 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 1 -- 172.21.15.63:0/2794627154 learned_addr learned my addr 172.21.15.63:0/2794627154 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-03-27T21:30:11.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): get_auth_request con 0x7ff718071470 auth_method 0 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71d382640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71e384640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.226+0000 7ff71db83640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff718070b50 0x7ff718120060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71db83640 10 monclient(hunting): get_auth_request con 0x7ff718070b50 auth_method 0 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71db83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71db83640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71db83640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 10 monclient(hunting): handle_auth_done global_id 4143 payload 824 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 -- 172.21.15.63:0/2794627154 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff718070b50 msgr2=0x7ff718120060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff718070b50 0x7ff718120060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 -- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff718137090 msgr2=0x7ff718120ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff718137090 0x7ff718120ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 10 monclient: _finish_hunting 0 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 monclient: found mon.noname-g 2024-03-27T21:30:11.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 -- 172.21.15.63:0/2794627154 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080094d0 con 0x7ff718071470 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71d382640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 0x7ff7181205a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7080090b0 tx=0x7ff7080046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 client.?.objecter ms_handle_connect 0x7ff718071470 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff708003a80 con 0x7ff718071470 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: dump: 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.235 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708003be0 con 0x7ff718071470 2024-03-27T21:30:11.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 5 monclient: authenticate success, global_id 4143 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff708003d50 con 0x7ff718071470 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 10 monclient: _renew_subs 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71806c440 con 0x7ff718071470 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70ffff640 4 set_mon_vals no callback set 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 monclient: dump: 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:epoch 1 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.237 INFO:teuthology.orchestra.run.smithi063.stderr:election_strategy: 3 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 10 client.4143.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 10 monclient: _renew_subs 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff718123340 con 0x7ff718071470 2024-03-27T21:30:11.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff71fde7640 1 librados: init done 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff70803a040 con 0x7ff718071470 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff708047450 con 0x7ff718071470 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 10 client.4143.objecter ms_dispatch 0x7ff718000b90 osd_map(7..7 src has 1..7) v4 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 3 client.4143.objecter handle_osd_map got epochs [7,7] > 0 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 3 client.4143.objecter handle_osd_map decoding full epoch 7 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.227+0000 7ff70e7fc640 20 client.4143.objecter dump_active .. 0 homeless 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.228+0000 7ff71fde7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.228+0000 7ff71fde7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.228+0000 7ff71fde7640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.228+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff718074b30 con 0x7ff718071470 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.230+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ff708066b50 con 0x7ff718071470 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.230+0000 7ff70e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.230+0000 7ff70e7fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:11.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.302+0000 7ff71fde7640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93", "id": 5}] 2024-03-27T21:30:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.302+0000 7ff71fde7640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93", "id": 5}] 2024-03-27T21:30:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.302+0000 7ff71fde7640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:11.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.302+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_command({"prefix": "osd new", "uuid": "51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93", "id": 5} v 0) v1 -- 0x7ff718121810 con 0x7ff718071470 2024-03-27T21:30:11.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.307+0000 7ff70e7fc640 1 -- 172.21.15.63:0/2794627154 <== mon.3 v2:172.21.15.63:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff708055030 con 0x7ff718071470 2024-03-27T21:30:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.307+0000 7ff70e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93", "id": 5}] 2024-03-27T21:30:11.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.307+0000 7ff70e7fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:11.297 INFO:teuthology.orchestra.run.smithi063.stdout:5 2024-03-27T21:30:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 10 librados: watch_flush enter 2024-03-27T21:30:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 10 librados: watch_flush exit 2024-03-27T21:30:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 20 client.4143.objecter shutdown clearing up homeless session... 2024-03-27T21:30:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 10 client.4143.objecter successfully canceled tick 2024-03-27T21:30:11.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 10 monclient: shutdown 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 msgr2=0x7ff7181205a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 0x7ff7181205a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7080090b0 tx=0x7ff7080046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 shutdown_connections 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff718137090 0x7ff718120ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff718071470 0x7ff7181205a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 --2- 172.21.15.63:0/2794627154 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff718070b50 0x7ff718120060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 >> 172.21.15.63:0/2794627154 conn(0x7ff7180a78a0 msgr2=0x7ff7180662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 shutdown_connections 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 -- 172.21.15.63:0/2794627154 wait complete. 2024-03-27T21:30:11.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-03-27T21:30:11.308+0000 7ff71fde7640 1 librados: shutdown 2024-03-27T21:30:11.308 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-27T21:30:11.308 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-27T21:30:11.311 INFO:tasks.ceph.osd.0:Started 2024-03-27T21:30:11.311 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-27T21:30:11.311 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-27T21:30:11.313 INFO:tasks.ceph.osd.1:Started 2024-03-27T21:30:11.313 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-27T21:30:11.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-27T21:30:11.315 INFO:tasks.ceph.osd.2:Started 2024-03-27T21:30:11.315 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-27T21:30:11.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-27T21:30:11.317 INFO:tasks.ceph.osd.3:Started 2024-03-27T21:30:11.317 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-27T21:30:11.318 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-27T21:30:11.320 INFO:tasks.ceph.osd.4:Started 2024-03-27T21:30:11.320 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-27T21:30:11.320 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-27T21:30:11.322 INFO:tasks.ceph.osd.5:Started 2024-03-27T21:30:11.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T21:30:11.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.449+0000 7f25444d2640 10 monclient: get_monmap_and_config 2024-03-27T21:30:11.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.449+0000 7f25444d2640 10 monclient: build_initial_monmap 2024-03-27T21:30:11.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.449+0000 7f25444d2640 10 monclient: monmap: 2024-03-27T21:30:11.438 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:11.438 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:11.450219+0000 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:11.450219+0000 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:11.439 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:11.440 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:11.440 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:11.440 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:11.440 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:11.440 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:11.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 Processor -- start 2024-03-27T21:30:11.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 -- start start 2024-03-27T21:30:11.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient: init 2024-03-27T21:30:11.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:11.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient: _add_conns ranks=[3,5,4,2,0,10,1,6,7,8,9] 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f253c09c4c0 0x7f253c09c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): picked mon.noname-g con 0x7f253c09c4c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c0a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): picked mon.noname-h con 0x7f253c0a1940 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 0x7f253c13bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): picked mon.noname-c con 0x7f253c0a22c0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c1359a0 con 0x7f253c09c4c0 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c134f00 con 0x7f253c0a22c0 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c09fcd0 con 0x7f253c0a1940 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f25444d2640 10 monclient(hunting): authenticate will time out at 833.757552s 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.450+0000 7f2542a6f640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 0x7f253c13bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 0x7f253c13bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:54296/0 (socket says 172.21.15.28:54296) 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 -- 172.21.15.28:0/2337128462 learned_addr learned my addr 172.21.15.28:0/2337128462 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): get_auth_request con 0x7f253c0a22c0 auth_method 0 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c0a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f253c09c4c0 0x7f253c09c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): get_auth_request con 0x7f253c0a1940 auth_method 0 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): get_auth_request con 0x7f253c09c4c0 auth_method 0 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2541a6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f254226e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient(hunting): handle_auth_done global_id 4153 payload 274 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 -- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 msgr2=0x7f253c0a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c0a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 -- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f253c09c4c0 msgr2=0x7f253c09c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f253c09c4c0 0x7f253c09c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient: _finish_hunting 0 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 monclient: found mon.noname-c 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:11.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.451+0000 7f2542a6f640 1 -- 172.21.15.28:0/2337128462 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0618f0 con 0x7f253c0a22c0 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f2542a6f640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 0x7f253c13bd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2534009eb0 tx=0x7f253402bd70 comp rx=0 tx=0).ready entity=mon.4 client_cookie=180dfaad1b515755 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 1 -- 172.21.15.28:0/2337128462 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f253402cb80 con 0x7f253c0a22c0 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: dump: 2024-03-27T21:30:11.454 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.455 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: _finish_auth 0 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: _check_auth_tickets 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 1 -- 172.21.15.28:0/2337128462 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253402cd00 con 0x7f253c0a22c0 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 5 monclient: authenticate success, global_id 4153 2024-03-27T21:30:11.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 1 -- 172.21.15.28:0/2337128462 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2534034860 con 0x7f253c0a22c0 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 4 set_mon_vals no callback set 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f254126c640 10 monclient: dump: 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.457 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 10 monclient: shutdown 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:11.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 -- 172.21.15.28:0/2337128462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 msgr2=0x7f253c13bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 0x7f253c13bd20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2534009eb0 tx=0x7f253402bd70 comp rx=0 tx=0).stop 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 -- 172.21.15.28:0/2337128462 shutdown_connections 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c0a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f253c0a22c0 0x7f253c13bd20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 --2- 172.21.15.28:0/2337128462 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f253c09c4c0 0x7f253c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 -- 172.21.15.28:0/2337128462 >> 172.21.15.28:0/2337128462 conn(0x7f253c0a65f0 msgr2=0x7f253c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 -- 172.21.15.28:0/2337128462 shutdown_connections 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.452+0000 7f25444d2640 1 -- 172.21.15.28:0/2337128462 wait complete. 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 10 monclient: build_initial_monmap 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 10 monclient: monmap: 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:11.459 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 1 librados: starting msgr at 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 1 librados: starting objecter 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 1 Processor -- start 2024-03-27T21:30:11.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 1 -- start start 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 1 librados: setting wanted keys 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 1 librados: calling monclient init 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.453+0000 7f25444d2640 10 monclient: init 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient: _add_conns ranks=[7,5,0,4,1,6,8,3,2] 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f253c09c4c0 0x7f253c1cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): picked mon.noname-i con 0x7f253c09c4c0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c133f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): picked mon.noname-h con 0x7f253c0a1940 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 0x7f253c134450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): picked mon.noname-a con 0x7f253c0a22c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c1349c0 con 0x7f253c0a22c0 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f253c06ad90 con 0x7f253c0a1940 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f253c071670 con 0x7f253c09c4c0 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f25444d2640 10 monclient(hunting): authenticate will time out at 833.761183s 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 0x7f253c134450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f253c09c4c0 0x7f253c1cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 0x7f253c134450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34832/0 (socket says 172.21.15.28:34832) 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 1 -- 172.21.15.28:0/2827489296 learned_addr learned my addr 172.21.15.28:0/2827489296 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): get_auth_request con 0x7f253c0a22c0 auth_method 0 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): get_auth_request con 0x7f253c09c4c0 auth_method 0 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): get_auth_request con 0x7f253c0a1940 auth_method 0 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient(hunting): handle_auth_done global_id 4165 payload 824 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 -- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 msgr2=0x7f253c133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c133f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 -- 172.21.15.28:0/2827489296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 msgr2=0x7f253c134450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 0x7f253c134450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient: _finish_hunting 0 2024-03-27T21:30:11.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 monclient: found mon.noname-i 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f254226e640 1 -- 172.21.15.28:0/2827489296 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009b30 con 0x7f253c09c4c0 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2541a6d640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.454+0000 7f2542a6f640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 0x7f253c134450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f254226e640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f253c09c4c0 0x7f253c1cb1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f253800e850 tx=0x7f253800ed10 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 client.?.objecter ms_handle_connect 0x7f253c09c4c0 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f25380095b0 con 0x7f253c09c4c0 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: dump: 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:11.465 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.466 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 5 monclient: authenticate success, global_id 4165 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800cdb0 con 0x7f253c09c4c0 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 10 monclient: _renew_subs 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c1230b0 con 0x7f253c09c4c0 2024-03-27T21:30:11.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f25380138e0 con 0x7f253c09c4c0 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2540a6b640 4 set_mon_vals no callback set 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 10 client.4165.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 monclient: dump: 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:11.468 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 10 monclient: _renew_subs 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c09ef40 con 0x7f253c09c4c0 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f25444d2640 1 librados: init done 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f253800c940 con 0x7f253c09c4c0 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f253800cbf0 con 0x7f253c09c4c0 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 10 client.4165.objecter ms_dispatch 0x7f253c000b90 osd_map(8..8 src has 1..8) v4 2024-03-27T21:30:11.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 3 client.4165.objecter handle_osd_map got epochs [8,8] > 0 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 3 client.4165.objecter handle_osd_map decoding full epoch 8 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.455+0000 7f2532ffd640 20 client.4165.objecter dump_active .. 0 homeless 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.456+0000 7f25444d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.456+0000 7f25444d2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.456+0000 7f25444d2640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.456+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c06a960 con 0x7f253c09c4c0 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.460+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f2538017070 con 0x7f253c09c4c0 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.460+0000 7f2532ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:11.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.460+0000 7f2532ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:11.471 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.474+0000 7faf7b00e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.521+0000 7f25444d2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.521+0000 7f25444d2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.521+0000 7f25444d2640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.521+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f253c074b30 con 0x7f253c09c4c0 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f2532ffd640 1 -- 172.21.15.28:0/2827489296 <== mon.7 v2:172.21.15.63:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+5604 (secure 0 0 0) 0x7f2538029090 con 0x7f253c09c4c0 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f2532ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:11.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f2532ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:11.512 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:11.512 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:11.304411+0000","last_up_change":"0.000000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:30:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 10 librados: watch_flush enter 2024-03-27T21:30:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 10 librados: watch_flush exit 2024-03-27T21:30:11.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 20 client.4165.objecter shutdown clearing up homeless session... 2024-03-27T21:30:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 10 client.4165.objecter successfully canceled tick 2024-03-27T21:30:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 10 monclient: shutdown 2024-03-27T21:30:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f253c09c4c0 msgr2=0x7f253c1cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f253c09c4c0 0x7f253c1cb1d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f253800e850 tx=0x7f253800ed10 comp rx=0 tx=0).stop 2024-03-27T21:30:11.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 shutdown_connections 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f253c0a22c0 0x7f253c134450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f253c0a1940 0x7f253c133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 --2- 172.21.15.28:0/2827489296 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f253c09c4c0 0x7f253c1cb1d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 >> 172.21.15.28:0/2827489296 conn(0x7f253c0a65f0 msgr2=0x7f253c0661a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 shutdown_connections 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 -- 172.21.15.28:0/2827489296 wait complete. 2024-03-27T21:30:11.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:11.522+0000 7f25444d2640 1 librados: shutdown 2024-03-27T21:30:11.517 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.528+0000 7faf7b00e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T21:30:11.521 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-27T21:30:11.521 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-27T21:30:11.565 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.576+0000 7faf7b00e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T21:30:11.622 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.633+0000 7faf7b00e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T21:30:11.666 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.677+0000 7faf7b00e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T21:30:11.786 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.797+0000 7faf7b00e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T21:30:11.858 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.870+0000 7faf7b00e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T21:30:11.906 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.917+0000 7faf7b00e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T21:30:11.913 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:11.924+0000 7fec0bab5640 -1 Falling back to public interface 2024-03-27T21:30:11.913 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-03-27T21:30:11.924+0000 7fa33b7bd640 -1 Falling back to public interface 2024-03-27T21:30:11.914 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:11.924+0000 7fec0aa5e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-03-27T21:30:11.914 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:11.924+0000 7fec0aa5e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-03-27T21:30:11.914 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:11.925+0000 7fec0aa5e640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6804/0: (98) Address already in use 2024-03-27T21:30:11.916 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-03-27T21:30:11.927+0000 7f21b05fd640 -1 Falling back to public interface 2024-03-27T21:30:11.916 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-27T21:30:11.927+0000 7f6005f8c640 -1 Falling back to public interface 2024-03-27T21:30:11.916 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-03-27T21:30:11.927+0000 7f21af5a6640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-03-27T21:30:11.918 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-03-27T21:30:11.929+0000 7f9d5a014640 -1 Falling back to public interface 2024-03-27T21:30:11.922 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-03-27T21:30:11.933+0000 7f0bb7a0d640 -1 Falling back to public interface 2024-03-27T21:30:11.962 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:11.973+0000 7faf7b00e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T21:30:12.010 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.021+0000 7faf7b00e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T21:30:12.125 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.229+0000 7f68013ec640 10 monclient: get_monmap_and_config 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.229+0000 7f68013ec640 10 monclient: build_initial_monmap 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.230+0000 7f68013ec640 10 monclient: monmap: 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:epoch 0 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:30:12.230740+0000 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:30:12.230740+0000 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:12.219 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.230+0000 7f68013ec640 1 Processor -- start 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.230+0000 7f68013ec640 1 -- start start 2024-03-27T21:30:12.220 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.230+0000 7f68013ec640 10 monclient: init 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.230+0000 7f68013ec640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient: _add_conns ranks=[2,8,10,1,7,4,3,9,5,6,0] 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f67fc1340a0 0x7f67fc134480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): picked mon.noname-b con 0x7f67fc1340a0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc0a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): picked mon.noname-e con 0x7f67fc1339b0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:12.228 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f67fc0a1f60 0x7f67fc0a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): picked mon.noname-f con 0x7f67fc0a1f60 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc09f9e0 con 0x7f67fc0a1f60 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc06baf0 con 0x7f67fc1340a0 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc09e0e0 con 0x7f67fc1339b0 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f68013ec640 10 monclient(hunting): authenticate will time out at 834.537820s 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc0a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f67fc1340a0 0x7f67fc134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc0a1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:50974/0 (socket says 172.21.15.28:50974) 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 -- 172.21.15.28:0/1840043168 learned_addr learned my addr 172.21.15.28:0/1840043168 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:12.229 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): get_auth_request con 0x7f67fc1339b0 auth_method 0 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): get_auth_request con 0x7f67fc1340a0 auth_method 0 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fb7fe640 1 --2- 172.21.15.28:0/1840043168 >> v2:172.21.15.63:3300/0 conn(0x7f67fc0a1f60 0x7f67fc0a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:12.230 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fb7fe640 10 monclient(hunting): get_auth_request con 0x7f67fc0a1f60 auth_method 0 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_done global_id 4139 payload 274 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 -- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f67fc1340a0 msgr2=0x7f67fc134480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 --2- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f67fc1340a0 0x7f67fc134480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 -- 172.21.15.28:0/1840043168 >> v2:172.21.15.63:3300/0 conn(0x7f67fc0a1f60 msgr2=0x7f67fc0a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 --2- 172.21.15.28:0/1840043168 >> v2:172.21.15.63:3300/0 conn(0x7f67fc0a1f60 0x7f67fc0a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 monclient: found mon.noname-e 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fa7fc640 1 -- 172.21.15.28:0/1840043168 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0618f0 con 0x7f67fc1339b0 2024-03-27T21:30:12.231 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.231+0000 7f67fb7fe640 1 --2- 172.21.15.28:0/1840043168 >> v2:172.21.15.63:3300/0 conn(0x7f67fc0a1f60 0x7f67fc0a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67fa7fc640 1 --2- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc0a1a20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009870 tx=0x7f67e402b7c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5b3cbb0cf3471cf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 1 -- 172.21.15.28:0/1840043168 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f67e4031990 con 0x7f67fc1339b0 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: dump: 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:12.232 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 1 -- 172.21.15.28:0/1840043168 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4031b10 con 0x7f67fc1339b0 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 5 monclient: authenticate success, global_id 4139 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:12.233 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 1 -- 172.21.15.28:0/1840043168 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f67e4031cc0 con 0x7f67fc1339b0 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 4 set_mon_vals no callback set 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f67f9ffb640 10 monclient: dump: 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:12.234 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 10 monclient: shutdown 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 1 -- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 msgr2=0x7f67fc0a1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.232+0000 7f68013ec640 1 --2- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc0a1a20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009870 tx=0x7f67e402b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 -- 172.21.15.28:0/1840043168 shutdown_connections 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 --2- 172.21.15.28:0/1840043168 >> v2:172.21.15.63:3300/0 conn(0x7f67fc0a1f60 0x7f67fc0a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 --2- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc0a1a20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 --2- 172.21.15.28:0/1840043168 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f67fc1340a0 0x7f67fc134480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 -- 172.21.15.28:0/1840043168 >> 172.21.15.28:0/1840043168 conn(0x7f67fc0a3390 msgr2=0x7f67fc06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:12.235 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 -- 172.21.15.28:0/1840043168 shutdown_connections 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 -- 172.21.15.28:0/1840043168 wait complete. 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 10 monclient: build_initial_monmap 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 10 monclient: monmap: 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:epoch 0 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:created 0.000000 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:12.236 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 librados: starting msgr at 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.233+0000 7f68013ec640 1 librados: starting objecter 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 Processor -- start 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 -- start start 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 librados: setting wanted keys 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 librados: calling monclient init 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient: init 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient: _add_conns ranks=[3,8,5,7,2,4,1,0,6] 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f67fc0a1f60 0x7f67fc132c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:12.237 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): picked mon.noname-g con 0x7f67fc0a1f60 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc133180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): picked mon.noname-e con 0x7f67fc1339b0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f67fc1340a0 0x7f67fc1c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): picked mon.noname-h con 0x7f67fc1340a0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc06a490 con 0x7f67fc0a1f60 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc120910 con 0x7f67fc1340a0 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc120e20 con 0x7f67fc1339b0 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f68013ec640 10 monclient(hunting): authenticate will time out at 834.541421s 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc133180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc133180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:50976/0 (socket says 172.21.15.28:50976) 2024-03-27T21:30:12.238 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 1 -- 172.21.15.28:0/592228147 learned_addr learned my addr 172.21.15.28:0/592228147 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): get_auth_request con 0x7f67fc1339b0 auth_method 0 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f67fc0a1f60 0x7f67fc132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fb7fe640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f67fc1340a0 0x7f67fc1c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 10 monclient(hunting): get_auth_request con 0x7f67fc0a1f60 auth_method 0 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fb7fe640 10 monclient(hunting): get_auth_request con 0x7f67fc1340a0 auth_method 0 2024-03-27T21:30:12.239 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.234+0000 7f67faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 10 monclient(hunting): handle_auth_done global_id 4148 payload 824 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 -- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f67fc1340a0 msgr2=0x7f67fc1c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f67fc1340a0 0x7f67fc1c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 -- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f67fc0a1f60 msgr2=0x7f67fc132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f67fc0a1f60 0x7f67fc132c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 monclient: found mon.noname-e 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 -- 172.21.15.28:0/592228147 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40094d0 con 0x7f67fc1339b0 2024-03-27T21:30:12.240 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fb7fe640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f67fc1340a0 0x7f67fc1c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67fa7fc640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc133180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67e40090b0 tx=0x7f67e40046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 client.?.objecter ms_handle_connect 0x7f67fc1339b0 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f67e4031950 con 0x7f67fc1339b0 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: dump: 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:12.241 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e4003a80 con 0x7f67fc1339b0 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 5 monclient: authenticate success, global_id 4148 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 10 monclient: _renew_subs 2024-03-27T21:30:12.242 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67fc0a0570 con 0x7f67fc1339b0 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f67e4003bf0 con 0x7f67fc1339b0 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 monclient: dump: 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:12.243 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f97fa640 4 set_mon_vals no callback set 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 10 client.4148.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 10 monclient: _renew_subs 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc121100 con 0x7f67fc1339b0 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f68013ec640 1 librados: init done 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67e403a040 con 0x7f67fc1339b0 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f67e403ea10 con 0x7f67fc1339b0 2024-03-27T21:30:12.244 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 10 client.4148.objecter ms_dispatch 0x7f67fc000b90 osd_map(8..8 src has 1..8) v4 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 3 client.4148.objecter handle_osd_map got epochs [8,8] > 0 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 3 client.4148.objecter handle_osd_map decoding full epoch 8 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.235+0000 7f67f37fe640 20 client.4148.objecter dump_active .. 0 homeless 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.236+0000 7f68013ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.236+0000 7f68013ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.236+0000 7f68013ec640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.236+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc060d80 con 0x7f67fc1339b0 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.238+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f67e4066b50 con 0x7f67fc1339b0 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.238+0000 7f67f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:12.245 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.238+0000 7f67f37fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:12.287 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f68013ec640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:12.288 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f68013ec640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:12.288 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f68013ec640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:12.288 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67fc09cf70 con 0x7f67fc1339b0 2024-03-27T21:30:12.288 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f67f37fe640 1 -- 172.21.15.28:0/592228147 <== mon.8 v2:172.21.15.28:3304/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+5604 (secure 0 0 0) 0x7f67e4055070 con 0x7f67fc1339b0 2024-03-27T21:30:12.288 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f67f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:12.288 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.299+0000 7f67f37fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:12.289 INFO:teuthology.misc.health.smithi028.stdout: 2024-03-27T21:30:12.289 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":8,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:11.304411+0000","last_up_change":"0.000000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:30:12.290 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 10 librados: watch_flush enter 2024-03-27T21:30:12.290 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 10 librados: watch_flush exit 2024-03-27T21:30:12.290 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 20 client.4148.objecter shutdown clearing up homeless session... 2024-03-27T21:30:12.290 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 10 client.4148.objecter successfully canceled tick 2024-03-27T21:30:12.290 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 10 monclient: shutdown 2024-03-27T21:30:12.290 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 msgr2=0x7f67fc133180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc133180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67e40090b0 tx=0x7f67e40046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 shutdown_connections 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f67fc1340a0 0x7f67fc1c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f67fc1339b0 0x7f67fc133180 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 --2- 172.21.15.28:0/592228147 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f67fc0a1f60 0x7f67fc132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 >> 172.21.15.28:0/592228147 conn(0x7f67fc0a3390 msgr2=0x7f67fc0a5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 shutdown_connections 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 -- 172.21.15.28:0/592228147 wait complete. 2024-03-27T21:30:12.291 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:12.300+0000 7f68013ec640 1 librados: shutdown 2024-03-27T21:30:12.298 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-03-27T21:30:12.406 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.417+0000 7faf7b00e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T21:30:12.547 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.558+0000 7faf7b00e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T21:30:12.688 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.699+0000 7faf7b00e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T21:30:12.735 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.746+0000 7faf7b00e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T21:30:12.851 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.862+0000 7faf7b00e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T21:30:12.949 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:12.960+0000 7faf7b00e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T21:30:13.109 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:13.120+0000 7faf7b00e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T21:30:13.152 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:13.163+0000 7faf7b00e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T21:30:13.313 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:13.324+0000 7faf7b00e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T21:30:14.140 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:14.151+0000 7faf7b00e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T21:30:14.427 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:14.439+0000 7faf7b00e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T21:30:14.480 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:14.492+0000 7faf7b00e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T21:30:14.601 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:14.612+0000 7faf7b00e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T21:30:15.361 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-27T21:30:15.372+0000 7f6005f8c640 -1 osd.0 0 log_to_monitors true 2024-03-27T21:30:15.375 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-03-27T21:30:15.386+0000 7fa33b7bd640 -1 osd.5 0 log_to_monitors true 2024-03-27T21:30:15.408 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-03-27T21:30:15.418+0000 7f0bb7a0d640 -1 osd.2 0 log_to_monitors true 2024-03-27T21:30:15.415 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:15.427+0000 7fec0bab5640 -1 osd.3 0 log_to_monitors true 2024-03-27T21:30:15.419 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-03-27T21:30:15.429+0000 7f21b05fd640 -1 osd.1 0 log_to_monitors true 2024-03-27T21:30:15.451 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-03-27T21:30:15.462+0000 7f9d5a014640 -1 osd.4 0 log_to_monitors true 2024-03-27T21:30:15.627 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.639+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.i 2024-03-27T21:30:15.628 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.639+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-03-27T21:30:15.632 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.643+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-03-27T21:30:15.632 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.643+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-03-27T21:30:15.632 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.643+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-27T21:30:15.633 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.643+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-27T21:30:15.633 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.644+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-03-27T21:30:15.633 INFO:tasks.ceph.mgr.x.smithi063.stderr:2024-03-27T21:30:15.644+0000 7faf1bb1d640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-03-27T21:30:16.711 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-03-27T21:30:16.720+0000 7f21ac58a640 -1 osd.1 0 waiting for initial osdmap 2024-03-27T21:30:16.712 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-27T21:30:16.722+0000 7f6001f19640 -1 osd.0 0 waiting for initial osdmap 2024-03-27T21:30:16.718 INFO:tasks.ceph.osd.1.smithi028.stderr:2024-03-27T21:30:16.728+0000 7f21a83b3640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T21:30:16.721 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-03-27T21:30:16.733+0000 7fa33774a640 -1 osd.5 0 waiting for initial osdmap 2024-03-27T21:30:16.727 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-27T21:30:16.738+0000 7f5ffdd42640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T21:30:16.752 INFO:tasks.ceph.osd.5.smithi063.stderr:2024-03-27T21:30:16.764+0000 7fa333573640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T21:30:17.488 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-03-27T21:30:17.498+0000 7f0bb348c640 -1 osd.2 0 waiting for initial osdmap 2024-03-27T21:30:17.499 INFO:tasks.ceph.osd.2.smithi028.stderr:2024-03-27T21:30:17.509+0000 7f0bab2ad640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T21:30:17.865 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-03-27T21:30:17.877+0000 7f9d559e2640 -1 osd.4 0 waiting for initial osdmap 2024-03-27T21:30:17.898 INFO:tasks.ceph.osd.4.smithi063.stderr:2024-03-27T21:30:17.910+0000 7f9d4d803640 -1 osd.4 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T21:30:18.406 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:18.418+0000 7fec07a42640 -1 osd.3 0 waiting for initial osdmap 2024-03-27T21:30:18.418 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-03-27T21:30:18.430+0000 7febff863640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T21:30:18.903 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.008+0000 7f5104d1b640 10 monclient: get_monmap_and_config 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.008+0000 7f5104d1b640 10 monclient: build_initial_monmap 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.008+0000 7f5104d1b640 10 monclient: monmap: 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:epoch 0 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:30:19.010575+0000 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:30:19.010575+0000 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:18.999 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.009+0000 7f5104d1b640 1 Processor -- start 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.009+0000 7f5104d1b640 1 -- start start 2024-03-27T21:30:19.000 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.009+0000 7f5104d1b640 10 monclient: init 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.009+0000 7f5104d1b640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.009+0000 7f5104d1b640 10 monclient: _add_conns ranks=[2,10,9,1,0,4,5,8,3,6,7] 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 0x7f51000a3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): picked mon.noname-b con 0x7f51000a4730 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f51000a4b10 0x7f5100136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): picked mon.noname-f con 0x7f51000a4b10 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 0x7f5100137230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): picked mon.noname-a con 0x7f51000a4f30 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510009f120 con 0x7f51000a4f30 2024-03-27T21:30:19.009 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000a0340 con 0x7f51000a4b10 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510009de50 con 0x7f51000a4730 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f5104d1b640 10 monclient(hunting): authenticate will time out at 841.317782s 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 0x7f51000a3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 0x7f5100137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 0x7f5100137230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34846/0 (socket says 172.21.15.28:34846) 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 0x7f51000a3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:34366/0 (socket says 172.21.15.28:34366) 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 1 -- 172.21.15.28:0/2499939413 learned_addr learned my addr 172.21.15.28:0/2499939413 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): get_auth_request con 0x7f51000a4f30 auth_method 0 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.010 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): get_auth_request con 0x7f51000a4730 auth_method 0 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.011 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fdd9b640 1 --2- 172.21.15.28:0/2499939413 >> v2:172.21.15.63:3300/0 conn(0x7f51000a4b10 0x7f5100136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fdd9b640 10 monclient(hunting): get_auth_request con 0x7f51000a4b10 auth_method 0 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fdd9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient(hunting): handle_auth_done global_id 4160 payload 274 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 -- 172.21.15.28:0/2499939413 >> v2:172.21.15.63:3300/0 conn(0x7f51000a4b10 msgr2=0x7f5100136cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 --2- 172.21.15.28:0/2499939413 >> v2:172.21.15.63:3300/0 conn(0x7f51000a4b10 0x7f5100136cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 -- 172.21.15.28:0/2499939413 >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 msgr2=0x7f5100137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 --2- 172.21.15.28:0/2499939413 >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 0x7f5100137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.012 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 monclient: found mon.noname-b 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fe59c640 1 -- 172.21.15.28:0/2499939413 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000618f0 con 0x7f51000a4730 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.010+0000 7f50fed9d640 1 --2- 172.21.15.28:0/2499939413 >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 0x7f5100137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fe59c640 1 --2- 172.21.15.28:0/2499939413 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 0x7f51000a3da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f510009f2a0 tx=0x7f50f802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30a8930bd3fa5aae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 1 -- 172.21.15.28:0/2499939413 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f50f8030980 con 0x7f51000a4730 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: dump: 2024-03-27T21:30:19.013 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.014 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: _finish_auth 0 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: _check_auth_tickets 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 1 -- 172.21.15.28:0/2499939413 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f802e050 con 0x7f51000a4730 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f5104d1b640 5 monclient: authenticate success, global_id 4160 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f5104d1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f5104d1b640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 1 -- 172.21.15.28:0/2499939413 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f50f80313a0 con 0x7f51000a4730 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f5104d1b640 4 set_mon_vals no callback set 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:19.015 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.011+0000 7f50fd59a640 10 monclient: dump: 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.016 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 10 monclient: shutdown 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 -- 172.21.15.28:0/2499939413 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 msgr2=0x7f51000a3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 --2- 172.21.15.28:0/2499939413 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 0x7f51000a3da0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f510009f2a0 tx=0x7f50f802b710 comp rx=0 tx=0).stop 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 -- 172.21.15.28:0/2499939413 shutdown_connections 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 --2- 172.21.15.28:0/2499939413 >> v2:172.21.15.28:3300/0 conn(0x7f51000a4f30 0x7f5100137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 --2- 172.21.15.28:0/2499939413 >> v2:172.21.15.63:3300/0 conn(0x7f51000a4b10 0x7f5100136cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 --2- 172.21.15.28:0/2499939413 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f51000a4730 0x7f51000a3da0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 -- 172.21.15.28:0/2499939413 >> 172.21.15.28:0/2499939413 conn(0x7f51000a9530 msgr2=0x7f51000a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 -- 172.21.15.28:0/2499939413 shutdown_connections 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 1 -- 172.21.15.28:0/2499939413 wait complete. 2024-03-27T21:30:19.017 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 10 monclient: build_initial_monmap 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.012+0000 7f5104d1b640 10 monclient: monmap: 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:epoch 0 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:created 0.000000 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:19.018 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 librados: starting msgr at 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 librados: starting objecter 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 Processor -- start 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 -- start start 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 librados: setting wanted keys 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 librados: calling monclient init 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient: init 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:19.019 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient: _add_conns ranks=[3,0,7,8,1,2,5,4,6] 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f51000a4730 0x7f51001cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): picked mon.noname-g con 0x7f51000a4730 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 0x7f5100136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): picked mon.noname-a con 0x7f51000a4b10 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f51000a4f30 0x7f5100137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): picked mon.noname-i con 0x7f51000a4f30 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100122ca0 con 0x7f51000a4b10 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510009e070 con 0x7f51000a4730 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.020 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f510009d040 con 0x7f51000a4f30 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f5104d1b640 10 monclient(hunting): authenticate will time out at 841.321424s 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 0x7f5100136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 0x7f5100136f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34856/0 (socket says 172.21.15.28:34856) 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 1 -- 172.21.15.28:0/3404680931 learned_addr learned my addr 172.21.15.28:0/3404680931 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): get_auth_request con 0x7f51000a4b10 auth_method 0 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.021 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fdd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.013+0000 7f50fe59c640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f51000a4730 0x7f51001cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fed9d640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f51000a4f30 0x7f5100137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fe59c640 10 monclient(hunting): get_auth_request con 0x7f51000a4730 auth_method 0 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fe59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fe59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fed9d640 10 monclient(hunting): get_auth_request con 0x7f51000a4f30 auth_method 0 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.022 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 10 monclient(hunting): handle_auth_done global_id 4257 payload 824 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 -- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f51000a4f30 msgr2=0x7f5100137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f51000a4f30 0x7f5100137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 -- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f51000a4730 msgr2=0x7f51001cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f51000a4730 0x7f51001cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 monclient: found mon.noname-a 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 -- 172.21.15.28:0/3404680931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0009b30 con 0x7f51000a4b10 2024-03-27T21:30:19.023 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fe59c640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f51000a4730 0x7f51001cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fdd9b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 0x7f5100136f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f50f400d7d0 tx=0x7f50f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 client.?.objecter ms_handle_connect 0x7f51000a4b10 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f50f4018070 con 0x7f51000a4b10 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: dump: 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.024 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:19.025 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f400bb30 con 0x7f51000a4b10 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 5 monclient: authenticate success, global_id 4257 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f50f400bca0 con 0x7f51000a4b10 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50fcd99640 4 set_mon_vals no callback set 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f50eeffd640 10 monclient: dump: 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:epoch 1 2024-03-27T21:30:19.026 INFO:teuthology.misc.health.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.027 INFO:teuthology.misc.health.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr: 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 10 monclient: _renew_subs 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f8009400 con 0x7f51000a4b10 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 10 client.4257.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 10 monclient: _renew_subs 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100123db0 con 0x7f51000a4b10 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.014+0000 7f5104d1b640 1 librados: init done 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 44753+0+0 (secure 0 0 0) 0x7f50f400b6c0 con 0x7f51000a4b10 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f5104d1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:19.028 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f5104d1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f5104d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f50e003a1c0 0x7f50e003c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510009d620 con 0x7f51000a4b10 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3982+0+0 (secure 0 0 0) 0x7f50f4049c90 con 0x7f51000a4b10 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 10 client.4257.objecter ms_dispatch 0x7f5100000b90 osd_map(12..12 src has 1..12) v4 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 3 client.4257.objecter handle_osd_map got epochs [12,12] > 0 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 3 client.4257.objecter handle_osd_map decoding full epoch 12 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50eeffd640 20 client.4257.objecter dump_active .. 0 homeless 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50fe59c640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f50e003a1c0 0x7f50e003c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.015+0000 7f50fe59c640 10 monclient: get_auth_request con 0x7f50e003a1c0 auth_method 0 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.016+0000 7f50eeffd640 10 client.4257.objecter ms_handle_connect 0x7f50e003a1c0 2024-03-27T21:30:19.029 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.016+0000 7f50fe59c640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f50e003a1c0 0x7f50e003c680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f50f8034000 tx=0x7f50f802f000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:19.030 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.020+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f50f400b970 con 0x7f51000a4b10 2024-03-27T21:30:19.030 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.020+0000 7f50eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:19.030 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.020+0000 7f50eeffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:19.188 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.198+0000 7f5104d1b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:19.188 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.198+0000 7f5104d1b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:19.188 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.198+0000 7f5104d1b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:19.188 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.198+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51000615e0 con 0x7f51000a4b10 2024-03-27T21:30:19.189 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.199+0000 7f50eeffd640 1 -- 172.21.15.28:0/3404680931 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+10013 (secure 0 0 0) 0x7f50f4013b80 con 0x7f51000a4b10 2024-03-27T21:30:19.189 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.199+0000 7f50eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:19.189 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.199+0000 7f50eeffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:19.189 INFO:teuthology.misc.health.smithi028.stdout: 2024-03-27T21:30:19.190 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":12,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:18.879901+0000","last_up_change":"2024-03-27T21:30:18.879901+0000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T21:30:18.680135+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6801","nonce":33278},{"type":"v1","addr":"172.21.15.28:6803","nonce":33278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6805","nonce":33278},{"type":"v1","addr":"172.21.15.28:6807","nonce":33278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":33278},{"type":"v1","addr":"172.21.15.28:6815","nonce":33278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":33278},{"type":"v1","addr":"172.21.15.28:6811","nonce":33278}]},"public_addr":"172.21.15.28:6803/33278","cluster_addr":"172.21.15.28:6807/33278","heartbeat_back_addr":"172.21.15.28:6815/33278","heartbeat_front_addr":"172.21.15.28:6811/33278","state":["exists","up"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":33279},{"type":"v1","addr":"172.21.15.28:6802","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":33279},{"type":"v1","addr":"172.21.15.28:6806","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":33279},{"type":"v1","addr":"172.21.15.28:6814","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":33279},{"type":"v1","addr":"172.21.15.28:6810","nonce":33279}]},"public_addr":"172.21.15.28:6802/33279","cluster_addr":"172.21.15.28:6806/33279","heartbeat_back_addr":"172.21.15.28:6814/33279","heartbeat_front_addr":"172.21.15.28:6810/33279","state":["exists","up"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":33280},{"type":"v1","addr":"172.21.15.28:6817","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":33280},{"type":"v1","addr":"172.21.15.28:6819","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":33280},{"type":"v1","addr":"172.21.15.28:6823","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":33280},{"type":"v1","addr":"172.21.15.28:6821","nonce":33280}]},"public_addr":"172.21.15.28:6817/33280","cluster_addr":"172.21.15.28:6819/33280","heartbeat_back_addr":"172.21.15.28:6823/33280","heartbeat_front_addr":"172.21.15.28:6821/33280","state":["exists","up"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33504},{"type":"v1","addr":"172.21.15.63:6805","nonce":33504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":33504},{"type":"v1","addr":"172.21.15.63:6810","nonce":33504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33504},{"type":"v1","addr":"172.21.15.63:6815","nonce":33504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33504},{"type":"v1","addr":"172.21.15.63:6813","nonce":33504}]},"public_addr":"172.21.15.63:6805/33504","cluster_addr":"172.21.15.63:6810/33504","heartbeat_back_addr":"172.21.15.63:6815/33504","heartbeat_front_addr":"172.21.15.63:6813/33504","state":["exists","up"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33505},{"type":"v1","addr":"172.21.15.63:6817","nonce":33505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33505},{"type":"v1","addr":"172.21.15.63:6819","nonce":33505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33505},{"type":"v1","addr":"172.21.15.63:6823","nonce":33505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33505},{"type":"v1","addr":"172.21.15.63:6821","nonce":33505}]},"public_addr":"172.21.15.63:6817/33505","cluster_addr":"172.21.15.63:6819/33505","heartbeat_back_addr":"172.21.15.63:6823/33505","heartbeat_front_addr":"172.21.15.63:6821/33505","state":["exists","up"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33506},{"type":"v1","addr":"172.21.15.63:6801","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":33506},{"type":"v1","addr":"172.21.15.63:6804","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":33506},{"type":"v1","addr":"172.21.15.63:6811","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33506},{"type":"v1","addr":"172.21.15.63:6808","nonce":33506}]},"public_addr":"172.21.15.63:6801/33506","cluster_addr":"172.21.15.63:6804/33506","heartbeat_back_addr":"172.21.15.63:6811/33506","heartbeat_front_addr":"172.21.15.63:6808/33506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.360569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.424079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.458359+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.398176+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:30:19.191 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 10 librados: watch_flush enter 2024-03-27T21:30:19.191 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 10 librados: watch_flush exit 2024-03-27T21:30:19.191 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 20 client.4257.objecter shutdown clearing up homeless session... 2024-03-27T21:30:19.191 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 10 client.4257.objecter successfully canceled tick 2024-03-27T21:30:19.191 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f50e003a1c0 msgr2=0x7f50e003c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.191 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f50e003a1c0 0x7f50e003c680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f50f8034000 tx=0x7f50f802f000 comp rx=0 tx=0).stop 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 10 monclient: shutdown 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 msgr2=0x7f5100136f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 0x7f5100136f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f50f400d7d0 tx=0x7f50f400dc90 comp rx=0 tx=0).stop 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 shutdown_connections 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f50e003a1c0 0x7f50e003c680 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f51000a4f30 0x7f5100137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f51000a4b10 0x7f5100136f50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 --2- 172.21.15.28:0/3404680931 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f51000a4730 0x7f51001cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 >> 172.21.15.28:0/3404680931 conn(0x7f51000a9530 msgr2=0x7f51000a16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 shutdown_connections 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 -- 172.21.15.28:0/3404680931 wait complete. 2024-03-27T21:30:19.192 INFO:teuthology.misc.health.smithi028.stderr:2024-03-27T21:30:19.201+0000 7f5104d1b640 1 librados: shutdown 2024-03-27T21:30:19.200 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-03-27T21:30:19.200 INFO:tasks.ceph:Creating RBD pool 2024-03-27T21:30:19.200 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.311+0000 7f9f15621640 10 monclient: get_monmap_and_config 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.311+0000 7f9f15621640 10 monclient: build_initial_monmap 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.311+0000 7f9f15621640 10 monclient: monmap: 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:19.313099+0000 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:19.313099+0000 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.301 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:19.302 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.311+0000 7f9f15621640 1 Processor -- start 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.311+0000 7f9f15621640 1 -- start start 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.311+0000 7f9f15621640 10 monclient: init 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient: _add_conns ranks=[1,7,4,6,0,10,8,3,9,5,2] 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f9f10136c90 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f100a3ce0 0x7f9f1013c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): picked mon.noname-i con 0x7f9f100a3ce0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 0x7f9f1013e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): picked mon.noname-c con 0x7f9f1009fe20 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f100618f0 con 0x7f9f10136c90 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100a0cf0 con 0x7f9f1009fe20 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100a2790 con 0x7f9f100a3ce0 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f15621640 10 monclient(hunting): authenticate will time out at 841.620111s 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 0x7f9f1013e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 0x7f9f1013e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:54298/0 (socket says 172.21.15.28:54298) 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 -- 172.21.15.28:0/2747464891 learned_addr learned my addr 172.21.15.28:0/2747464891 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): get_auth_request con 0x7f9f1009fe20 auth_method 0 2024-03-27T21:30:19.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 1 --2- 172.21.15.28:0/2747464891 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f100a3ce0 0x7f9f1013c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): get_auth_request con 0x7f9f100a3ce0 auth_method 0 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_done global_id 4189 payload 274 2024-03-27T21:30:19.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 -- 172.21.15.28:0/2747464891 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f100a3ce0 msgr2=0x7f9f1013c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 --2- 172.21.15.28:0/2747464891 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f100a3ce0 0x7f9f1013c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 -- 172.21.15.28:0/2747464891 >> v1:172.21.15.63:6789/0 conn(0x7f9f10136c90 legacy=0x7f9f10137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 monclient: found mon.noname-c 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0dffb640 1 -- 172.21.15.28:0/2747464891 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261492065 0 0) 0x7f9f100618f0 con 0x7f9f10136c90 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0f7fe640 1 -- 172.21.15.28:0/2747464891 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100a24b0 con 0x7f9f1009fe20 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.312+0000 7f9f0dffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0f7fe640 1 --2- 172.21.15.28:0/2747464891 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 0x7f9f1013e710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f080098d0 tx=0x7f9f0802b8d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4d2affa24f3f623a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 1 -- 172.21.15.28:0/2747464891 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9f08031aa0 con 0x7f9f1009fe20 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:19.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: dump: 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.315 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f15621640 5 monclient: authenticate success, global_id 4189 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 1 -- 172.21.15.28:0/2747464891 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08031c20 con 0x7f9f1009fe20 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f15621640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f15621640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 1 -- 172.21.15.28:0/2747464891 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9f08031d90 con 0x7f9f1009fe20 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f15621640 4 set_mon_vals no callback set 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.313+0000 7f9f0dffb640 10 monclient: dump: 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:19.316 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:19.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 10 monclient: shutdown 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 -- 172.21.15.28:0/2747464891 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 msgr2=0x7f9f1013e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 --2- 172.21.15.28:0/2747464891 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 0x7f9f1013e710 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9f080098d0 tx=0x7f9f0802b8d0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 -- 172.21.15.28:0/2747464891 shutdown_connections 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 --2- 172.21.15.28:0/2747464891 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f9f1009fe20 0x7f9f1013e710 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 --2- 172.21.15.28:0/2747464891 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f100a3ce0 0x7f9f1013c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 -- 172.21.15.28:0/2747464891 >> 172.21.15.28:0/2747464891 conn(0x7f9f100a9430 msgr2=0x7f9f100a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 -- 172.21.15.28:0/2747464891 shutdown_connections 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 1 -- 172.21.15.28:0/2747464891 wait complete. 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 10 monclient: build_initial_monmap 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.314+0000 7f9f15621640 10 monclient: monmap: 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:19.318 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 librados: starting msgr at 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 librados: starting objecter 2024-03-27T21:30:19.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 Processor -- start 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 -- start start 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 librados: setting wanted keys 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 librados: calling monclient init 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient: init 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient: _add_conns ranks=[1,2,7,8,5,3,6,0,4] 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f1009fe20 0x7f9f101cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): picked mon.noname-f con 0x7f9f1009fe20 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 0x7f9f10131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): picked mon.noname-b con 0x7f9f100a3ce0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f10136c90 0x7f9f101c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): picked mon.noname-i con 0x7f9f10136c90 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100a1530 con 0x7f9f1009fe20 2024-03-27T21:30:19.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f100a1170 con 0x7f9f100a3ce0 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1009f5b0 con 0x7f9f10136c90 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.315+0000 7f9f15621640 10 monclient(hunting): authenticate will time out at 841.623655s 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 0x7f9f10131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 0x7f9f10131ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:34372/0 (socket says 172.21.15.28:34372) 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 -- 172.21.15.28:0/3495123322 learned_addr learned my addr 172.21.15.28:0/3495123322 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): get_auth_request con 0x7f9f100a3ce0 auth_method 0 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f1009fe20 0x7f9f101cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f10136c90 0x7f9f101c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): get_auth_request con 0x7f9f10136c90 auth_method 0 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): get_auth_request con 0x7f9f1009fe20 auth_method 0 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient(hunting): handle_auth_done global_id 4169 payload 824 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 -- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f10136c90 msgr2=0x7f9f101c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f10136c90 0x7f9f101c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 -- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f1009fe20 msgr2=0x7f9f101cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f1009fe20 0x7f9f101cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 monclient: found mon.noname-b 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 -- 172.21.15.28:0/3495123322 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f080094d0 con 0x7f9f100a3ce0 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0e7fc640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 0x7f9f10131ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800e8d0 tx=0x7f9ef800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 client.?.objecter ms_handle_connect 0x7f9f100a3ce0 2024-03-27T21:30:19.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9ef8009630 con 0x7f9f100a3ce0 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: dump: 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.324 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 5 monclient: authenticate success, global_id 4169 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800cdb0 con 0x7f9f100a3ce0 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 10 monclient: _renew_subs 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1009daf0 con 0x7f9f100a3ce0 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:19.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9ef80138e0 con 0x7f9f100a3ce0 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f0d7fa640 4 set_mon_vals no callback set 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 10 client.4169.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f077fe640 10 monclient: dump: 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:19.326 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 10 monclient: _renew_subs 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1009e430 con 0x7f9f100a3ce0 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.316+0000 7f9f15621640 1 librados: init done 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 4) v1 ==== 44753+0+0 (secure 0 0 0) 0x7f9ef8013470 con 0x7f9f100a3ce0 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9ef003a1c0 0x7f9ef003c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f15621640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:19.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f15621640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f15621640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f10137070 con 0x7f9f100a3ce0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3982+0+0 (secure 0 0 0) 0x7f9ef804a140 con 0x7f9f100a3ce0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 10 client.4169.objecter ms_dispatch 0x7f9f10000b90 osd_map(12..12 src has 1..12) v4 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 3 client.4169.objecter handle_osd_map got epochs [12,12] > 0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 3 client.4169.objecter handle_osd_map decoding full epoch 12 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f077fe640 20 client.4169.objecter dump_active .. 0 homeless 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f0effd640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9ef003a1c0 0x7f9ef003c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.317+0000 7f9f0effd640 10 monclient: get_auth_request con 0x7f9ef003a1c0 auth_method 0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.318+0000 7f9f077fe640 10 client.4169.objecter ms_handle_connect 0x7f9ef003a1c0 2024-03-27T21:30:19.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.318+0000 7f9f0effd640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9ef003a1c0 0x7f9ef003c680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f000012e0 tx=0x7f9f00009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:19.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.322+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9ef8017020 con 0x7f9f100a3ce0 2024-03-27T21:30:19.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.322+0000 7f9f077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:19.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.322+0000 7f9f077fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.505+0000 7f9f15621640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-03-27T21:30:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.505+0000 7f9f15621640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-03-27T21:30:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.505+0000 7f9f15621640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:19.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.505+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9f10074b30 con 0x7f9f100a3ce0 2024-03-27T21:30:19.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.886+0000 7f9f077fe640 1 -- 172.21.15.28:0/3495123322 <== mon.2 v2:172.21.15.28:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9ef80232f0 con 0x7f9f100a3ce0 2024-03-27T21:30:19.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.886+0000 7f9f077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-03-27T21:30:19.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.886+0000 7f9f077fe640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-03-27T21:30:19.876 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'rbd' created 2024-03-27T21:30:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 10 librados: watch_flush enter 2024-03-27T21:30:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 10 librados: watch_flush exit 2024-03-27T21:30:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 20 client.4169.objecter shutdown clearing up homeless session... 2024-03-27T21:30:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 10 client.4169.objecter successfully canceled tick 2024-03-27T21:30:19.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9ef003a1c0 msgr2=0x7f9ef003c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9ef003a1c0 0x7f9ef003c680 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9f000012e0 tx=0x7f9f00009040 comp rx=0 tx=0).stop 2024-03-27T21:30:19.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 10 monclient: shutdown 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 msgr2=0x7f9f10131ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.889+0000 7f9f15621640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 0x7f9f10131ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800e8d0 tx=0x7f9ef800ed90 comp rx=0 tx=0).stop 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 shutdown_connections 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9ef003a1c0 0x7f9ef003c680 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f9f10136c90 0x7f9f101c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f9f100a3ce0 0x7f9f10131ff0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 --2- 172.21.15.28:0/3495123322 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9f1009fe20 0x7f9f101cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 >> 172.21.15.28:0/3495123322 conn(0x7f9f100a9430 msgr2=0x7f9f100a9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 shutdown_connections 2024-03-27T21:30:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 -- 172.21.15.28:0/3495123322 wait complete. 2024-03-27T21:30:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:19.890+0000 7f9f15621640 1 librados: shutdown 2024-03-27T21:30:19.892 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-27T21:30:20.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.015+0000 7f9d16731640 10 monclient: get_monmap_and_config 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.015+0000 7f9d16731640 10 monclient: build_initial_monmap 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.015+0000 7f9d16731640 10 monclient: monmap: 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:20.016838+0000 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:20.016838+0000 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:20.005 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:20.006 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:20.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.015+0000 7f9d16731640 1 Processor -- start 2024-03-27T21:30:20.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.015+0000 7f9d16731640 1 -- start start 2024-03-27T21:30:20.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.015+0000 7f9d16731640 10 monclient: init 2024-03-27T21:30:20.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient: _add_conns ranks=[3,8,1,2,4,9,0,7,5,6,10] 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9d1009fee0 0x7f9d1009f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): picked mon.noname-g con 0x7f9d1009fee0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 0x7f9d100a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): picked mon.noname-e con 0x7f9d100a1940 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f9d100a22a0 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d100618f0 con 0x7f9d100a22a0 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1009ea00 con 0x7f9d1009fee0 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1006ab30 con 0x7f9d100a1940 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d16731640 10 monclient(hunting): authenticate will time out at 842.324125s 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 0x7f9d100a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 0x7f9d100a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:50996/0 (socket says 172.21.15.28:50996) 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 -- 172.21.15.28:0/2747902730 learned_addr learned my addr 172.21.15.28:0/2747902730 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): get_auth_request con 0x7f9d100a1940 auth_method 0 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0ffff640 1 --2- 172.21.15.28:0/2747902730 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9d1009fee0 0x7f9d1009f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0ffff640 10 monclient(hunting): get_auth_request con 0x7f9d1009fee0 auth_method 0 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient(hunting): handle_auth_done global_id 4175 payload 274 2024-03-27T21:30:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 -- 172.21.15.28:0/2747902730 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9d1009fee0 msgr2=0x7f9d1009f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 --2- 172.21.15.28:0/2747902730 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9d1009fee0 0x7f9d1009f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 -- 172.21.15.28:0/2747902730 >> v1:172.21.15.63:6789/0 conn(0x7f9d100a22a0 legacy=0x7f9d1013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 monclient: found mon.noname-e 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.016+0000 7f9d0f7fe640 1 -- 172.21.15.28:0/2747902730 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100a2720 con 0x7f9d100a1940 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0f7fe640 1 --2- 172.21.15.28:0/2747902730 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 0x7f9d100a1d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d040098a0 tx=0x7f9d0402b840 comp rx=0 tx=0).ready entity=mon.8 client_cookie=e3efc49694eb92f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 1 -- 172.21.15.28:0/2747902730 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9d0402e070 con 0x7f9d100a1940 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: dump: 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:20.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: _finish_auth 0 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 1 -- 172.21.15.28:0/2747902730 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d04031a10 con 0x7f9d100a1940 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d16731640 5 monclient: authenticate success, global_id 4175 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d16731640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d16731640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 1 -- 172.21.15.28:0/2747902730 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9d04031c00 con 0x7f9d100a1940 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d16731640 4 set_mon_vals no callback set 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.017+0000 7f9d0effd640 10 monclient: dump: 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:20.019 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 10 monclient: shutdown 2024-03-27T21:30:20.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 -- 172.21.15.28:0/2747902730 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 msgr2=0x7f9d100a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 --2- 172.21.15.28:0/2747902730 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 0x7f9d100a1d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d040098a0 tx=0x7f9d0402b840 comp rx=0 tx=0).stop 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 -- 172.21.15.28:0/2747902730 shutdown_connections 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 --2- 172.21.15.28:0/2747902730 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f9d100a1940 0x7f9d100a1d60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 --2- 172.21.15.28:0/2747902730 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f9d1009fee0 0x7f9d1009f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 -- 172.21.15.28:0/2747902730 >> 172.21.15.28:0/2747902730 conn(0x7f9d100a65f0 msgr2=0x7f9d100a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 -- 172.21.15.28:0/2747902730 shutdown_connections 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.018+0000 7f9d16731640 1 -- 172.21.15.28:0/2747902730 wait complete. 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 10 monclient: build_initial_monmap 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 10 monclient: monmap: 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:20.021 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 1 librados: starting msgr at 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 1 librados: starting objecter 2024-03-27T21:30:20.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 1 Processor -- start 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 1 -- start start 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 1 librados: setting wanted keys 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 1 librados: calling monclient init 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.019+0000 7f9d16731640 10 monclient: init 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient: _add_conns ranks=[0,5,1,4,3,6,7,8,2] 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 0x7f9d101cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): picked mon.noname-a con 0x7f9d1009fee0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f9d100a1940 0x7f9d101bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): picked mon.noname-h con 0x7f9d100a1940 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d100a22a0 0x7f9d101bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): picked mon.noname-f con 0x7f9d100a22a0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d101bc710 con 0x7f9d1009fee0 2024-03-27T21:30:20.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1009d4c0 con 0x7f9d100a22a0 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d10071600 con 0x7f9d100a1940 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d16731640 10 monclient(hunting): authenticate will time out at 842.328208s 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 0x7f9d101cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 0x7f9d101cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34858/0 (socket says 172.21.15.28:34858) 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 -- 172.21.15.28:0/4291265854 learned_addr learned my addr 172.21.15.28:0/4291265854 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): get_auth_request con 0x7f9d1009fee0 auth_method 0 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:20.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0f7fe640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f9d100a1940 0x7f9d101bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d14cce640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d100a22a0 0x7f9d101bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient(hunting): handle_auth_done global_id 4266 payload 824 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 -- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f9d100a1940 msgr2=0x7f9d101bbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f9d100a1940 0x7f9d101bbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 -- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d100a22a0 msgr2=0x7f9d101bc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d100a22a0 0x7f9d101bc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 monclient: found mon.noname-a 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0ffff640 1 -- 172.21.15.28:0/4291265854 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040094d0 con 0x7f9d1009fee0 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d14cce640 10 monclient: get_auth_request con 0x7f9d100a22a0 auth_method 0 2024-03-27T21:30:20.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d14cce640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d100a22a0 0x7f9d101bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0f7fe640 10 monclient: get_auth_request con 0x7f9d100a1940 auth_method 0 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.020+0000 7f9d0f7fe640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f9d100a1940 0x7f9d101bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0ffff640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 0x7f9d101cb600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000d860 tx=0x7f9d0000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 client.?.objecter ms_handle_connect 0x7f9d1009fee0 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9d0000de50 con 0x7f9d1009fee0 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: dump: 2024-03-27T21:30:20.026 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:20.027 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 5 monclient: authenticate success, global_id 4266 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0000bd40 con 0x7f9d1009fee0 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 10 monclient: _renew_subs 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d101a8e60 con 0x7f9d1009fee0 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9d0000beb0 con 0x7f9d1009fee0 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0e7fc640 4 set_mon_vals no callback set 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d0cff9640 10 monclient: dump: 2024-03-27T21:30:20.028 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:20.029 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 10 client.4266.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 10 monclient: _renew_subs 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d101a7c20 con 0x7f9d1009fee0 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.021+0000 7f9d16731640 1 librados: init done 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d16731640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d16731640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 44753+0+0 (secure 0 0 0) 0x7f9d0000b8d0 con 0x7f9d1009fee0 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d16731640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d10074b30 con 0x7f9d1009fee0 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9cfc03a1e0 0x7f9cfc03c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4335+0+0 (secure 0 0 0) 0x7f9d00049ff0 con 0x7f9d1009fee0 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 10 client.4266.objecter ms_dispatch 0x7f9d10000b90 osd_map(13..13 src has 1..13) v4 2024-03-27T21:30:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 3 client.4266.objecter handle_osd_map got epochs [13,13] > 0 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 3 client.4266.objecter handle_osd_map decoding full epoch 13 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 20 client.4266.objecter dump_active .. 0 homeless 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0f7fe640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9cfc03a1e0 0x7f9cfc03c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0f7fe640 10 monclient: get_auth_request con 0x7f9cfc03a1e0 auth_method 0 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0cff9640 10 client.4266.objecter ms_handle_connect 0x7f9cfc03a1e0 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.022+0000 7f9d0f7fe640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9cfc03a1e0 0x7f9cfc03c6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d04036000 tx=0x7f9d04008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.026+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f9d0007d580 con 0x7f9d1009fee0 2024-03-27T21:30:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.026+0000 7f9d0cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.026+0000 7f9d0cff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.218+0000 7f9d16731640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-03-27T21:30:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.218+0000 7f9d16731640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-03-27T21:30:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.218+0000 7f9d16731640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.218+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9d1009cf00 con 0x7f9d1009fee0 2024-03-27T21:30:20.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.928+0000 7f9d0cff9640 1 -- 172.21.15.28:0/4291265854 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9d0000bb80 con 0x7f9d1009fee0 2024-03-27T21:30:20.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.928+0000 7f9d0cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-03-27T21:30:20.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.928+0000 7f9d0cff9640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2024-03-27T21:30:20.918 INFO:teuthology.orchestra.run.smithi028.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 10 librados: watch_flush enter 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 10 librados: watch_flush exit 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 20 client.4266.objecter shutdown clearing up homeless session... 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 10 client.4266.objecter successfully canceled tick 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9cfc03a1e0 msgr2=0x7f9cfc03c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9cfc03a1e0 0x7f9cfc03c6a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9d04036000 tx=0x7f9d04008030 comp rx=0 tx=0).stop 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 10 monclient: shutdown 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:20.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 msgr2=0x7f9d101cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 0x7f9d101cb600 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000d860 tx=0x7f9d0000dd20 comp rx=0 tx=0).stop 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.931+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 shutdown_connections 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.932+0000 7f9d16731640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f9cfc03a1e0 0x7f9cfc03c6a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.932+0000 7f9d16731640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f9d100a1940 0x7f9d101bbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.932+0000 7f9d16731640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d100a22a0 0x7f9d101bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.932+0000 7f9d16731640 1 --2- 172.21.15.28:0/4291265854 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9d1009fee0 0x7f9d101cb600 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:20.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.932+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 >> 172.21.15.28:0/4291265854 conn(0x7f9d100a65f0 msgr2=0x7f9d101bec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:20.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.933+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 shutdown_connections 2024-03-27T21:30:20.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.933+0000 7f9d16731640 1 -- 172.21.15.28:0/4291265854 wait complete. 2024-03-27T21:30:20.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:20.933+0000 7f9d16731640 1 librados: shutdown 2024-03-27T21:30:20.934 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-27T21:30:20.934 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-27T21:30:20.934 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-27T21:30:20.935 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-27T21:30:20.935 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-27T21:30:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.045+0000 7f10d999c640 10 monclient: get_monmap_and_config 2024-03-27T21:30:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.045+0000 7f10d999c640 10 monclient: build_initial_monmap 2024-03-27T21:30:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.045+0000 7f10d999c640 10 monclient: monmap: 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:21.047177+0000 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:21.047177+0000 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.045+0000 7f10d999c640 1 Processor -- start 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.045+0000 7f10d999c640 1 -- start start 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.045+0000 7f10d999c640 10 monclient: init 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient: _add_conns ranks=[9,8,0,2,3,7,10,5,4,1,6] 2024-03-27T21:30:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10d4136d00 0x7f10d41370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): picked mon.noname-a con 0x7f10d4136d00 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f10d40a3d70 0x7f10d4137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): picked mon.noname-e con 0x7f10d40a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f10d41339e0 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d40618f0 con 0x7f10d41339e0 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d40a25b0 con 0x7f10d4136d00 2024-03-27T21:30:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4137b60 con 0x7f10d40a3d70 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d999c640 10 monclient(hunting): authenticate will time out at 843.354181s 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10d4136d00 0x7f10d41370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f10d41339e0 0x7f10d4133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52912/0 (socket says 172.21.15.28:52912) 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d37fe640 1 -- 172.21.15.28:0/3481814903 learned_addr learned my addr 172.21.15.28:0/3481814903 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request con 0x7f10d4136d00 auth_method 0 2024-03-27T21:30:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f10d40a3d70 0x7f10d4137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): get_auth_request con 0x7f10d40a3d70 auth_method 0 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient(hunting): handle_auth_done global_id 4184 payload 274 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 1 -- 172.21.15.28:0/3481814903 >> v2:172.21.15.28:3300/0 conn(0x7f10d4136d00 msgr2=0x7f10d41370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 1 --2- 172.21.15.28:0/3481814903 >> v2:172.21.15.28:3300/0 conn(0x7f10d4136d00 0x7f10d41370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 1 -- 172.21.15.28:0/3481814903 >> v1:172.21.15.28:6789/0 conn(0x7f10d41339e0 legacy=0x7f10d4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 1 monclient: found mon.noname-e 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d1ffb640 1 -- 172.21.15.28:0/3481814903 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641032977 0 0) 0x7f10d40618f0 con 0x7f10d41339e0 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d27fc640 1 -- 172.21.15.28:0/3481814903 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d40a13f0 con 0x7f10d40a3d70 2024-03-27T21:30:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d2ffd640 1 --2- 172.21.15.28:0/3481814903 >> v2:172.21.15.28:3300/0 conn(0x7f10d4136d00 0x7f10d41370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.046+0000 7f10d1ffb640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d27fc640 1 --2- 172.21.15.28:0/3481814903 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f10d40a3d70 0x7f10d4137620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097a0 tx=0x7f10c402b7a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=aa836d088acb9a0d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 1 -- 172.21.15.28:0/3481814903 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f10c402f050 con 0x7f10d40a3d70 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: dump: 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d999c640 5 monclient: authenticate success, global_id 4184 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 1 -- 172.21.15.28:0/3481814903 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4031970 con 0x7f10d40a3d70 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d999c640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 1 -- 172.21.15.28:0/3481814903 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f10c4032390 con 0x7f10d40a3d70 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d999c640 4 set_mon_vals no callback set 2024-03-27T21:30:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.047+0000 7f10d1ffb640 10 monclient: dump: 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 10 monclient: shutdown 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 -- 172.21.15.28:0/3481814903 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f10d40a3d70 msgr2=0x7f10d4137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 --2- 172.21.15.28:0/3481814903 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f10d40a3d70 0x7f10d4137620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f10c40097a0 tx=0x7f10c402b7a0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 -- 172.21.15.28:0/3481814903 shutdown_connections 2024-03-27T21:30:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 --2- 172.21.15.28:0/3481814903 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f10d40a3d70 0x7f10d4137620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 --2- 172.21.15.28:0/3481814903 >> v2:172.21.15.28:3300/0 conn(0x7f10d4136d00 0x7f10d41370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 -- 172.21.15.28:0/3481814903 >> 172.21.15.28:0/3481814903 conn(0x7f10d40a9430 msgr2=0x7f10d40a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 -- 172.21.15.28:0/3481814903 shutdown_connections 2024-03-27T21:30:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 1 -- 172.21.15.28:0/3481814903 wait complete. 2024-03-27T21:30:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 10 monclient: build_initial_monmap 2024-03-27T21:30:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.048+0000 7f10d999c640 10 monclient: monmap: 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 librados: starting msgr at 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 librados: starting objecter 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 Processor -- start 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 -- start start 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 librados: setting wanted keys 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 librados: calling monclient init 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient: init 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient: _add_conns ranks=[1,0,3,7,4,8,5,2,6] 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d40a3d70 0x7f10d409f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): picked mon.noname-f con 0x7f10d40a3d70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 0x7f10d41cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): picked mon.noname-a con 0x7f10d41339e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f10d4136d00 0x7f10d41cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): picked mon.noname-g con 0x7f10d4136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d409e880 con 0x7f10d41339e0 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d41cb650 con 0x7f10d40a3d70 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d40a11e0 con 0x7f10d4136d00 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d999c640 10 monclient(hunting): authenticate will time out at 843.357589s 2024-03-27T21:30:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 0x7f10d41cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 0x7f10d41cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38428/0 (socket says 172.21.15.28:38428) 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 1 -- 172.21.15.28:0/3121428119 learned_addr learned my addr 172.21.15.28:0/3121428119 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 10 monclient(hunting): get_auth_request con 0x7f10d41339e0 auth_method 0 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.049+0000 7f10d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d37fe640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f10d4136d00 0x7f10d41cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d2ffd640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d40a3d70 0x7f10d409f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d37fe640 10 monclient(hunting): get_auth_request con 0x7f10d4136d00 auth_method 0 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request con 0x7f10d40a3d70 auth_method 0 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d2ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 10 monclient(hunting): handle_auth_done global_id 4302 payload 824 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 -- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f10d4136d00 msgr2=0x7f10d41cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f10d4136d00 0x7f10d41cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 -- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d40a3d70 msgr2=0x7f10d409f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d40a3d70 0x7f10d409f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 monclient: found mon.noname-a 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 -- 172.21.15.28:0/3121428119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc009400 con 0x7f10d41339e0 2024-03-27T21:30:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d37fe640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f10d4136d00 0x7f10d41cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d2ffd640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d40a3d70 0x7f10d409f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d27fc640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 0x7f10d41cba60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10c4036040 tx=0x7f10c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 client.?.objecter ms_handle_connect 0x7f10d41339e0 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f10c4004490 con 0x7f10d41339e0 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: dump: 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: _finish_auth 0 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4003a80 con 0x7f10d41339e0 2024-03-27T21:30:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 5 monclient: authenticate success, global_id 4302 2024-03-27T21:30:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 10 monclient: _renew_subs 2024-03-27T21:30:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c4009400 con 0x7f10d41339e0 2024-03-27T21:30:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f10c4003bf0 con 0x7f10d41339e0 2024-03-27T21:30:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d17fa640 4 set_mon_vals no callback set 2024-03-27T21:30:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10cbfff640 10 monclient: dump: 2024-03-27T21:30:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.084 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 10 client.4302.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 10 monclient: _renew_subs 2024-03-27T21:30:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d409e5a0 con 0x7f10d41339e0 2024-03-27T21:30:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.050+0000 7f10d999c640 1 librados: init done 2024-03-27T21:30:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 44753+0+0 (secure 0 0 0) 0x7f10c4003d50 con 0x7f10d41339e0 2024-03-27T21:30:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f10b403a1f0 0x7f10b403c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10d999c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f10c406b660 con 0x7f10d41339e0 2024-03-27T21:30:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10d999c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 10 client.4302.objecter ms_dispatch 0x7f10d4000b90 osd_map(14..14 src has 1..14) v4 2024-03-27T21:30:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10d999c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 3 client.4302.objecter handle_osd_map got epochs [14,14] > 0 2024-03-27T21:30:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 3 client.4302.objecter handle_osd_map decoding full epoch 14 2024-03-27T21:30:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d40a9d30 con 0x7f10d41339e0 2024-03-27T21:30:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10cbfff640 20 client.4302.objecter dump_active .. 0 homeless 2024-03-27T21:30:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10d2ffd640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f10b403a1f0 0x7f10b403c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.051+0000 7f10d2ffd640 10 monclient: get_auth_request con 0x7f10b403a1f0 auth_method 0 2024-03-27T21:30:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.052+0000 7f10d2ffd640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f10b403a1f0 0x7f10b403c6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009c80 tx=0x7f10bc008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.052+0000 7f10cbfff640 10 client.4302.objecter ms_handle_connect 0x7f10b403a1f0 2024-03-27T21:30:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.056+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f10c4043070 con 0x7f10d41339e0 2024-03-27T21:30:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.056+0000 7f10cbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.056+0000 7f10cbfff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.288+0000 7f10d999c640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-03-27T21:30:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.288+0000 7f10d999c640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-03-27T21:30:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.288+0000 7f10d999c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.288+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f10d40a6c30 con 0x7f10d41339e0 2024-03-27T21:30:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.291+0000 7f10cbfff640 1 -- 172.21.15.28:0/3121428119 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+86022 (secure 0 0 0) 0x7f10c4038030 con 0x7f10d41339e0 2024-03-27T21:30:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.291+0000 7f10cbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-03-27T21:30:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.291+0000 7f10cbfff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:21.282 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 10 librados: watch_flush enter 2024-03-27T21:30:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 10 librados: watch_flush exit 2024-03-27T21:30:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 20 client.4302.objecter shutdown clearing up homeless session... 2024-03-27T21:30:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 10 client.4302.objecter successfully canceled tick 2024-03-27T21:30:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f10b403a1f0 msgr2=0x7f10b403c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f10b403a1f0 0x7f10b403c6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009c80 tx=0x7f10bc008040 comp rx=0 tx=0).stop 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 10 monclient: shutdown 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 msgr2=0x7f10d41cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 0x7f10d41cba60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10c4036040 tx=0x7f10c40046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 shutdown_connections 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f10b403a1f0 0x7f10b403c6b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f10d4136d00 0x7f10d41cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10d41339e0 0x7f10d41cba60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 --2- 172.21.15.28:0/3121428119 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10d40a3d70 0x7f10d409f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 >> 172.21.15.28:0/3121428119 conn(0x7f10d40a9430 msgr2=0x7f10d41324b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 shutdown_connections 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.293+0000 7f10d999c640 1 -- 172.21.15.28:0/3121428119 wait complete. 2024-03-27T21:30:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.294+0000 7f10d999c640 1 librados: shutdown 2024-03-27T21:30:21.294 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":4,"active_gid":4132,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":33051},{"type":"v1","addr":"172.21.15.63:6825","nonce":33051}]},"active_addr":"172.21.15.63:6825/33051","active_change":"2024-03-27T21:30:14.627446+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3085981096}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":645708593}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1513232467}]}]} 2024-03-27T21:30:21.296 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-27T21:30:21.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-27T21:30:21.296 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.406+0000 7f1aa9900640 10 monclient: get_monmap_and_config 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.406+0000 7f1aa9900640 10 monclient: build_initial_monmap 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.406+0000 7f1aa9900640 10 monclient: monmap: 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:21.408033+0000 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:21.408033+0000 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:21.396 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:21.397 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.406+0000 7f1aa9900640 1 Processor -- start 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 1 -- start start 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient: init 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient: _add_conns ranks=[3,0,7,5,2,10,4,1,9,8,6] 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa4136d00 0x7f1aa41370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): picked mon.noname-g con 0x7f1aa4136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1aa40a3d70 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4137620 0x7f1aa41340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): picked mon.noname-i con 0x7f1aa4137620 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40618f0 con 0x7f1aa40a3d70 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40a25b0 con 0x7f1aa4136d00 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40a13f0 con 0x7f1aa4137620 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa9900640 10 monclient(hunting): authenticate will time out at 843.715195s 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1a9bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1aa40a3d70 0x7f1aa41339e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52914/0 (socket says 172.21.15.28:52914) 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1a9bfff640 1 -- 172.21.15.28:0/823152975 learned_addr learned my addr 172.21.15.28:0/823152975 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa4136d00 0x7f1aa41370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request con 0x7f1aa4136d00 auth_method 0 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4137620 0x7f1aa41340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request con 0x7f1aa4137620 auth_method 0 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa27fc640 1 -- 172.21.15.28:0/823152975 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193462130 0 0) 0x7f1aa40618f0 con 0x7f1aa40a3d70 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa27fc640 10 monclient(hunting): _negotiate 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa27fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa27fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa27fc640 10 monclient(hunting): my global_id is 4311 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa27fc640 1 -- 172.21.15.28:0/823152975 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a90003520 con 0x7f1aa40a3d70 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.407+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_done global_id 4269 payload 274 2024-03-27T21:30:21.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 1 -- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4137620 msgr2=0x7f1aa41340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4137620 0x7f1aa41340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 1 -- 172.21.15.28:0/823152975 >> v1:172.21.15.28:6789/0 conn(0x7f1aa40a3d70 legacy=0x7f1aa41339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 1 monclient: found mon.noname-g 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa27fc640 1 -- 172.21.15.28:0/823152975 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033790545 0 0) 0x7f1a90003520 con 0x7f1aa40a3d70 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 1 -- 172.21.15.28:0/823152975 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa40a1f60 con 0x7f1aa4136d00 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa27fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.408+0000 7f1aa2ffd640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa4136d00 0x7f1aa41370e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097d0 tx=0x7f1a9402b650 comp rx=0 tx=0).ready entity=mon.3 client_cookie=b61b9fc1c6bf3c11 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 1 -- 172.21.15.28:0/823152975 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1a8c0018e0 con 0x7f1aa4136d00 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: dump: 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.411 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 5 monclient: authenticate success, global_id 4269 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 1 -- 172.21.15.28:0/823152975 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9402e050 con 0x7f1aa4136d00 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 4 set_mon_vals no callback set 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 1 -- 172.21.15.28:0/823152975 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1a94030df0 con 0x7f1aa4136d00 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:21.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa27fc640 10 monclient: dump: 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.413 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 10 monclient: shutdown 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 -- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa4136d00 msgr2=0x7f1aa41370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa4136d00 0x7f1aa41370e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1a940097d0 tx=0x7f1a9402b650 comp rx=0 tx=0).stop 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 -- 172.21.15.28:0/823152975 shutdown_connections 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4137620 0x7f1aa41340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 --2- 172.21.15.28:0/823152975 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa4136d00 0x7f1aa41370e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 -- 172.21.15.28:0/823152975 >> 172.21.15.28:0/823152975 conn(0x7f1aa40a9430 msgr2=0x7f1aa40a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 -- 172.21.15.28:0/823152975 shutdown_connections 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.409+0000 7f1aa9900640 1 -- 172.21.15.28:0/823152975 wait complete. 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 10 monclient: build_initial_monmap 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 10 monclient: monmap: 2024-03-27T21:30:21.414 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:21.415 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 librados: starting msgr at 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 librados: starting objecter 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 Processor -- start 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 -- start start 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 librados: setting wanted keys 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 librados: calling monclient init 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 10 monclient: init 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 10 monclient: _add_conns ranks=[3,7,0,1,4,5,2,8,6] 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa40a3d70 0x7f1aa41cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 10 monclient(hunting): picked mon.noname-g con 0x7f1aa40a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.410+0000 7f1aa9900640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4136d00 0x7f1aa41cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): picked mon.noname-i con 0x7f1aa4136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 0x7f1aa409e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.416 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): picked mon.noname-a con 0x7f1aa4137620 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41205c0 con 0x7f1aa4137620 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41223b0 con 0x7f1aa40a3d70 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4121f90 con 0x7f1aa4136d00 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient(hunting): authenticate will time out at 843.718749s 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 0x7f1aa409e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4136d00 0x7f1aa41cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 0x7f1aa409e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38432/0 (socket says 172.21.15.28:38432) 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 -- 172.21.15.28:0/3290770251 learned_addr learned my addr 172.21.15.28:0/3290770251 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa40a3d70 0x7f1aa41cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request con 0x7f1aa4137620 auth_method 0 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): get_auth_request con 0x7f1aa4136d00 auth_method 0 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request con 0x7f1aa40a3d70 auth_method 0 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1a9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient(hunting): handle_auth_done global_id 4320 payload 824 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 -- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4136d00 msgr2=0x7f1aa41cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4136d00 0x7f1aa41cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 -- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa40a3d70 msgr2=0x7f1aa41cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa40a3d70 0x7f1aa41cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 monclient: found mon.noname-a 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 -- 172.21.15.28:0/3290770251 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a94009400 con 0x7f1aa4137620 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa37fe640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 0x7f1aa409e210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ec10 tx=0x7f1a9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 client.?.objecter ms_handle_connect 0x7f1aa4137620 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1a9c014480 con 0x7f1aa4137620 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: dump: 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.420 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:21.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00f040 con 0x7f1aa4137620 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 5 monclient: authenticate success, global_id 4320 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1a9c014a90 con 0x7f1aa4137620 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient: _renew_subs 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa41200d0 con 0x7f1aa4137620 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa1ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa0ff9640 10 monclient: dump: 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.422 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 client.4320.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient: _renew_subs 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa40a11e0 con 0x7f1aa4137620 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.411+0000 7f1aa9900640 1 librados: init done 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.412+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 44753+0+0 (secure 0 0 0) 0x7f1a9c014620 con 0x7f1aa4137620 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.412+0000 7f1aa0ff9640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1a8403a1c0 0x7f1a8403c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa9900640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa9900640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa9900640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f1a9c04adf0 con 0x7f1aa4137620 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa0ff9640 10 client.4320.objecter ms_dispatch 0x7f1aa4000b90 osd_map(14..14 src has 1..14) v4 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa0ff9640 3 client.4320.objecter handle_osd_map got epochs [14,14] > 0 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa0ff9640 3 client.4320.objecter handle_osd_map decoding full epoch 14 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa40a0da0 con 0x7f1aa4137620 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa0ff9640 20 client.4320.objecter dump_active .. 0 homeless 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa2ffd640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1a8403a1c0 0x7f1a8403c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa2ffd640 10 monclient: get_auth_request con 0x7f1a8403a1c0 auth_method 0 2024-03-27T21:30:21.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa2ffd640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1a8403a1c0 0x7f1a8403c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a94034000 tx=0x7f1a94008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.413+0000 7f1aa0ff9640 10 client.4320.objecter ms_handle_connect 0x7f1a8403a1c0 2024-03-27T21:30:21.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.417+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1a9c018070 con 0x7f1aa4137620 2024-03-27T21:30:21.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.417+0000 7f1aa0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.417+0000 7f1aa0ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:21.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.529+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f1a9c01d400 con 0x7f1aa4137620 2024-03-27T21:30:21.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.607+0000 7f1aa9900640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:21.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.607+0000 7f1aa9900640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:21.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.607+0000 7f1aa9900640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.607+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aa40a9d70 con 0x7f1aa4137620 2024-03-27T21:30:21.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.608+0000 7f1aa0ff9640 1 -- 172.21.15.28:0/3290770251 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11807 (secure 0 0 0) 0x7f1a9c0076f0 con 0x7f1aa4137620 2024-03-27T21:30:21.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.608+0000 7f1aa0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:21.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.608+0000 7f1aa0ff9640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:21.598 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:21.598 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":14,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:20.883602+0000","last_up_change":"2024-03-27T21:30:18.879901+0000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T21:30:18.680135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-27T21:30:19.526407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6801","nonce":33278},{"type":"v1","addr":"172.21.15.28:6803","nonce":33278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6805","nonce":33278},{"type":"v1","addr":"172.21.15.28:6807","nonce":33278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":33278},{"type":"v1","addr":"172.21.15.28:6815","nonce":33278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":33278},{"type":"v1","addr":"172.21.15.28:6811","nonce":33278}]},"public_addr":"172.21.15.28:6803/33278","cluster_addr":"172.21.15.28:6807/33278","heartbeat_back_addr":"172.21.15.28:6815/33278","heartbeat_front_addr":"172.21.15.28:6811/33278","state":["exists","up"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":33279},{"type":"v1","addr":"172.21.15.28:6802","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":33279},{"type":"v1","addr":"172.21.15.28:6806","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":33279},{"type":"v1","addr":"172.21.15.28:6814","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":33279},{"type":"v1","addr":"172.21.15.28:6810","nonce":33279}]},"public_addr":"172.21.15.28:6802/33279","cluster_addr":"172.21.15.28:6806/33279","heartbeat_back_addr":"172.21.15.28:6814/33279","heartbeat_front_addr":"172.21.15.28:6810/33279","state":["exists","up"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":33280},{"type":"v1","addr":"172.21.15.28:6817","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":33280},{"type":"v1","addr":"172.21.15.28:6819","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":33280},{"type":"v1","addr":"172.21.15.28:6823","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":33280},{"type":"v1","addr":"172.21.15.28:6821","nonce":33280}]},"public_addr":"172.21.15.28:6817/33280","cluster_addr":"172.21.15.28:6819/33280","heartbeat_back_addr":"172.21.15.28:6823/33280","heartbeat_front_addr":"172.21.15.28:6821/33280","state":["exists","up"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33504},{"type":"v1","addr":"172.21.15.63:6805","nonce":33504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":33504},{"type":"v1","addr":"172.21.15.63:6810","nonce":33504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33504},{"type":"v1","addr":"172.21.15.63:6815","nonce":33504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33504},{"type":"v1","addr":"172.21.15.63:6813","nonce":33504}]},"public_addr":"172.21.15.63:6805/33504","cluster_addr":"172.21.15.63:6810/33504","heartbeat_back_addr":"172.21.15.63:6815/33504","heartbeat_front_addr":"172.21.15.63:6813/33504","state":["exists","up"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33505},{"type":"v1","addr":"172.21.15.63:6817","nonce":33505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33505},{"type":"v1","addr":"172.21.15.63:6819","nonce":33505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33505},{"type":"v1","addr":"172.21.15.63:6823","nonce":33505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33505},{"type":"v1","addr":"172.21.15.63:6821","nonce":33505}]},"public_addr":"172.21.15.63:6817/33505","cluster_addr":"172.21.15.63:6819/33505","heartbeat_back_addr":"172.21.15.63:6823/33505","heartbeat_front_addr":"172.21.15.63:6821/33505","state":["exists","up"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33506},{"type":"v1","addr":"172.21.15.63:6801","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":33506},{"type":"v1","addr":"172.21.15.63:6804","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":33506},{"type":"v1","addr":"172.21.15.63:6811","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33506},{"type":"v1","addr":"172.21.15.63:6808","nonce":33506}]},"public_addr":"172.21.15.63:6801/33506","cluster_addr":"172.21.15.63:6804/33506","heartbeat_back_addr":"172.21.15.63:6811/33506","heartbeat_front_addr":"172.21.15.63:6808/33506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.360569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.424079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.458359+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.423025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.452402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.398176+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:30:21.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 10 librados: watch_flush enter 2024-03-27T21:30:21.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 10 librados: watch_flush exit 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 20 client.4320.objecter shutdown clearing up homeless session... 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 10 client.4320.objecter successfully canceled tick 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1a8403a1c0 msgr2=0x7f1a8403c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1a8403a1c0 0x7f1a8403c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1a94034000 tx=0x7f1a94008030 comp rx=0 tx=0).stop 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 10 monclient: shutdown 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 msgr2=0x7f1aa409e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 0x7f1aa409e210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00ec10 tx=0x7f1a9c00c490 comp rx=0 tx=0).stop 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 shutdown_connections 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1a8403a1c0 0x7f1a8403c680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1aa4137620 0x7f1aa409e210 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1aa4136d00 0x7f1aa41cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 --2- 172.21.15.28:0/3290770251 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1aa40a3d70 0x7f1aa41cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 >> 172.21.15.28:0/3290770251 conn(0x7f1aa40a9430 msgr2=0x7f1aa40a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:21.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 shutdown_connections 2024-03-27T21:30:21.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 -- 172.21.15.28:0/3290770251 wait complete. 2024-03-27T21:30:21.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.610+0000 7f1aa9900640 1 librados: shutdown 2024-03-27T21:30:21.610 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-27T21:30:21.611 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.720+0000 7f854345c640 10 monclient: get_monmap_and_config 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.720+0000 7f854345c640 10 monclient: build_initial_monmap 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.720+0000 7f854345c640 10 monclient: monmap: 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:21.722550+0000 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:21.722550+0000 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:21.711 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 Processor -- start 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 -- start start 2024-03-27T21:30:21.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient: init 2024-03-27T21:30:21.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:21.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient: _add_conns ranks=[3,2,1,6,9,10,0,4,7,8,5] 2024-03-27T21:30:21.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f853c136d00 0x7f853c1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): picked mon.noname-g con 0x7f853c136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 0x7f853c137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): picked mon.noname-b con 0x7f853c0a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f853c1339e0 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c0618f0 con 0x7f853c1339e0 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0a25b0 con 0x7f853c0a3d70 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c137b60 con 0x7f853c136d00 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.721+0000 7f854345c640 10 monclient(hunting): authenticate will time out at 844.029711s 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 0x7f853c137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 0x7f853c137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36412/0 (socket says 172.21.15.28:36412) 2024-03-27T21:30:21.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 -- 172.21.15.28:0/1759946514 learned_addr learned my addr 172.21.15.28:0/1759946514 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): get_auth_request con 0x7f853c0a3d70 auth_method 0 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 1 --2- 172.21.15.28:0/1759946514 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f853c136d00 0x7f853c1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): get_auth_request con 0x7f853c136d00 auth_method 0 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85411f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient(hunting): handle_auth_done global_id 4196 payload 274 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 -- 172.21.15.28:0/1759946514 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f853c136d00 msgr2=0x7f853c1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 --2- 172.21.15.28:0/1759946514 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f853c136d00 0x7f853c1370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 -- 172.21.15.28:0/1759946514 >> v1:172.21.15.63:6789/0 conn(0x7f853c1339e0 legacy=0x7f853c133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f8533fff640 1 -- 172.21.15.28:0/1759946514 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711134220 0 0) 0x7f853c0618f0 con 0x7f853c1339e0 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient: _finish_hunting 0 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 monclient: found mon.noname-b 2024-03-27T21:30:21.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f85409f7640 1 -- 172.21.15.28:0/1759946514 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0a13f0 con 0x7f853c0a3d70 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.722+0000 7f8533fff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f85409f7640 1 --2- 172.21.15.28:0/1759946514 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 0x7f853c137620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f852c0098d0 tx=0x7f852c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64916d907d1c4cac server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 1 -- 172.21.15.28:0/1759946514 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f852c02e070 con 0x7f853c0a3d70 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: dump: 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.726 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 1 -- 172.21.15.28:0/1759946514 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c031a10 con 0x7f853c0a3d70 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 5 monclient: authenticate success, global_id 4196 2024-03-27T21:30:21.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 1 -- 172.21.15.28:0/1759946514 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f852c031bc0 con 0x7f853c0a3d70 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 4 set_mon_vals no callback set 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f8533fff640 10 monclient: dump: 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.728 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.729 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 10 monclient: shutdown 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 -- 172.21.15.28:0/1759946514 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 msgr2=0x7f853c137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 --2- 172.21.15.28:0/1759946514 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 0x7f853c137620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f852c0098d0 tx=0x7f852c02b840 comp rx=0 tx=0).stop 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 -- 172.21.15.28:0/1759946514 shutdown_connections 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 --2- 172.21.15.28:0/1759946514 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f853c0a3d70 0x7f853c137620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 --2- 172.21.15.28:0/1759946514 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f853c136d00 0x7f853c1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 -- 172.21.15.28:0/1759946514 >> 172.21.15.28:0/1759946514 conn(0x7f853c0a9430 msgr2=0x7f853c0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 -- 172.21.15.28:0/1759946514 shutdown_connections 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.723+0000 7f854345c640 1 -- 172.21.15.28:0/1759946514 wait complete. 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 10 monclient: build_initial_monmap 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 10 monclient: monmap: 2024-03-27T21:30:21.730 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:21.731 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 1 librados: starting msgr at 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 1 librados: starting objecter 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 1 Processor -- start 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 1 -- start start 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 1 librados: setting wanted keys 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 1 librados: calling monclient init 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.724+0000 7f854345c640 10 monclient: init 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient: _add_conns ranks=[5,1,0,7,8,6,4,3,2] 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f853c0a3d70 0x7f853c132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): picked mon.noname-h con 0x7f853c0a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f853c1339e0 0x7f853c133020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): picked mon.noname-f con 0x7f853c1339e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:21.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 0x7f853c09c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): picked mon.noname-a con 0x7f853c136d00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c09e100 con 0x7f853c136d00 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c0a11e0 con 0x7f853c1339e0 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f853c1c0570 con 0x7f853c0a3d70 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f854345c640 10 monclient(hunting): authenticate will time out at 844.032981s 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 0x7f853c09c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 0x7f853c09c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38438/0 (socket says 172.21.15.28:38438) 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f853c1339e0 0x7f853c133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 -- 172.21.15.28:0/1714156417 learned_addr learned my addr 172.21.15.28:0/1714156417 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): get_auth_request con 0x7f853c136d00 auth_method 0 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f853c0a3d70 0x7f853c132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): get_auth_request con 0x7f853c1339e0 auth_method 0 2024-03-27T21:30:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): get_auth_request con 0x7f853c0a3d70 auth_method 0 2024-03-27T21:30:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85411f8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient(hunting): handle_auth_done global_id 4329 payload 824 2024-03-27T21:30:21.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 -- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f853c0a3d70 msgr2=0x7f853c132ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f853c0a3d70 0x7f853c132ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 -- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f853c1339e0 msgr2=0x7f853c133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f853c1339e0 0x7f853c133020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient: _finish_hunting 0 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 monclient: found mon.noname-a 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 -- 172.21.15.28:0/1714156417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c0094d0 con 0x7f853c136d00 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85409f7640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f853c1339e0 0x7f853c133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f85419f9640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 0x7f853c09c600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f853400c780 tx=0x7f853400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f8531ffb640 10 client.?.objecter ms_handle_connect 0x7f853c136d00 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.725+0000 7f8531ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f853400ce30 con 0x7f853c136d00 2024-03-27T21:30:21.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: dump: 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.738 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8534003ba0 con 0x7f853c136d00 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8534003d10 con 0x7f853c136d00 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 5 monclient: authenticate success, global_id 4329 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f85337fe640 4 set_mon_vals no callback set 2024-03-27T21:30:21.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 10 monclient: dump: 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:21.740 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 10 monclient: _renew_subs 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c11f9d0 con 0x7f853c136d00 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 10 client.4329.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 10 monclient: _renew_subs 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c11ff90 con 0x7f853c136d00 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f854345c640 1 librados: init done 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.726+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f8534005070 con 0x7f853c136d00 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f852003a250 0x7f852003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f8534049c70 con 0x7f853c136d00 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 10 client.4329.objecter ms_dispatch 0x7f853c000b90 osd_map(14..14 src has 1..14) v4 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 3 client.4329.objecter handle_osd_map got epochs [14,14] > 0 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 3 client.4329.objecter handle_osd_map decoding full epoch 14 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 20 client.4329.objecter dump_active .. 0 homeless 2024-03-27T21:30:21.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f854345c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f854345c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f854345c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f85411f8640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f852003a250 0x7f852003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c0672e0 con 0x7f853c136d00 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f85411f8640 10 monclient: get_auth_request con 0x7f852003a250 auth_method 0 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f85411f8640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f852003a250 0x7f852003c710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8538009aa0 tx=0x7f8538009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.727+0000 7f8531ffb640 10 client.4329.objecter ms_handle_connect 0x7f852003a250 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.732+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8534005320 con 0x7f853c136d00 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.732+0000 7f8531ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:21.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.732+0000 7f8531ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.912+0000 7f854345c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.912+0000 7f854345c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.912+0000 7f854345c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:21.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.912+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f853c074b30 con 0x7f853c136d00 2024-03-27T21:30:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.913+0000 7f8531ffb640 1 -- 172.21.15.28:0/1714156417 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11807 (secure 0 0 0) 0x7f853403b030 con 0x7f853c136d00 2024-03-27T21:30:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.913+0000 7f8531ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:21.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.913+0000 7f8531ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:21.903 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:21.903 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":14,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:20.883602+0000","last_up_change":"2024-03-27T21:30:18.879901+0000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T21:30:18.680135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-27T21:30:19.526407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6801","nonce":33278},{"type":"v1","addr":"172.21.15.28:6803","nonce":33278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6805","nonce":33278},{"type":"v1","addr":"172.21.15.28:6807","nonce":33278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":33278},{"type":"v1","addr":"172.21.15.28:6815","nonce":33278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":33278},{"type":"v1","addr":"172.21.15.28:6811","nonce":33278}]},"public_addr":"172.21.15.28:6803/33278","cluster_addr":"172.21.15.28:6807/33278","heartbeat_back_addr":"172.21.15.28:6815/33278","heartbeat_front_addr":"172.21.15.28:6811/33278","state":["exists","up"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":33279},{"type":"v1","addr":"172.21.15.28:6802","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":33279},{"type":"v1","addr":"172.21.15.28:6806","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":33279},{"type":"v1","addr":"172.21.15.28:6814","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":33279},{"type":"v1","addr":"172.21.15.28:6810","nonce":33279}]},"public_addr":"172.21.15.28:6802/33279","cluster_addr":"172.21.15.28:6806/33279","heartbeat_back_addr":"172.21.15.28:6814/33279","heartbeat_front_addr":"172.21.15.28:6810/33279","state":["exists","up"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":33280},{"type":"v1","addr":"172.21.15.28:6817","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":33280},{"type":"v1","addr":"172.21.15.28:6819","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":33280},{"type":"v1","addr":"172.21.15.28:6823","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":33280},{"type":"v1","addr":"172.21.15.28:6821","nonce":33280}]},"public_addr":"172.21.15.28:6817/33280","cluster_addr":"172.21.15.28:6819/33280","heartbeat_back_addr":"172.21.15.28:6823/33280","heartbeat_front_addr":"172.21.15.28:6821/33280","state":["exists","up"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33504},{"type":"v1","addr":"172.21.15.63:6805","nonce":33504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":33504},{"type":"v1","addr":"172.21.15.63:6810","nonce":33504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33504},{"type":"v1","addr":"172.21.15.63:6815","nonce":33504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33504},{"type":"v1","addr":"172.21.15.63:6813","nonce":33504}]},"public_addr":"172.21.15.63:6805/33504","cluster_addr":"172.21.15.63:6810/33504","heartbeat_back_addr":"172.21.15.63:6815/33504","heartbeat_front_addr":"172.21.15.63:6813/33504","state":["exists","up"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33505},{"type":"v1","addr":"172.21.15.63:6817","nonce":33505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33505},{"type":"v1","addr":"172.21.15.63:6819","nonce":33505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33505},{"type":"v1","addr":"172.21.15.63:6823","nonce":33505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33505},{"type":"v1","addr":"172.21.15.63:6821","nonce":33505}]},"public_addr":"172.21.15.63:6817/33505","cluster_addr":"172.21.15.63:6819/33505","heartbeat_back_addr":"172.21.15.63:6823/33505","heartbeat_front_addr":"172.21.15.63:6821/33505","state":["exists","up"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33506},{"type":"v1","addr":"172.21.15.63:6801","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":33506},{"type":"v1","addr":"172.21.15.63:6804","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":33506},{"type":"v1","addr":"172.21.15.63:6811","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33506},{"type":"v1","addr":"172.21.15.63:6808","nonce":33506}]},"public_addr":"172.21.15.63:6801/33506","cluster_addr":"172.21.15.63:6804/33506","heartbeat_back_addr":"172.21.15.63:6811/33506","heartbeat_front_addr":"172.21.15.63:6808/33506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.360569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.424079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.458359+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.423025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.452402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.398176+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.914+0000 7f854345c640 10 librados: watch_flush enter 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 10 librados: watch_flush exit 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 20 client.4329.objecter shutdown clearing up homeless session... 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 10 client.4329.objecter successfully canceled tick 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f852003a250 msgr2=0x7f852003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f852003a250 0x7f852003c710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8538009aa0 tx=0x7f8538009190 comp rx=0 tx=0).stop 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 10 monclient: shutdown 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 msgr2=0x7f853c09c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:21.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 0x7f853c09c600 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f853400c780 tx=0x7f853400cc40 comp rx=0 tx=0).stop 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 shutdown_connections 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f852003a250 0x7f852003c710 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f853c136d00 0x7f853c09c600 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f853c1339e0 0x7f853c133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 --2- 172.21.15.28:0/1714156417 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f853c0a3d70 0x7f853c132ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 >> 172.21.15.28:0/1714156417 conn(0x7f853c0a9430 msgr2=0x7f853c066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 shutdown_connections 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 -- 172.21.15.28:0/1714156417 wait complete. 2024-03-27T21:30:21.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:21.915+0000 7f854345c640 1 librados: shutdown 2024-03-27T21:30:21.915 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-27T21:30:21.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-27T21:30:21.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-27T21:30:21.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-27T21:30:21.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-27T21:30:21.917 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-27T21:30:22.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.047+0000 7f299085c640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.047+0000 7f299085c640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.047+0000 7f299085c640 10 monclient: monmap: 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.049308+0000 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.049308+0000 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.038 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 1 Processor -- start 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 1 -- start start 2024-03-27T21:30:22.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 10 monclient: init 2024-03-27T21:30:22.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 10 monclient: _add_conns ranks=[9,2,8,7,6,3,4,1,0,10,5] 2024-03-27T21:30:22.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f298c136d00 0x7f298c1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 10 monclient(hunting): picked mon.noname-a con 0x7f298c136d00 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f298c0a3d70 0x7f298c137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 10 monclient(hunting): picked mon.noname-b con 0x7f298c0a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.048+0000 7f299085c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c1339e0 0x7f298c133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 10 monclient(hunting): picked mon.noname-e con 0x7f298c1339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0a25b0 con 0x7f298c136d00 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c137b60 con 0x7f298c0a3d70 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a13f0 con 0x7f298c1339e0 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f299085c640 10 monclient(hunting): authenticate will time out at 844.356761s 2024-03-27T21:30:22.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f298c136d00 0x7f298c1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f298c136d00 0x7f298c1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38440/0 (socket says 172.21.15.28:38440) 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 -- 172.21.15.28:0/1742297556 learned_addr learned my addr 172.21.15.28:0/1742297556 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): get_auth_request con 0x7f298c136d00 auth_method 0 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298ad9d640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c1339e0 0x7f298c133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f2989d9b640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f298c0a3d70 0x7f298c137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298ad9d640 10 monclient(hunting): get_auth_request con 0x7f298c1339e0 auth_method 0 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298ad9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient(hunting): handle_auth_done global_id 4338 payload 274 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 -- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c1339e0 msgr2=0x7f298c133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c1339e0 0x7f298c133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 -- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f298c0a3d70 msgr2=0x7f298c137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f298c0a3d70 0x7f298c137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 monclient: found mon.noname-a 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298a59c640 1 -- 172.21.15.28:0/1742297556 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0618f0 con 0x7f298c136d00 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f2989d9b640 10 monclient: get_auth_request con 0x7f298c0a3d70 auth_method 0 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f2989d9b640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f298c0a3d70 0x7f298c137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.049+0000 7f298ad9d640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c1339e0 0x7f298c133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:22.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298a59c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c136d00 0x7f298c1370e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f297c013150 tx=0x7f297c033fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d05d5a6e03b778 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 1 -- 172.21.15.28:0/1742297556 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f297c0110d0 con 0x7f298c136d00 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: dump: 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.055 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 1 -- 172.21.15.28:0/1742297556 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c011250 con 0x7f298c136d00 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 1 -- 172.21.15.28:0/1742297556 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f297c00f850 con 0x7f298c136d00 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f298959a640 10 monclient: dump: 2024-03-27T21:30:22.056 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.057 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f299085c640 5 monclient: authenticate success, global_id 4338 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f299085c640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.051+0000 7f299085c640 4 set_mon_vals no callback set 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 10 monclient: shutdown 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 -- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c136d00 msgr2=0x7f298c1370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c136d00 0x7f298c1370e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f297c013150 tx=0x7f297c033fd0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 -- 172.21.15.28:0/1742297556 shutdown_connections 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c1339e0 0x7f298c133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f298c0a3d70 0x7f298c137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 --2- 172.21.15.28:0/1742297556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f298c136d00 0x7f298c1370e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 -- 172.21.15.28:0/1742297556 >> 172.21.15.28:0/1742297556 conn(0x7f298c0a9430 msgr2=0x7f298c0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 -- 172.21.15.28:0/1742297556 shutdown_connections 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.052+0000 7f299085c640 1 -- 172.21.15.28:0/1742297556 wait complete. 2024-03-27T21:30:22.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 10 monclient: monmap: 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.059 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 1 librados: starting msgr at 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 1 librados: starting objecter 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 1 Processor -- start 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 1 -- start start 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 1 librados: setting wanted keys 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 1 librados: calling monclient init 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.053+0000 7f299085c640 10 monclient: init 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient: _add_conns ranks=[5,7,8,0,6,2,4,3,1] 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f298c0a3d70 0x7f298c1c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): picked mon.noname-h con 0x7f298c0a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:22.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f298c1339e0 0x7f298c1c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): picked mon.noname-i con 0x7f298c1339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c136d00 0x7f298c1c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): picked mon.noname-e con 0x7f298c136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f298c09de90 con 0x7f298c0a3d70 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a16a0 con 0x7f298c1339e0 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a11e0 con 0x7f298c136d00 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f299085c640 10 monclient(hunting): authenticate will time out at 844.362253s 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c136d00 0x7f298c1c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c136d00 0x7f298c1c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42322/0 (socket says 172.21.15.28:42322) 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 1 -- 172.21.15.28:0/3398445358 learned_addr learned my addr 172.21.15.28:0/3398445358 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): get_auth_request con 0x7f298c136d00 auth_method 0 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f2989d9b640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f298c1339e0 0x7f298c1c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f2989d9b640 10 monclient(hunting): get_auth_request con 0x7f298c1339e0 auth_method 0 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f2989d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f2989d9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f2989d9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298a59c640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f298c0a3d70 0x7f298c1c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.054+0000 7f298ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): get_auth_request con 0x7f298c0a3d70 auth_method 0 2024-03-27T21:30:22.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f2989d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f2989d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f2989d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298a59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 10 monclient(hunting): handle_auth_done global_id 4211 payload 824 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f298c1339e0 msgr2=0x7f298c1c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f298c1339e0 0x7f298c1c7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f298c0a3d70 msgr2=0x7f298c1c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f298c0a3d70 0x7f298c1c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 monclient: found mon.noname-e 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 -- 172.21.15.28:0/3398445358 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c011d70 con 0x7f298c136d00 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f298ad9d640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c136d00 0x7f298c1c77c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2984007e60 tx=0x7f298400d4a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 client.?.objecter ms_handle_connect 0x7f298c136d00 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f298400de80 con 0x7f298c136d00 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 monclient: dump: 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.064 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.055+0000 7f297affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400f040 con 0x7f298c136d00 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f297affd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f2988d99640 4 set_mon_vals no callback set 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 5 monclient: authenticate success, global_id 4211 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 10 monclient: _renew_subs 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c09cf30 con 0x7f298c136d00 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 10 client.4211.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 10 monclient: _renew_subs 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c09c360 con 0x7f298c136d00 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.056+0000 7f299085c640 1 librados: init done 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2984003e00 con 0x7f298c136d00 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f297affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f297affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f297affd640 10 monclient: dump: 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.067 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f2984003990 con 0x7f298c136d00 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f299085c640 10 client.4211.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f299085c640 15 client.4211.objecter _session_command_op_assign -1 1 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f299085c640 20 client.4211.objecter _get_session osd=-1 returning homeless 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f299085c640 10 client.4211.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f299085c640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.057+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f298c0a3020 con 0x7f298c136d00 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f296c03a1e0 0x7f296c03c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f2984049e50 con 0x7f298c136d00 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 10 client.4211.objecter ms_dispatch 0x7f298c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 3 client.4211.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 3 client.4211.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 10 client.4211.objecter checking command 1 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 20 client.4211.objecter _get_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 15 client.4211.objecter _session_command_op_remove -1 1 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 20 client.4211.objecter _get_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 20 client.4211.objecter get_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 15 client.4211.objecter _session_command_op_assign 4 1 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 4 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 10 client.4211.objecter _send_command 1 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 --> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f296c042950 con 0x7f296c03fe80 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 20 client.4211.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== mon.8 v2:172.21.15.28:3304/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29840138f0 con 0x7f298c136d00 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f297affd640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f298a59c640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f296c03a1e0 0x7f296c03c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f298a59c640 10 monclient: get_auth_request con 0x7f296c03a1e0 auth_method 0 2024-03-27T21:30:22.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f2989d9b640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f2989d9b640 10 monclient: get_auth_request con 0x7f296c03fe80 auth_method 0 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f2989d9b640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 msgr2=0x7f296c0422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f2989d9b640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 msgr2=0x7f296c0422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f2989d9b640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.058+0000 7f2989d9b640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.059+0000 7f297affd640 10 client.4211.objecter ms_handle_connect 0x7f296c03a1e0 2024-03-27T21:30:22.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.059+0000 7f298a59c640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f296c03a1e0 0x7f296c03c6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f297c03d000 tx=0x7f297c038000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.059+0000 7fe556aaf640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.059+0000 7fe556aaf640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.060+0000 7fe556aaf640 10 monclient: monmap: 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.061784+0000 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.061784+0000 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.090 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.091 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.060+0000 7fe556aaf640 1 Processor -- start 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.060+0000 7fe556aaf640 1 -- start start 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.060+0000 7fe556aaf640 10 monclient: init 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient: _add_conns ranks=[0,1,2,6,4,9,3,7,10,5,8] 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe5500a0920 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe55006ff10 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe55013d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient(hunting): picked mon.noname-b con 0x7fe55013ad90 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500618f0 con 0x7fe5500a0920 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500716a0 con 0x7fe55006ff10 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe55504c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe55013d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe55484b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe5500a0920 0x7fe550134f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52922/0 (socket says 172.21.15.28:52922) 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe55484b640 1 -- 172.21.15.28:0/1697988537 learned_addr learned my addr 172.21.15.28:0/1697988537 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 1 -- 172.21.15.28:0/1697988537 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe550135630 con 0x7fe55013ad90 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.061+0000 7fe556aaf640 10 monclient(hunting): authenticate will time out at 844.369685s 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): get_auth_request con 0x7fe55013ad90 auth_method 0 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe54f7fe640 1 -- 172.21.15.28:0/1697988537 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814174446 0 0) 0x7fe5500618f0 con 0x7fe5500a0920 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe54f7fe640 10 monclient(hunting): _negotiate 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe54f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe54f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe54f7fe640 10 monclient(hunting): my global_id is 4347 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe54f7fe640 1 -- 172.21.15.28:0/1697988537 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe540003520 con 0x7fe5500a0920 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient(hunting): handle_auth_done global_id 4205 payload 274 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 1 -- 172.21.15.28:0/1697988537 >> v1:172.21.15.63:6789/0 conn(0x7fe55006ff10 legacy=0x7fe5500a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 1 -- 172.21.15.28:0/1697988537 >> v1:172.21.15.28:6789/0 conn(0x7fe5500a0920 legacy=0x7fe550134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 1 monclient: found mon.noname-b 2024-03-27T21:30:22.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.062+0000 7fe55504c640 1 -- 172.21.15.28:0/1697988537 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500713c0 con 0x7fe55013ad90 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe55504c640 1 --2- 172.21.15.28:0/1697988537 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe55013d180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe548009dc0 tx=0x7fe54802be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=decdb6272bb052f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 1 -- 172.21.15.28:0/1697988537 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe54802ce20 con 0x7fe55013ad90 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: dump: 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.095 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 1 -- 172.21.15.28:0/1697988537 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54802c9b0 con 0x7fe55013ad90 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 1 -- 172.21.15.28:0/1697988537 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe54802cb20 con 0x7fe55013ad90 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe54f7fe640 10 monclient: dump: 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.097 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe556aaf640 5 monclient: authenticate success, global_id 4205 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe556aaf640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.063+0000 7fe556aaf640 4 set_mon_vals no callback set 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 10 monclient: shutdown 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 -- 172.21.15.28:0/1697988537 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 msgr2=0x7fe55013d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 --2- 172.21.15.28:0/1697988537 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe55013d180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe548009dc0 tx=0x7fe54802be00 comp rx=0 tx=0).stop 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 -- 172.21.15.28:0/1697988537 shutdown_connections 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 --2- 172.21.15.28:0/1697988537 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe55013d180 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 -- 172.21.15.28:0/1697988537 >> 172.21.15.28:0/1697988537 conn(0x7fe5500a7810 msgr2=0x7fe5500a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 -- 172.21.15.28:0/1697988537 shutdown_connections 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.064+0000 7fe556aaf640 1 -- 172.21.15.28:0/1697988537 wait complete. 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 10 monclient: monmap: 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.099 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 1 librados: starting msgr at 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 1 librados: starting objecter 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 1 Processor -- start 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 1 -- start start 2024-03-27T21:30:22.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 1 librados: setting wanted keys 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 1 librados: calling monclient init 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.065+0000 7fe556aaf640 10 monclient: init 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient: _add_conns ranks=[8,3,2,0,5,6,1,4,7] 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe55006ff10 0x7fe550130370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): picked mon.noname-e con 0x7fe55006ff10 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5500a0920 0x7fe5501308b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): picked mon.noname-g con 0x7fe5500a0920 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe5501cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): picked mon.noname-b con 0x7fe55013ad90 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe550130df0 con 0x7fe55013ad90 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe550070a70 con 0x7fe5500a0920 2024-03-27T21:30:22.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fe55009c4f0 con 0x7fe55006ff10 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe55006ff10 0x7fe550130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe556aaf640 10 monclient(hunting): authenticate will time out at 844.373957s 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5500a0920 0x7fe5501308b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5500a0920 0x7fe5501308b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.28:54930/0 (socket says 172.21.15.28:54930) 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 -- 172.21.15.28:0/154935491 learned_addr learned my addr 172.21.15.28:0/154935491 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): get_auth_request con 0x7fe5500a0920 auth_method 0 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe5501cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): get_auth_request con 0x7fe55006ff10 auth_method 0 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): get_auth_request con 0x7fe55013ad90 auth_method 0 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55504c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe55484b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient(hunting): handle_auth_done global_id 4296 payload 824 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 -- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe55006ff10 msgr2=0x7fe550130370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe55006ff10 0x7fe550130370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 -- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 msgr2=0x7fe5501cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe55013ad90 0x7fe5501cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 monclient: found mon.noname-g 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 -- 172.21.15.28:0/154935491 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009a70 con 0x7fe5500a0920 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.066+0000 7fe54ffff640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5500a0920 0x7fe5501308b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c450 tx=0x7fe53c00c910 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 client.?.objecter ms_handle_connect 0x7fe5500a0920 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe53c0011e0 con 0x7fe5500a0920 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: dump: 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.105 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c012630 con 0x7fe5500a0920 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 5 monclient: authenticate success, global_id 4296 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 10 monclient: _renew_subs 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe550070640 con 0x7fe5500a0920 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe53c012c10 con 0x7fe5500a0920 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54effd640 4 set_mon_vals no callback set 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe54d7fa640 10 monclient: dump: 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.107 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 10 monclient: _renew_subs 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55009c210 con 0x7fe5500a0920 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.067+0000 7fe556aaf640 1 librados: init done 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe556aaf640 10 client.4296.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe556aaf640 15 client.4296.objecter _session_command_op_assign -1 1 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe556aaf640 20 client.4296.objecter _get_session osd=-1 returning homeless 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe556aaf640 10 client.4296.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe556aaf640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe55013d6c0 con 0x7fe5500a0920 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.068+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== mon.3 v2:172.21.15.63:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fe53c0127a0 con 0x7fe5500a0920 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe53403a250 0x7fe53403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== mon.3 v2:172.21.15.63:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fe53c049aa0 con 0x7fe5500a0920 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 10 client.4296.objecter ms_dispatch 0x7fe550000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 3 client.4296.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 3 client.4296.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 10 client.4296.objecter checking command 1 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fe534040060 0x7fe534042480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 20 client.4296.objecter _get_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 15 client.4296.objecter _session_command_op_remove -1 1 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 20 client.4296.objecter _get_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 20 client.4296.objecter get_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 15 client.4296.objecter _session_command_op_assign 1 1 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 4 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 10 client.4296.objecter _send_command 1 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 --> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe534042b30 con 0x7fe534040060 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 20 client.4296.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== mon.3 v2:172.21.15.63:3301/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe53c04e2a0 con 0x7fe5500a0920 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe55484b640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe53403a250 0x7fe53403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe55484b640 10 monclient: get_auth_request con 0x7fe53403a250 auth_method 0 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe55504c640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fe534040060 0x7fe534042480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe55504c640 10 monclient: get_auth_request con 0x7fe534040060 auth_method 0 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe55504c640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fe534040060 0x7fe534042480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe54d7fa640 10 client.4296.objecter ms_handle_connect 0x7fe534040060 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.069+0000 7fe55484b640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe53403a250 0x7fe53403c710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe544005880 tx=0x7fe544007cf0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.070+0000 7fe54d7fa640 10 client.4296.objecter ms_handle_connect 0x7fe53403a250 2024-03-27T21:30:22.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.070+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== osd.1 v2:172.21.15.28:6800/33279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fe534042b30 con 0x7fe534040060 2024-03-27T21:30:22.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.070+0000 7fe54d7fa640 10 client.4296.objecter ms_dispatch 0x7fe550000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:30:22.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.071+0000 7fe54d7fa640 10 client.4296.objecter _finish_command 1 = system:0 2024-03-27T21:30:22.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.071+0000 7fe54d7fa640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 4 2024-03-27T21:30:22.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.071+0000 7fe54d7fa640 15 client.4296.objecter _session_command_op_remove 1 1 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.079+0000 7f887e149640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.079+0000 7f887e149640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.079+0000 7f887e149640 10 monclient: monmap: 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.081436+0000 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.081436+0000 2024-03-27T21:30:22.115 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.080+0000 7f887e149640 1 Processor -- start 2024-03-27T21:30:22.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.080+0000 7f887e149640 1 -- start start 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.080+0000 7f887e149640 10 monclient: init 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient: _add_conns ranks=[10,1,4,9,5,2,6,0,3,8,7] 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8878136d00 0x7f88781370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): picked mon.noname-f con 0x7f8878136d00 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f88780a3d70 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f8878137620 0x7f88781340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8878136d00 0x7f88781370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): picked mon.noname-c con 0x7f8878137620 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f8877fff640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f8878137620 0x7f88781340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8878136d00 0x7f88781370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:37906/0 (socket says 172.21.15.28:37906) 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f8876ffd640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f88780a3d70 0x7f88781339e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.28:38586/0 (socket says 172.21.15.28:38586) 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 1 -- 172.21.15.28:0/753219848 learned_addr learned my addr 172.21.15.28:0/753219848 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780618f0 con 0x7f88780a3d70 2024-03-27T21:30:22.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780a25b0 con 0x7f8878136d00 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88780a13f0 con 0x7f8878137620 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f887e149640 10 monclient(hunting): authenticate will time out at 844.389634s 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 10 monclient(hunting): get_auth_request con 0x7f8878136d00 auth_method 0 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.081+0000 7f88777fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): get_auth_request con 0x7f8878137620 auth_method 0 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 1 -- 172.21.15.28:0/753219848 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260153109 0 0) 0x7f88780618f0 con 0x7f88780a3d70 2024-03-27T21:30:22.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 10 monclient(hunting): _negotiate 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 10 monclient(hunting): my global_id is 4375 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 1 -- 172.21.15.28:0/753219848 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8860003520 con 0x7f88780a3d70 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient(hunting): handle_auth_done global_id 4216 payload 274 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 1 -- 172.21.15.28:0/753219848 >> v2:172.21.15.63:3300/0 conn(0x7f8878136d00 msgr2=0x7f88781370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 1 --2- 172.21.15.28:0/753219848 >> v2:172.21.15.63:3300/0 conn(0x7f8878136d00 0x7f88781370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 1 -- 172.21.15.28:0/753219848 >> v1:172.21.15.63:6789/0 conn(0x7f88780a3d70 legacy=0x7f88781339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 1 monclient: found mon.noname-c 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 1 -- 172.21.15.28:0/753219848 <== mon.1 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3816734502 0 0) 0x7f8860003520 con 0x7f88780a3d70 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f8877fff640 1 -- 172.21.15.28:0/753219848 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780a1f60 con 0x7f8878137620 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.082+0000 7f88767fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f8877fff640 1 --2- 172.21.15.28:0/753219848 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f8878137620 0x7f88781340f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887002bce0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=abdae2d92f5d5b32 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7fb69288f640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7fb69288f640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 1 -- 172.21.15.28:0/753219848 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f886c001900 con 0x7f8878137620 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7fb69288f640 10 monclient: monmap: 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.085074+0000 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.085074+0000 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.121 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.122 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: dump: 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.123 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.124 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f887e149640 5 monclient: authenticate success, global_id 4216 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f887e149640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 1 -- 172.21.15.28:0/753219848 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887002c810 con 0x7f8878137620 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 1 -- 172.21.15.28:0/753219848 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f88700327b0 con 0x7f8878137620 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f88767fc640 10 monclient: dump: 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.125 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f887e149640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.083+0000 7f887e149640 4 set_mon_vals no callback set 2024-03-27T21:30:22.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7fb69288f640 1 Processor -- start 2024-03-27T21:30:22.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7fb69288f640 1 -- start start 2024-03-27T21:30:22.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7fb69288f640 10 monclient: init 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 10 monclient: shutdown 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f8878137620 msgr2=0x7f88781340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 --2- 172.21.15.28:0/753219848 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f8878137620 0x7f88781340f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887002bce0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 shutdown_connections 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 --2- 172.21.15.28:0/753219848 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f8878137620 0x7f88781340f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 --2- 172.21.15.28:0/753219848 >> v2:172.21.15.63:3300/0 conn(0x7f8878136d00 0x7f88781370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 >> 172.21.15.28:0/753219848 conn(0x7f88780a9430 msgr2=0x7f88780a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 shutdown_connections 2024-03-27T21:30:22.128 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7f887e149640 1 -- 172.21.15.28:0/753219848 wait complete. 2024-03-27T21:30:22.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7fb69288f640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.084+0000 7fb69288f640 10 monclient: _add_conns ranks=[10,6,4,1,8,5,9,3,2,7,0] 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 0x7fb68c1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): picked mon.noname-f con 0x7fb68c136d00 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 0x7fb68c137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): picked mon.noname-d con 0x7fb68c0a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 0x7fb68c133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 0x7fb68c1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 0x7fb68c1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:37912/0 (socket says 172.21.15.28:37912) 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 0x7fb68c137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 0x7fb68c137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43310/0 (socket says 172.21.15.28:43310) 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7f887e149640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7f887e149640 10 monclient: monmap: 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.131 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.132 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.132 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.132 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb690e2c640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 0x7fb68c133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb690e2c640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 0x7fb68c133e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48394/0 (socket says 172.21.15.28:48394) 2024-03-27T21:30:22.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): picked mon.noname-c con 0x7fb68c1339e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fdf59cb6640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fdf59cb6640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68bfff640 1 -- 172.21.15.28:0/1334918643 learned_addr learned my addr 172.21.15.28:0/1334918643 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fdf59cb6640 10 monclient: monmap: 2024-03-27T21:30:22.133 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.087393+0000 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.087393+0000 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.134 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.135 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.135 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0a25b0 con 0x7fb68c136d00 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c137b60 con 0x7fb68c1339e0 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0a13f0 con 0x7fb68c0a3d70 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb69288f640 10 monclient(hunting): authenticate will time out at 844.393526s 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7f887e149640 1 librados: starting msgr at 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7f887e149640 1 librados: starting objecter 2024-03-27T21:30:22.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7f887e149640 1 Processor -- start 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): get_auth_request con 0x7fb68c0a3d70 auth_method 0 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb690e2c640 10 monclient(hunting): get_auth_request con 0x7fb68c1339e0 auth_method 0 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb690e2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb690e2c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb690e2c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.085+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7f887e149640 1 -- start start 2024-03-27T21:30:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7f887e149640 1 librados: setting wanted keys 2024-03-27T21:30:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7f887e149640 1 librados: calling monclient init 2024-03-27T21:30:22.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7f887e149640 10 monclient: init 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb690e2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb690e2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb690e2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68bfff640 10 monclient(hunting): get_auth_request con 0x7fb68c136d00 auth_method 0 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_done global_id 4218 payload 274 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 1 -- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 msgr2=0x7fb68c133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 1 --2- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 0x7fb68c133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 1 -- 172.21.15.28:0/1334918643 >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 msgr2=0x7fb68c1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 1 --2- 172.21.15.28:0/1334918643 >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 0x7fb68c1370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 1 monclient: found mon.noname-d 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68b7fe640 1 -- 172.21.15.28:0/1334918643 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c0618f0 con 0x7fb68c0a3d70 2024-03-27T21:30:22.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fb68bfff640 1 --2- 172.21.15.28:0/1334918643 >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 0x7fb68c1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fdf59cb6640 1 Processor -- start 2024-03-27T21:30:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fdf59cb6640 1 -- start start 2024-03-27T21:30:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7fdf59cb6640 10 monclient: init 2024-03-27T21:30:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7f887e149640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.086+0000 7f887e149640 10 monclient: _add_conns ranks=[7,0,8,3,2,6,1,4,5] 2024-03-27T21:30:22.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fb690e2c640 1 --2- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 0x7fb68c133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f88780a3d70 0x7f887809ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): picked mon.noname-i con 0x7f88780a3d70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8878136d00 0x7f887809bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): picked mon.noname-a con 0x7f8878136d00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:22.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f8878137620 0x7f887809c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient: _add_conns ranks=[2,0,10,3,9,7,1,6,5,4,8] 2024-03-27T21:30:22.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 0x7fdf54134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8878136d00 0x7f887809bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): picked mon.noname-e con 0x7f8878137620 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887809e1e0 con 0x7f8878136d00 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f88780a1630 con 0x7f88780a3d70 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8878136d00 0x7f887809bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38446/0 (socket says 172.21.15.28:38446) 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f887809db20 con 0x7f8878137620 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 1 -- 172.21.15.28:0/1020958620 learned_addr learned my addr 172.21.15.28:0/1020958620 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f887e149640 10 monclient(hunting): authenticate will time out at 844.395187s 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f8878137620 0x7f887809c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f88777fe640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f88780a3d70 0x7f887809ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f88777fe640 10 monclient(hunting): get_auth_request con 0x7f88780a3d70 auth_method 0 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f88777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f88777fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f88777fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): get_auth_request con 0x7f8878136d00 auth_method 0 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): get_auth_request con 0x7f8878137620 auth_method 0 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fb68b7fe640 1 --2- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 0x7fb68c137620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6800097a0 tx=0x7fb68002b6f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c736de7729b6903b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8876ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 10 monclient(hunting): handle_auth_done global_id 4229 payload 824 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 1 -- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f88780a3d70 msgr2=0x7f887809ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7f8877fff640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f88780a3d70 0x7f887809ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 1 -- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8878136d00 msgr2=0x7f887809bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8878136d00 0x7f887809bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 1 monclient: found mon.noname-e 2024-03-27T21:30:22.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): picked mon.noname-b con 0x7fdf5409ed40 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdf5409f120 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdf5409f580 0x7fdf540a1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): picked mon.noname-f con 0x7fdf5409f580 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf540618f0 con 0x7fdf5409f120 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf5409d300 con 0x7fdf5409f580 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5409c070 con 0x7fdf5409ed40 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf59cb6640 10 monclient(hunting): authenticate will time out at 844.395182s 2024-03-27T21:30:22.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 0x7fdf54134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 1 -- 172.21.15.28:0/1334918643 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb680030980 con 0x7fb68c0a3d70 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 0x7fdf54134fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36444/0 (socket says 172.21.15.28:36444) 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 1 -- 172.21.15.28:0/76275195 learned_addr learned my addr 172.21.15.28:0/76275195 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): get_auth_request con 0x7fdf5409ed40 auth_method 0 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.087+0000 7fdf537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf53fff640 1 --2- 172.21.15.28:0/76275195 >> v2:172.21.15.63:3300/0 conn(0x7fdf5409f580 0x7fdf540a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 10 monclient(hunting): handle_auth_done global_id 4223 payload 274 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 1 -- 172.21.15.28:0/76275195 >> v2:172.21.15.63:3300/0 conn(0x7fdf5409f580 msgr2=0x7fdf540a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 1 --2- 172.21.15.28:0/76275195 >> v2:172.21.15.63:3300/0 conn(0x7fdf5409f580 0x7fdf540a1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: dump: 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.153 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.154 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 1 -- 172.21.15.28:0/76275195 >> v1:172.21.15.28:6789/0 conn(0x7fdf5409f120 legacy=0x7fdf540a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 1 monclient: found mon.noname-b 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fdf537fe640 1 -- 172.21.15.28:0/76275195 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54099070 con 0x7fdf5409ed40 2024-03-27T21:30:22.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 1 -- 172.21.15.28:0/1334918643 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68002e050 con 0x7fb68c0a3d70 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 1 -- 172.21.15.28:0/1334918643 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb6800313a0 con 0x7fb68c0a3d70 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb68affd640 10 monclient: dump: 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.156 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb69288f640 5 monclient: authenticate success, global_id 4218 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb69288f640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7fb69288f640 4 set_mon_vals no callback set 2024-03-27T21:30:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 1 -- 172.21.15.28:0/1020958620 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870009a70 con 0x7f8878137620 2024-03-27T21:30:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f8877fff640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f8878137620 0x7f887809c4b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8870033000 tx=0x7f8870004a40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f885ffff640 10 client.?.objecter ms_handle_connect 0x7f8878137620 2024-03-27T21:30:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.088+0000 7f885ffff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf537fe640 1 --2- 172.21.15.28:0/76275195 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 0x7fdf54134fc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdf44013db0 tx=0x7fdf44033ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=beb6f9cf42bc354c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8870009450 con 0x7f8878137620 2024-03-27T21:30:22.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: dump: 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.160 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 1 -- 172.21.15.28:0/76275195 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdf44034ba0 con 0x7fdf5409ed40 2024-03-27T21:30:22.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887002de50 con 0x7f8878137620 2024-03-27T21:30:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f88700046c0 con 0x7f8878137620 2024-03-27T21:30:22.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 10 monclient: shutdown 2024-03-27T21:30:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 msgr2=0x7fb68c137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 1 --2- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 0x7fb68c137620 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6800097a0 tx=0x7fb68002b6f0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f885ffff640 10 monclient: dump: 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.164 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f8875ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 5 monclient: authenticate success, global_id 4229 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 10 monclient: _renew_subs 2024-03-27T21:30:22.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 shutdown_connections 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 1 --2- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb68c1339e0 0x7fb68c133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 1 --2- 172.21.15.28:0/1334918643 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c0a3d70 0x7fb68c137620 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fb69288f640 1 --2- 172.21.15.28:0/1334918643 >> v2:172.21.15.63:3300/0 conn(0x7fb68c136d00 0x7fb68c1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 >> 172.21.15.28:0/1334918643 conn(0x7fb68c0a9430 msgr2=0x7fb68c0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 1 -- 172.21.15.28:0/1020958620 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88780a11e0 con 0x7f8878137620 2024-03-27T21:30:22.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 10 client.4229.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 10 monclient: _renew_subs 2024-03-27T21:30:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 1 -- 172.21.15.28:0/1020958620 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887809d610 con 0x7f8878137620 2024-03-27T21:30:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7f887e149640 1 librados: init done 2024-03-27T21:30:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 shutdown_connections 2024-03-27T21:30:22.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fb69288f640 1 -- 172.21.15.28:0/1334918643 wait complete. 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: dump: 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.168 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 1 -- 172.21.15.28:0/76275195 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf44034d20 con 0x7fdf5409ed40 2024-03-27T21:30:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885dffb640 10 client.4229.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885dffb640 15 client.4229.objecter _session_command_op_assign -1 1 2024-03-27T21:30:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885dffb640 20 client.4229.objecter _get_session osd=-1 returning homeless 2024-03-27T21:30:22.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885dffb640 10 client.4229.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 1 -- 172.21.15.28:0/76275195 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdf4403ac20 con 0x7fdf5409ed40 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f8870004250 con 0x7f8878137620 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf527fc640 10 monclient: dump: 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.171 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.172 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885dffb640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8878137a70 con 0x7f8878137620 2024-03-27T21:30:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf59cb6640 5 monclient: authenticate success, global_id 4223 2024-03-27T21:30:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf59cb6640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.089+0000 7fdf59cb6640 4 set_mon_vals no callback set 2024-03-27T21:30:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f886403a250 0x7f886403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 10 monclient: shutdown 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 10 monclient: monmap: 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.175 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 -- 172.21.15.28:0/76275195 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 msgr2=0x7fdf54134fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f887006c860 con 0x7f8878137620 2024-03-27T21:30:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 10 client.4229.objecter ms_dispatch 0x7f8878000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 3 client.4229.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 3 client.4229.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 10 client.4229.objecter checking command 1 2024-03-27T21:30:22.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f8864040060 0x7f8864042480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 20 client.4229.objecter _get_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 15 client.4229.objecter _session_command_op_remove -1 1 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 20 client.4229.objecter _get_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 20 client.4229.objecter get_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 15 client.4229.objecter _session_command_op_assign 0 1 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 4 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 10 client.4229.objecter _send_command 1 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 --> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8864042b30 con 0x7f8864040060 2024-03-27T21:30:22.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 20 client.4229.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 --2- 172.21.15.28:0/76275195 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 0x7fdf54134fc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdf44013db0 tx=0x7fdf44033ff0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 -- 172.21.15.28:0/76275195 shutdown_connections 2024-03-27T21:30:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 1 librados: starting msgr at 2024-03-27T21:30:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== mon.8 v2:172.21.15.28:3304/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8870004820 con 0x7f8878137620 2024-03-27T21:30:22.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:30:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 1 librados: starting objecter 2024-03-27T21:30:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f8876ffd640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f8864040060 0x7f8864042480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 --2- 172.21.15.28:0/76275195 >> v2:172.21.15.63:3300/0 conn(0x7fdf5409f580 0x7fdf540a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f8876ffd640 10 monclient: get_auth_request con 0x7f8864040060 auth_method 0 2024-03-27T21:30:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 --2- 172.21.15.28:0/76275195 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdf5409ed40 0x7fdf54134fc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f88777fe640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f886403a250 0x7f886403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f88777fe640 10 monclient: get_auth_request con 0x7f886403a250 auth_method 0 2024-03-27T21:30:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 -- 172.21.15.28:0/76275195 >> 172.21.15.28:0/76275195 conn(0x7fdf540a2040 msgr2=0x7fdf540a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 -- 172.21.15.28:0/76275195 shutdown_connections 2024-03-27T21:30:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.090+0000 7fdf59cb6640 1 -- 172.21.15.28:0/76275195 wait complete. 2024-03-27T21:30:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 1 Processor -- start 2024-03-27T21:30:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 1 -- start start 2024-03-27T21:30:22.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f885ffff640 10 client.4229.objecter ms_handle_connect 0x7f8864040060 2024-03-27T21:30:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 1 librados: setting wanted keys 2024-03-27T21:30:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 1 librados: calling monclient init 2024-03-27T21:30:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7fb69288f640 10 monclient: init 2024-03-27T21:30:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.091+0000 7f8876ffd640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f8864040060 0x7f8864042480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f885ffff640 10 client.4229.objecter ms_handle_connect 0x7f886403a250 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f88777fe640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f886403a250 0x7f886403c710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8868009b60 tx=0x7f8868008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fdf59cb6640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fdf59cb6640 10 monclient: monmap: 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.184 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.185 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient: _add_conns ranks=[8,7,6,0,5,3,4,1,2] 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb68c0a3d70 0x7fb68c1cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): picked mon.noname-e con 0x7fb68c0a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb68c1339e0 0x7fb68c132a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): picked mon.noname-i con 0x7fb68c1339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c136d00 0x7fb68c132fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): picked mon.noname-d con 0x7fb68c136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c1cc020 con 0x7fb68c136d00 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c11ff10 con 0x7fb68c1339e0 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0a1630 con 0x7fb68c0a3d70 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb69288f640 10 monclient(hunting): authenticate will time out at 844.400384s 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== osd.0 v2:172.21.15.28:6801/33278 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f8864042b30 con 0x7f8864040060 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f885ffff640 10 client.4229.objecter ms_dispatch 0x7f8878000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:30:22.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f885ffff640 10 client.4229.objecter _finish_command 1 = system:0 2024-03-27T21:30:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f885ffff640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 4 2024-03-27T21:30:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7f885ffff640 15 client.4229.objecter _session_command_op_remove 0 1 2024-03-27T21:30:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb68c1339e0 0x7fb68c132a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fdf59cb6640 1 librados: starting msgr at 2024-03-27T21:30:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fdf59cb6640 1 librados: starting objecter 2024-03-27T21:30:22.189 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb690e2c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c136d00 0x7fb68c132fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fdf59cb6640 1 Processor -- start 2024-03-27T21:30:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 10 client.4296.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-03-27T21:30:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 15 client.4296.objecter _session_command_op_assign -1 2 2024-03-27T21:30:22.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 20 client.4296.objecter _get_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 20 client.4296.objecter _get_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 15 client.4296.objecter _session_command_op_remove -1 2 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 20 client.4296.objecter get_session s=0x7fe53403f990 osd=1 3 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 15 client.4296.objecter _session_command_op_assign 1 2 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 4 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 10 client.4296.objecter _send_command 2 2024-03-27T21:30:22.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 --> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe55009c710 con 0x7fe534040060 2024-03-27T21:30:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb68c1339e0 0x7fb68c132a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3303/0 says I am v2:172.21.15.28:35882/0 (socket says 172.21.15.28:35882) 2024-03-27T21:30:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 1 -- 172.21.15.28:0/3895741660 learned_addr learned my addr 172.21.15.28:0/3895741660 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb690e2c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c136d00 0x7fb68c132fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43318/0 (socket says 172.21.15.28:43318) 2024-03-27T21:30:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): get_auth_request con 0x7fb68c1339e0 auth_method 0 2024-03-27T21:30:22.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb690e2c640 10 monclient(hunting): get_auth_request con 0x7fb68c136d00 auth_method 0 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb690e2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb690e2c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb690e2c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68bfff640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb68c0a3d70 0x7fb68c1cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68bfff640 10 monclient(hunting): get_auth_request con 0x7fb68c0a3d70 auth_method 0 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.092+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb690e2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb690e2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb690e2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 10 monclient(hunting): handle_auth_done global_id 4309 payload 824 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 -- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb68c0a3d70 msgr2=0x7fb68c1cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 -- start start 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 librados: setting wanted keys 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 librados: calling monclient init 2024-03-27T21:30:22.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient: init 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb68c0a3d70 0x7fb68c1cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 -- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c136d00 msgr2=0x7fb68c132fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c136d00 0x7fb68c132fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 monclient: found mon.noname-i 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:30:22.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 -- 172.21.15.28:0/3895741660 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684009a70 con 0x7fb68c1339e0 2024-03-27T21:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe54d7fa640 1 -- 172.21.15.28:0/154935491 <== osd.1 v2:172.21.15.28:6800/33279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe55009c710 con 0x7fe534040060 2024-03-27T21:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe54d7fa640 10 client.4296.objecter ms_dispatch 0x7fe550000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe54d7fa640 10 client.4296.objecter _finish_command 2 = system:0 2024-03-27T21:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe54d7fa640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 4 2024-03-27T21:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe54d7fa640 15 client.4296.objecter _session_command_op_remove 1 2 2024-03-27T21:30:22.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68bfff640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb68c0a3d70 0x7fb68c1cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb690e2c640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb68c136d00 0x7fb68c132fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb68b7fe640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb68c1339e0 0x7fb68c132a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb6800096f0 tx=0x7fb6800046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb688ff9640 10 client.?.objecter ms_handle_connect 0x7fb68c1339e0 2024-03-27T21:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fb688ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient: _add_conns ranks=[8,0,7,6,1,4,5,3,2] 2024-03-27T21:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdf5409ed40 0x7fdf54070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): picked mon.noname-e con 0x7fdf5409ed40 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf5409f120 0x7fdf54070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 10 librados: watch_flush enter 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 10 librados: watch_flush exit 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 10 client.4296.objecter close_session for osd.1 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fe534040060 msgr2=0x7fe534042480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fe534040060 0x7fe534042480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 20 client.4296.objecter put_session s=0x7fe53403f990 osd=1 1 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): picked mon.noname-a con 0x7fdf5409f120 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:22.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 20 client.4296.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fe556aaf640 10 client.4296.objecter successfully canceled tick 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdf5409f580 0x7fdf540714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): picked mon.noname-i con 0x7fdf5409f580 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541315c0 con 0x7fdf5409f120 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5412ac80 con 0x7fdf5409f580 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5409c220 con 0x7fdf5409ed40 2024-03-27T21:30:22.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf59cb6640 10 monclient(hunting): authenticate will time out at 844.401554s 2024-03-27T21:30:22.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb680030980 con 0x7fb68c1339e0 2024-03-27T21:30:22.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: dump: 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.202 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680030b20 con 0x7fb68c1339e0 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb680030c90 con 0x7fb68c1339e0 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe53403a250 msgr2=0x7fe53403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe53403a250 0x7fe53403c710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe544005880 tx=0x7fe544007cf0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 10 monclient: shutdown 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5500a0920 msgr2=0x7fe5501308b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 --2- 172.21.15.28:0/154935491 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5500a0920 0x7fe5501308b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c450 tx=0x7fe53c00c910 comp rx=0 tx=0).stop 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb688ff9640 10 monclient: dump: 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.204 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 5 monclient: authenticate success, global_id 4309 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 10 monclient: _renew_subs 2024-03-27T21:30:22.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe55504c640 1 -- 172.21.15.28:0/154935491 reap_dead start 2024-03-27T21:30:22.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb680009400 con 0x7fb68c1339e0 2024-03-27T21:30:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb68a7fc640 4 set_mon_vals no callback set 2024-03-27T21:30:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 10 client.4309.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 10 monclient: _renew_subs 2024-03-27T21:30:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c0a11e0 con 0x7fb68c1339e0 2024-03-27T21:30:22.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf537fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdf5409ed40 0x7fdf54070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.093+0000 7fdf537fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdf5409ed40 0x7fdf54070a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42342/0 (socket says 172.21.15.28:42342) 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 -- 172.21.15.28:0/4148328411 learned_addr learned my addr 172.21.15.28:0/4148328411 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): get_auth_request con 0x7fdf5409ed40 auth_method 0 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf52ffd640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf5409f120 0x7fdf54070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf52ffd640 10 monclient(hunting): get_auth_request con 0x7fdf5409f120 auth_method 0 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf52ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf52ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient(hunting): handle_auth_done global_id 4247 payload 824 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 -- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdf5409f580 msgr2=0x7fdf540714e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdf5409f580 0x7fdf540714e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 -- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf5409f120 msgr2=0x7fdf54070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdf5409f120 0x7fdf54070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 monclient: found mon.noname-e 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 -- 172.21.15.28:0/4148328411 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44013a10 con 0x7fdf5409ed40 2024-03-27T21:30:22.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fb69288f640 1 librados: init done 2024-03-27T21:30:22.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf537fe640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdf5409ed40 0x7fdf54070a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdf44013ed0 tx=0x7fdf440046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 shutdown_connections 2024-03-27T21:30:22.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 >> 172.21.15.28:0/154935491 conn(0x7fe5500a7810 msgr2=0x7fe55009f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 shutdown_connections 2024-03-27T21:30:22.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 -- 172.21.15.28:0/154935491 wait complete. 2024-03-27T21:30:22.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fe556aaf640 1 librados: shutdown 2024-03-27T21:30:22.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb69288f640 10 client.4309.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb69288f640 15 client.4309.objecter _session_command_op_assign -1 1 2024-03-27T21:30:22.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb69288f640 20 client.4309.objecter _get_session osd=-1 returning homeless 2024-03-27T21:30:22.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb69288f640 10 client.4309.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb69288f640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:22.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb68c0a3020 con 0x7fb68c1339e0 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf3bfff640 10 client.?.objecter ms_handle_connect 0x7fdf5409ed40 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf3bfff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdf440044c0 con 0x7fdf5409ed40 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf3bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf3bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.094+0000 7fdf3bfff640 10 monclient: dump: 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.212 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 5 monclient: authenticate success, global_id 4247 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 10 monclient: _renew_subs 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf5409bcd0 con 0x7fdf5409ed40 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf44051460 con 0x7fdf5409ed40 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdf440478b0 con 0x7fdf5409ed40 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 10 client.4247.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf3bfff640 10 monclient: dump: 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.214 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 10 monclient: _renew_subs 2024-03-27T21:30:22.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== mon.7 v2:172.21.15.63:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fb680039070 con 0x7fb68c1339e0 2024-03-27T21:30:22.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf5412c060 con 0x7fdf5409ed40 2024-03-27T21:30:22.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf59cb6640 1 librados: init done 2024-03-27T21:30:22.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fdf51ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:22.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.095+0000 7fb688ff9640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb67803a280 0x7fb67803c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== mon.7 v2:172.21.15.63:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fb68006bcc0 con 0x7fb68c1339e0 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 10 client.4309.objecter ms_dispatch 0x7fb68c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 3 client.4309.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 3 client.4309.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 10 client.4309.objecter checking command 1 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7fb678040110 0x7fb678042530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb68bfff640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb67803a280 0x7fb67803c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 20 client.4309.objecter _get_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 15 client.4309.objecter _session_command_op_remove -1 1 2024-03-27T21:30:22.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7f59e02ae640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7f59e02ae640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 20 client.4309.objecter _get_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 20 client.4309.objecter get_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 15 client.4309.objecter _session_command_op_assign 3 1 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 4 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 10 client.4309.objecter _send_command 1 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 --> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb678042be0 con 0x7fb678040110 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 20 client.4309.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== mon.7 v2:172.21.15.63:3303/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb68006e260 con 0x7fb68c1339e0 2024-03-27T21:30:22.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb68bfff640 10 monclient: get_auth_request con 0x7fb67803a280 auth_method 0 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7f59e02ae640 10 monclient: monmap: 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.098092+0000 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.098092+0000 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.219 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb690e2c640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7fb678040110 0x7fb678042530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb690e2c640 10 monclient: get_auth_request con 0x7fb678040110 auth_method 0 2024-03-27T21:30:22.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fdf44043040 con 0x7fdf5409ed40 2024-03-27T21:30:22.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf59cb6640 10 client.4247.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf59cb6640 15 client.4247.objecter _session_command_op_assign -1 1 2024-03-27T21:30:22.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf59cb6640 20 client.4247.objecter _get_session osd=-1 returning homeless 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf59cb6640 10 client.4247.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf59cb6640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdf540a2e70 con 0x7fdf5409ed40 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fdf3bfff640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdf4003a280 0x7fdf4003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fdf44074190 con 0x7fdf5409ed40 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 10 client.4247.objecter ms_dispatch 0x7fdf54000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 3 client.4247.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 3 client.4247.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb688ff9640 10 client.4309.objecter ms_handle_connect 0x7fb678040110 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.096+0000 7fb690e2c640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7fb678040110 0x7fb678042530 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb688ff9640 10 client.4309.objecter ms_handle_connect 0x7fb67803a280 2024-03-27T21:30:22.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 10 client.4247.objecter checking command 1 2024-03-27T21:30:22.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fdf40040090 0x7fdf400424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb68bfff640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb67803a280 0x7fb67803c740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00cd30 tx=0x7fb67c008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 20 client.4247.objecter _get_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 15 client.4247.objecter _session_command_op_remove -1 1 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 20 client.4247.objecter _get_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 20 client.4247.objecter get_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 15 client.4247.objecter _session_command_op_assign 2 1 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 4 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 10 client.4247.objecter _send_command 1 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 --> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf40042b60 con 0x7fdf40040090 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 20 client.4247.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== mon.8 v2:172.21.15.28:3304/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf4403a930 con 0x7fdf5409ed40 2024-03-27T21:30:22.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf52ffd640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdf4003a280 0x7fdf4003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:30:22.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf52ffd640 10 monclient: get_auth_request con 0x7fdf4003a280 auth_method 0 2024-03-27T21:30:22.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7f59e02ae640 1 Processor -- start 2024-03-27T21:30:22.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf53fff640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fdf40040090 0x7fdf400424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf53fff640 10 monclient: get_auth_request con 0x7fdf40040090 auth_method 0 2024-03-27T21:30:22.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7f59e02ae640 1 -- start start 2024-03-27T21:30:22.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7f59e02ae640 10 monclient: init 2024-03-27T21:30:22.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== osd.3 v2:172.21.15.63:6802/33504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fb678042be0 con 0x7fb678040110 2024-03-27T21:30:22.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb688ff9640 10 client.4309.objecter ms_dispatch 0x7fb68c000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:30:22.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf3bfff640 10 client.4247.objecter ms_handle_connect 0x7fdf40040090 2024-03-27T21:30:22.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fdf53fff640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fdf40040090 0x7fdf400424b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb688ff9640 10 client.4309.objecter _finish_command 1 = system:0 2024-03-27T21:30:22.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb688ff9640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 4 2024-03-27T21:30:22.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.097+0000 7fb688ff9640 15 client.4309.objecter _session_command_op_remove 3 1 2024-03-27T21:30:22.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf52ffd640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdf4003a280 0x7fdf4003c740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf54071ef0 tx=0x7fdf48009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf3bfff640 10 client.4247.objecter ms_handle_connect 0x7fdf4003a280 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient: _add_conns ranks=[2,10,3,4,1,8,7,6,0,9,5] 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 0x7f59d81370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): picked mon.noname-b con 0x7f59d8136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 0x7f59d81370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 0x7f59d81370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36450/0 (socket says 172.21.15.28:36450) 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 1 -- 172.21.15.28:0/2269620404 learned_addr learned my addr 172.21.15.28:0/2269620404 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 1 --2- 172.21.15.28:0/2269620404 >> v2:172.21.15.63:3300/0 conn(0x7f59d80a3d70 0x7f59d8137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): picked mon.noname-f con 0x7f59d80a3d70 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:22.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d81339e0 0x7f59d8133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== osd.2 v2:172.21.15.28:6816/33280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fdf40042b60 con 0x7fdf40040090 2024-03-27T21:30:22.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf3bfff640 10 client.4247.objecter ms_dispatch 0x7fdf54000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:30:22.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf3bfff640 10 client.4247.objecter _finish_command 1 = system:0 2024-03-27T21:30:22.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf3bfff640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 4 2024-03-27T21:30:22.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7fdf3bfff640 15 client.4247.objecter _session_command_op_remove 2 1 2024-03-27T21:30:22.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): picked mon.noname-g con 0x7f59d81339e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80a25b0 con 0x7f59d80a3d70 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8137b60 con 0x7f59d8136d00 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80a13f0 con 0x7f59d81339e0 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59e02ae640 10 monclient(hunting): authenticate will time out at 844.406576s 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 10 monclient(hunting): get_auth_request con 0x7f59d8136d00 auth_method 0 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.098+0000 7f59de04a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 1 --2- 172.21.15.28:0/2269620404 >> v2:172.21.15.63:3300/0 conn(0x7f59d80a3d70 0x7f59d8137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d81339e0 0x7f59d8133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): get_auth_request con 0x7f59d80a3d70 auth_method 0 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): get_auth_request con 0x7f59d81339e0 auth_method 0 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de84b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 10 monclient(hunting): handle_auth_done global_id 4232 payload 274 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 1 -- 172.21.15.28:0/2269620404 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d81339e0 msgr2=0x7f59d8133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d81339e0 0x7f59d8133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 1 -- 172.21.15.28:0/2269620404 >> v2:172.21.15.63:3300/0 conn(0x7f59d80a3d70 msgr2=0x7f59d8137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 1 --2- 172.21.15.28:0/2269620404 >> v2:172.21.15.63:3300/0 conn(0x7f59d80a3d70 0x7f59d8137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 1 monclient: found mon.noname-b 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59de04a640 1 -- 172.21.15.28:0/2269620404 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d80618f0 con 0x7f59d8136d00 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.099+0000 7f59dd849640 1 --2- 172.21.15.28:0/2269620404 >> v2:172.21.15.63:3300/0 conn(0x7f59d80a3d70 0x7f59d8137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.100+0000 7f59de04a640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 0x7f59d81370e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009e50 tx=0x7f59d402bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af34325b5ade21db server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.100+0000 7f59dd048640 1 -- 172.21.15.28:0/2269620404 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59d402cbc0 con 0x7f59d8136d00 2024-03-27T21:30:22.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.100+0000 7f59dd048640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.100+0000 7f59dd048640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: dump: 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.247 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 1 -- 172.21.15.28:0/2269620404 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d402cd40 con 0x7f59d8136d00 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 1 -- 172.21.15.28:0/2269620404 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59d4034860 con 0x7f59d8136d00 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59dd048640 10 monclient: dump: 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.248 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 5 monclient: authenticate success, global_id 4232 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 4 set_mon_vals no callback set 2024-03-27T21:30:22.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 10 monclient: shutdown 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 msgr2=0x7f59d81370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.101+0000 7f59e02ae640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 0x7f59d81370e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009e50 tx=0x7f59d402bdb0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 shutdown_connections 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d81339e0 0x7f59d8133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 --2- 172.21.15.28:0/2269620404 >> v2:172.21.15.63:3300/0 conn(0x7f59d80a3d70 0x7f59d8137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 --2- 172.21.15.28:0/2269620404 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d8136d00 0x7f59d81370e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 >> 172.21.15.28:0/2269620404 conn(0x7f59d80a9430 msgr2=0x7f59d80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 shutdown_connections 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.102+0000 7f59e02ae640 1 -- 172.21.15.28:0/2269620404 wait complete. 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 10 monclient: monmap: 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.250 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 1 librados: starting msgr at 2024-03-27T21:30:22.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 1 librados: starting objecter 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 1 Processor -- start 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 1 -- start start 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 1 librados: setting wanted keys 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 1 librados: calling monclient init 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.103+0000 7f59e02ae640 10 monclient: init 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 10 monclient: _add_conns ranks=[3,8,6,2,7,5,1,4,0] 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d80a3d70 0x7f59d8131d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 10 monclient(hunting): picked mon.noname-g con 0x7f59d80a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f59d81339e0 0x7f59d81322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 10 monclient(hunting): picked mon.noname-e con 0x7f59d81339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d8136d00 0x7f59d81c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.104+0000 7f59e02ae640 10 monclient(hunting): picked mon.noname-d con 0x7f59d8136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d809ddf0 con 0x7f59d80a3d70 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d8136d00 0x7f59d81c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d8136d00 0x7f59d81c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43330/0 (socket says 172.21.15.28:43330) 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 1 -- 172.21.15.28:0/768853950 learned_addr learned my addr 172.21.15.28:0/768853950 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8132800 con 0x7f59d8136d00 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f59d81339e0 0x7f59d81322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d80a3d70 0x7f59d8131d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80a1630 con 0x7f59d81339e0 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59e02ae640 10 monclient(hunting): authenticate will time out at 844.412944s 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): get_auth_request con 0x7f59d8136d00 auth_method 0 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): get_auth_request con 0x7f59d81339e0 auth_method 0 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): get_auth_request con 0x7f59d80a3d70 auth_method 0 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59dd849640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient(hunting): handle_auth_done global_id 4314 payload 824 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 -- 172.21.15.28:0/768853950 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f59d81339e0 msgr2=0x7f59d81322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f59d81339e0 0x7f59d81322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 -- 172.21.15.28:0/768853950 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d8136d00 msgr2=0x7f59d81c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d8136d00 0x7f59d81c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 monclient: found mon.noname-g 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8009400 con 0x7f59d80a3d70 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de84b640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d8136d00 0x7f59d81c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59de04a640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d80a3d70 0x7f59d8131d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f59d4032000 tx=0x7f59d4004a40 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59ceffd640 10 client.?.objecter ms_handle_connect 0x7f59d80a3d70 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.105+0000 7f59ceffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59d402cbb0 con 0x7f59d80a3d70 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: dump: 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.256 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4009510 con 0x7f59d80a3d70 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59d403ed00 con 0x7f59d80a3d70 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59ceffd640 10 monclient: dump: 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.257 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59dc847640 4 set_mon_vals no callback set 2024-03-27T21:30:22.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 5 monclient: authenticate success, global_id 4314 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 10 monclient: _renew_subs 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d4009b30 con 0x7f59d80a3d70 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 10 client.4314.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 10 monclient: _renew_subs 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d809e690 con 0x7f59d80a3d70 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.106+0000 7f59e02ae640 1 librados: init done 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== mon.3 v2:172.21.15.63:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f59d4004600 con 0x7f59d80a3d70 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a280 0x7f59bc03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== mon.3 v2:172.21.15.63:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f59d406cef0 con 0x7f59d80a3d70 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 10 client.4314.objecter ms_dispatch 0x7f59d8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 3 client.4314.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 3 client.4314.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.107+0000 7f59ceffd640 20 client.4314.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59dd849640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a280 0x7f59bc03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59dd849640 10 monclient: get_auth_request con 0x7f59bc03a280 auth_method 0 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 10 client.4314.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 15 client.4314.objecter _session_command_op_assign -1 1 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7f59d81c7790 0x7f59d80a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 20 client.4314.objecter _get_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 20 client.4314.objecter _get_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 15 client.4314.objecter _session_command_op_remove -1 1 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 20 client.4314.objecter get_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 15 client.4314.objecter _session_command_op_assign 5 1 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 4 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 10 client.4314.objecter _send_command 1 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59d80a2240 con 0x7f59d81c7790 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59de84b640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7f59d81c7790 0x7f59d80a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59de84b640 10 monclient: get_auth_request con 0x7f59d81c7790 auth_method 0 2024-03-27T21:30:22.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59ceffd640 10 client.4314.objecter ms_handle_connect 0x7f59bc03a280 2024-03-27T21:30:22.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59dd849640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a280 0x7f59bc03c740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f59d809bea0 tx=0x7f59c8016040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59ceffd640 10 client.4314.objecter ms_handle_connect 0x7f59d81c7790 2024-03-27T21:30:22.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.108+0000 7f59de84b640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7f59d81c7790 0x7f59d80a6e40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.261 INFO:teuthology.orchestra.run.smithi028.stdout:47244640259 2024-03-27T21:30:22.262 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-27T21:30:22.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.109+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== osd.5 v2:172.21.15.63:6800/33506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f59d0009cd0 con 0x7f59d81c7790 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.109+0000 7f59ceffd640 10 client.4314.objecter ms_dispatch 0x7f59d8000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.109+0000 7f59ceffd640 10 client.4314.objecter _finish_command 1 = system:0 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.109+0000 7f59ceffd640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 4 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.109+0000 7f59ceffd640 15 client.4314.objecter _session_command_op_remove 5 1 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 10 client.4229.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 15 client.4229.objecter _session_command_op_assign -1 2 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 20 client.4229.objecter _get_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 20 client.4229.objecter _get_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 15 client.4229.objecter _session_command_op_remove -1 2 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 20 client.4229.objecter get_session s=0x7f886403f990 osd=0 3 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 15 client.4229.objecter _session_command_op_assign 0 2 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 4 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 10 client.4229.objecter _send_command 2 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 --> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f88780a3020 con 0x7f8864040060 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885ffff640 1 -- 172.21.15.28:0/1020958620 <== osd.0 v2:172.21.15.28:6801/33278 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f886c0047e0 con 0x7f8864040060 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885ffff640 10 client.4229.objecter ms_dispatch 0x7f8878000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885ffff640 10 client.4229.objecter _finish_command 2 = system:0 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885ffff640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 4 2024-03-27T21:30:22.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.114+0000 7f885ffff640 15 client.4229.objecter _session_command_op_remove 0 2 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 10 librados: watch_flush enter 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 10 librados: watch_flush exit 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 10 client.4229.objecter close_session for osd.0 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f8864040060 msgr2=0x7f8864042480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f8864040060 0x7f8864042480 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 20 client.4229.objecter put_session s=0x7f886403f990 osd=0 1 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 20 client.4229.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 10 client.4229.objecter successfully canceled tick 2024-03-27T21:30:22.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f886403a250 msgr2=0x7f886403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f886403a250 0x7f886403c710 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8868009b60 tx=0x7f8868008040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 10 monclient: shutdown 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f8878137620 msgr2=0x7f887809c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 --2- 172.21.15.28:0/1020958620 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f8878137620 0x7f887809c4b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8870033000 tx=0x7f8870004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f8877fff640 1 -- 172.21.15.28:0/1020958620 reap_dead start 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 shutdown_connections 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 >> 172.21.15.28:0/1020958620 conn(0x7f88780a9430 msgr2=0x7f8878134f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 shutdown_connections 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 -- 172.21.15.28:0/1020958620 wait complete. 2024-03-27T21:30:22.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.115+0000 7f885dffb640 1 librados: shutdown 2024-03-27T21:30:22.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 10 client.4309.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 15 client.4309.objecter _session_command_op_assign -1 2 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 20 client.4309.objecter _get_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 20 client.4309.objecter _get_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 15 client.4309.objecter _session_command_op_remove -1 2 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 20 client.4309.objecter get_session s=0x7fb67803fa40 osd=3 3 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 15 client.4309.objecter _session_command_op_assign 3 2 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 4 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 10 client.4309.objecter _send_command 2 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.120+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 --> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb68c0a2240 con 0x7fb678040110 2024-03-27T21:30:22.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb688ff9640 1 -- 172.21.15.28:0/3895741660 <== osd.3 v2:172.21.15.63:6802/33504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb68400f040 con 0x7fb678040110 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb688ff9640 10 client.4309.objecter ms_dispatch 0x7fb68c000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb688ff9640 10 client.4309.objecter _finish_command 2 = system:0 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb688ff9640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 4 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb688ff9640 15 client.4309.objecter _session_command_op_remove 3 2 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 10 librados: watch_flush enter 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 10 librados: watch_flush exit 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 10 client.4309.objecter close_session for osd.3 2024-03-27T21:30:22.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7fb678040110 msgr2=0x7fb678042530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7fb678040110 0x7fb678042530 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 20 client.4309.objecter put_session s=0x7fb67803fa40 osd=3 1 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 20 client.4309.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 10 client.4309.objecter successfully canceled tick 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb67803a280 msgr2=0x7fb67803c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb67803a280 0x7fb67803c740 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00cd30 tx=0x7fb67c008040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 10 monclient: shutdown 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb68c1339e0 msgr2=0x7fb68c132a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.121+0000 7fb69288f640 1 --2- 172.21.15.28:0/3895741660 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb68c1339e0 0x7fb68c132a60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb6800096f0 tx=0x7fb6800046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.122+0000 7fb690e2c640 1 -- 172.21.15.28:0/3895741660 reap_dead start 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.122+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 shutdown_connections 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.122+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 >> 172.21.15.28:0/3895741660 conn(0x7fb68c0a9430 msgr2=0x7fb68c0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.122+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 shutdown_connections 2024-03-27T21:30:22.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.122+0000 7fb69288f640 1 -- 172.21.15.28:0/3895741660 wait complete. 2024-03-27T21:30:22.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.122+0000 7fb69288f640 1 librados: shutdown 2024-03-27T21:30:22.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 10 client.4314.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 15 client.4314.objecter _session_command_op_assign -1 2 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 20 client.4314.objecter _get_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 20 client.4314.objecter _get_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 15 client.4314.objecter _session_command_op_remove -1 2 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 20 client.4314.objecter get_session s=0x7f59d80a3020 osd=5 3 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 15 client.4314.objecter _session_command_op_assign 5 2 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 4 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 10 client.4314.objecter _send_command 2 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 --> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59d809feb0 con 0x7f59d81c7790 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59ceffd640 1 -- 172.21.15.28:0/768853950 <== osd.5 v2:172.21.15.63:6800/33506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59d0016420 con 0x7f59d81c7790 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59ceffd640 10 client.4314.objecter ms_dispatch 0x7f59d8000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59ceffd640 10 client.4314.objecter _finish_command 2 = system:0 2024-03-27T21:30:22.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59ceffd640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 4 2024-03-27T21:30:22.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.123+0000 7f59ceffd640 15 client.4314.objecter _session_command_op_remove 5 2 2024-03-27T21:30:22.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 10 librados: watch_flush enter 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 10 librados: watch_flush exit 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 10 client.4314.objecter close_session for osd.5 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7f59d81c7790 msgr2=0x7f59d80a6e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7f59d81c7790 0x7f59d80a6e40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 20 client.4314.objecter put_session s=0x7f59d80a3020 osd=5 1 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 20 client.4314.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 10 client.4314.objecter successfully canceled tick 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a280 msgr2=0x7f59bc03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a280 0x7f59bc03c740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f59d809bea0 tx=0x7f59c8016040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 10 monclient: shutdown 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d80a3d70 msgr2=0x7f59d8131d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 --2- 172.21.15.28:0/768853950 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f59d80a3d70 0x7f59d8131d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f59d4032000 tx=0x7f59d4004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59de84b640 1 -- 172.21.15.28:0/768853950 reap_dead start 2024-03-27T21:30:22.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 shutdown_connections 2024-03-27T21:30:22.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.124+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 >> 172.21.15.28:0/768853950 conn(0x7f59d80a9430 msgr2=0x7f59d80662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.125+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 shutdown_connections 2024-03-27T21:30:22.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.125+0000 7f59e02ae640 1 -- 172.21.15.28:0/768853950 wait complete. 2024-03-27T21:30:22.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.125+0000 7f59e02ae640 1 librados: shutdown 2024-03-27T21:30:22.278 INFO:teuthology.orchestra.run.smithi028.stdout:47244640258 2024-03-27T21:30:22.279 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-27T21:30:22.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 10 client.4247.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 15 client.4247.objecter _session_command_op_assign -1 2 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 20 client.4247.objecter _get_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 20 client.4247.objecter _get_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 15 client.4247.objecter _session_command_op_remove -1 2 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 20 client.4247.objecter get_session s=0x7fdf4003f9c0 osd=2 3 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 15 client.4247.objecter _session_command_op_assign 2 2 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 4 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 10 client.4247.objecter _send_command 2 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 --> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf54135500 con 0x7fdf40040090 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.129+0000 7fdf3bfff640 1 -- 172.21.15.28:0/4148328411 <== osd.2 v2:172.21.15.28:6816/33280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf4c007890 con 0x7fdf40040090 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf3bfff640 10 client.4247.objecter ms_dispatch 0x7fdf54000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf3bfff640 10 client.4247.objecter _finish_command 2 = system:0 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf3bfff640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 4 2024-03-27T21:30:22.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf3bfff640 15 client.4247.objecter _session_command_op_remove 2 2 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 10 librados: watch_flush enter 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 10 librados: watch_flush exit 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 10 client.4247.objecter close_session for osd.2 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fdf40040090 msgr2=0x7fdf400424b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fdf40040090 0x7fdf400424b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 20 client.4247.objecter put_session s=0x7fdf4003f9c0 osd=2 1 2024-03-27T21:30:22.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 20 client.4247.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 10 client.4247.objecter successfully canceled tick 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdf4003a280 msgr2=0x7fdf4003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdf4003a280 0x7fdf4003c740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdf54071ef0 tx=0x7fdf48009040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 10 monclient: shutdown 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdf5409ed40 msgr2=0x7fdf54070a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 --2- 172.21.15.28:0/4148328411 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdf5409ed40 0x7fdf54070a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdf44013ed0 tx=0x7fdf440046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf53fff640 1 -- 172.21.15.28:0/4148328411 reap_dead start 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 shutdown_connections 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 >> 172.21.15.28:0/4148328411 conn(0x7fdf540a2040 msgr2=0x7fdf54098680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 shutdown_connections 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 -- 172.21.15.28:0/4148328411 wait complete. 2024-03-27T21:30:22.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.130+0000 7fdf59cb6640 1 librados: shutdown 2024-03-27T21:30:22.284 INFO:teuthology.orchestra.run.smithi028.stdout:51539607555 2024-03-27T21:30:22.284 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-27T21:30:22.285 INFO:teuthology.orchestra.run.smithi028.stdout:47244640259 2024-03-27T21:30:22.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-27T21:30:22.286 INFO:teuthology.orchestra.run.smithi028.stdout:47244640258 2024-03-27T21:30:22.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.260+0000 7f2989d9b640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.260+0000 7f2989d9b640 10 monclient: get_auth_request con 0x7f296c03fe80 auth_method 0 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f297affd640 10 client.4211.objecter ms_handle_connect 0x7f296c03fe80 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f2989d9b640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== osd.4 v2:172.21.15.63:6816/33505 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f296c042950 con 0x7f296c03fe80 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f297affd640 10 client.4211.objecter ms_dispatch 0x7f298c000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f297affd640 10 client.4211.objecter _finish_command 1 = system:0 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f297affd640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 4 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.261+0000 7f297affd640 15 client.4211.objecter _session_command_op_remove 4 1 2024-03-27T21:30:22.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 10 client.4211.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 15 client.4211.objecter _session_command_op_assign -1 2 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 20 client.4211.objecter _get_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 20 client.4211.objecter _get_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 15 client.4211.objecter _session_command_op_remove -1 2 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 20 client.4211.objecter get_session s=0x7f298400f040 osd=4 3 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 15 client.4211.objecter _session_command_op_assign 4 2 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 4 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 10 client.4211.objecter _send_command 2 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.274+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 --> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f298c0a2240 con 0x7f296c03fe80 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f297affd640 1 -- 172.21.15.28:0/3398445358 <== osd.4 v2:172.21.15.63:6816/33505 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f298000c040 con 0x7f296c03fe80 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f297affd640 10 client.4211.objecter ms_dispatch 0x7f298c000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f297affd640 10 client.4211.objecter _finish_command 2 = system:0 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f297affd640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 4 2024-03-27T21:30:22.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f297affd640 15 client.4211.objecter _session_command_op_remove 4 2 2024-03-27T21:30:22.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 10 librados: watch_flush enter 2024-03-27T21:30:22.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 10 librados: watch_flush exit 2024-03-27T21:30:22.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 10 client.4211.objecter close_session for osd.4 2024-03-27T21:30:22.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 msgr2=0x7f296c0422a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7f296c03fe80 0x7f296c0422a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 20 client.4211.objecter put_session s=0x7f298400f040 osd=4 1 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 20 client.4211.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 10 client.4211.objecter successfully canceled tick 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f296c03a1e0 msgr2=0x7f296c03c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f296c03a1e0 0x7f296c03c6a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f297c03d000 tx=0x7f297c038000 comp rx=0 tx=0).stop 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 10 monclient: shutdown 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c136d00 msgr2=0x7f298c1c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 --2- 172.21.15.28:0/3398445358 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f298c136d00 0x7f298c1c77c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2984007e60 tx=0x7f298400d4a0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f298ad9d640 1 -- 172.21.15.28:0/3398445358 reap_dead start 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 shutdown_connections 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 >> 172.21.15.28:0/3398445358 conn(0x7f298c0a9430 msgr2=0x7f298c0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 shutdown_connections 2024-03-27T21:30:22.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 -- 172.21.15.28:0/3398445358 wait complete. 2024-03-27T21:30:22.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.275+0000 7f299085c640 1 librados: shutdown 2024-03-27T21:30:22.293 INFO:teuthology.orchestra.run.smithi028.stdout:51539607556 2024-03-27T21:30:22.293 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-27T21:30:22.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.442+0000 7f5c76eaf640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.442+0000 7f5c76eaf640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.442+0000 7f5c76eaf640 10 monclient: monmap: 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.443700+0000 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.443700+0000 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.432 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.433 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.433 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.433 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.433 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.433 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.443+0000 7f5c76eaf640 1 Processor -- start 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.443+0000 7f5c76eaf640 1 -- start start 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.443+0000 7f5c76eaf640 10 monclient: init 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient: _add_conns ranks=[4,1,2,6,10,9,3,7,5,8,0] 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c70099540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): picked mon.noname-c con 0x7f5c70066b10 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5c70099a80 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c7013c700 0x7f5c7013eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): picked mon.noname-b con 0x7f5c7013c700 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700618f0 con 0x7f5c70099a80 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7009a990 con 0x7f5c7013c700 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7009b650 con 0x7f5c70066b10 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c76eaf640 10 monclient(hunting): authenticate will time out at 844.751182s 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c70099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c70099540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48402/0 (socket says 172.21.15.28:48402) 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 1 -- 172.21.15.28:0/2095158649 learned_addr learned my addr 172.21.15.28:0/2095158649 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): get_auth_request con 0x7f5c70066b10 auth_method 0 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c7544c640 1 --2- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c7013c700 0x7f5c7013eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c7544c640 10 monclient(hunting): get_auth_request con 0x7f5c7013c700 auth_method 0 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c7544c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c7544c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.444+0000 7f5c7544c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c7544c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c7544c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c7544c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_done global_id 4234 payload 274 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 1 -- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c7013c700 msgr2=0x7f5c7013eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 1 --2- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c7013c700 0x7f5c7013eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 1 -- 172.21.15.28:0/2095158649 >> v1:172.21.15.63:6789/0 conn(0x7f5c70099a80 legacy=0x7f5c70099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 1 monclient: found mon.noname-c 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.445+0000 7f5c74c4b640 1 -- 172.21.15.28:0/2095158649 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7009b230 con 0x7f5c70066b10 2024-03-27T21:30:22.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c74c4b640 1 --2- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c70099540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c640098d0 tx=0x7f5c6402b840 comp rx=0 tx=0).ready entity=mon.4 client_cookie=434c0ffbe02b9cd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f07591a4640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 1 -- 172.21.15.28:0/2095158649 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c6402e070 con 0x7f5c70066b10 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: dump: 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.441 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 1 -- 172.21.15.28:0/2095158649 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c64031a10 con 0x7f5c70066b10 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 1 -- 172.21.15.28:0/2095158649 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c64031c00 con 0x7f5c70066b10 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:22.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c6f7fe640 10 monclient: dump: 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.443 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c76eaf640 5 monclient: authenticate success, global_id 4234 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c76eaf640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f5c76eaf640 4 set_mon_vals no callback set 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f07591a4640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.446+0000 7f07591a4640 10 monclient: monmap: 2024-03-27T21:30:22.444 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.447269+0000 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.447269+0000 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.445 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.446 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 1 Processor -- start 2024-03-27T21:30:22.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 10 monclient: shutdown 2024-03-27T21:30:22.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 1 -- start start 2024-03-27T21:30:22.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient: init 2024-03-27T21:30:22.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 -- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 msgr2=0x7f5c70099540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c70099540 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5c640098d0 tx=0x7f5c6402b840 comp rx=0 tx=0).stop 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 -- 172.21.15.28:0/2095158649 shutdown_connections 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c7013c700 0x7f5c7013eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/2095158649 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c70099540 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 -- 172.21.15.28:0/2095158649 >> 172.21.15.28:0/2095158649 conn(0x7f5c700a2040 msgr2=0x7f5c700a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 -- 172.21.15.28:0/2095158649 shutdown_connections 2024-03-27T21:30:22.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f5c76eaf640 1 -- 172.21.15.28:0/2095158649 wait complete. 2024-03-27T21:30:22.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient: _add_conns ranks=[8,10,7,1,5,2,9,0,6,4,3] 2024-03-27T21:30:22.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 0x7f07541370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient(hunting): picked mon.noname-e con 0x7f0754136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540a3d70 0x7f0754137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient(hunting): picked mon.noname-f con 0x7f07540a3d70 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f07541339e0 0x7f0754133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient(hunting): picked mon.noname-i con 0x7f07541339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.447+0000 7f07591a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07540a25b0 con 0x7f07540a3d70 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0754137b60 con 0x7f07541339e0 2024-03-27T21:30:22.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f07540a13f0 con 0x7f0754136d00 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 10 monclient: monmap: 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.451 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.452 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f07591a4640 10 monclient(hunting): authenticate will time out at 844.754742s 2024-03-27T21:30:22.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540a3d70 0x7f0754137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 0x7f07541370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07540a3d70 0x7f0754137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:37928/0 (socket says 172.21.15.28:37928) 2024-03-27T21:30:22.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 1 librados: starting msgr at 2024-03-27T21:30:22.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 1 librados: starting objecter 2024-03-27T21:30:22.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 0x7f07541370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42372/0 (socket says 172.21.15.28:42372) 2024-03-27T21:30:22.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 1 -- 172.21.15.28:0/987506167 learned_addr learned my addr 172.21.15.28:0/987506167 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 1 Processor -- start 2024-03-27T21:30:22.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): get_auth_request con 0x7f07540a3d70 auth_method 0 2024-03-27T21:30:22.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 1 -- start start 2024-03-27T21:30:22.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 1 librados: setting wanted keys 2024-03-27T21:30:22.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 1 librados: calling monclient init 2024-03-27T21:30:22.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f5c76eaf640 10 monclient: init 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075359e640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f07541339e0 0x7f0754133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075359e640 10 monclient(hunting): get_auth_request con 0x7f07541339e0 auth_method 0 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075359e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075359e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): get_auth_request con 0x7f0754136d00 auth_method 0 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f075259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient(hunting): handle_auth_done global_id 4265 payload 274 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 -- 172.21.15.28:0/987506167 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f07541339e0 msgr2=0x7f0754133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f07541339e0 0x7f0754133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 -- 172.21.15.28:0/987506167 >> v2:172.21.15.63:3300/0 conn(0x7f07540a3d70 msgr2=0x7f0754137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 --2- 172.21.15.28:0/987506167 >> v2:172.21.15.63:3300/0 conn(0x7f07540a3d70 0x7f0754137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 monclient: found mon.noname-e 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.448+0000 7f0752d9d640 1 -- 172.21.15.28:0/987506167 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540618f0 con 0x7f0754136d00 2024-03-27T21:30:22.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f075359e640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f07541339e0 0x7f0754133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient: _add_conns ranks=[4,3,1,5,6,0,2,8,7] 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c7006e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): picked mon.noname-c con 0x7f5c70066b10 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c70099a80 0x7f5c7006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): picked mon.noname-g con 0x7f5c70099a80 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c7013c700 0x7f5c7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): picked mon.noname-f con 0x7f5c7013c700 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c70137860 con 0x7f5c7013c700 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7006aec0 con 0x7f5c70099a80 2024-03-27T21:30:22.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c701370e0 con 0x7f5c70066b10 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c76eaf640 10 monclient(hunting): authenticate will time out at 844.756348s 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c7006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c7006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48412/0 (socket says 172.21.15.28:48412) 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 1 -- 172.21.15.28:0/3732580579 learned_addr learned my addr 172.21.15.28:0/3732580579 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): get_auth_request con 0x7f5c70066b10 auth_method 0 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c7544c640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c7013c700 0x7f5c7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c7544c640 10 monclient(hunting): get_auth_request con 0x7f5c7013c700 auth_method 0 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c7544c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c7544c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.449+0000 7f5c7544c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c7544c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c7544c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c7544c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 10 monclient(hunting): handle_auth_done global_id 4243 payload 824 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 -- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c70099a80 msgr2=0x7f5c7006e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c70099a80 0x7f5c7006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 -- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c7013c700 msgr2=0x7f5c7006edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c7013c700 0x7f5c7006edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 monclient: found mon.noname-c 2024-03-27T21:30:22.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0752d9d640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 0x7f07541370e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07440097a0 tx=0x7f074402b6f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1761d94c547b4f40 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 -- 172.21.15.28:0/3732580579 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640094d0 con 0x7f5c70066b10 2024-03-27T21:30:22.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 1 -- 172.21.15.28:0/987506167 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0744030980 con 0x7f0754136d00 2024-03-27T21:30:22.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c74c4b640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c7006e330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5c640097c0 tx=0x7f5c640046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 client.?.objecter ms_handle_connect 0x7f5c70066b10 2024-03-27T21:30:22.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: dump: 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.467 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 1 -- 172.21.15.28:0/987506167 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074402e050 con 0x7f0754136d00 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c64004250 con 0x7f5c70066b10 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: dump: 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.469 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6403f070 con 0x7f5c70066b10 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c640043b0 con 0x7f5c70066b10 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6e7fc640 4 set_mon_vals no callback set 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c6d7fa640 10 monclient: dump: 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.471 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c76eaf640 5 monclient: authenticate success, global_id 4243 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c76eaf640 10 monclient: _renew_subs 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c76eaf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c70067140 con 0x7f5c70066b10 2024-03-27T21:30:22.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f5c76eaf640 10 client.4243.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f5c76eaf640 10 monclient: _renew_subs 2024-03-27T21:30:22.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f5c76eaf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c70070780 con 0x7f5c70066b10 2024-03-27T21:30:22.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f5c76eaf640 1 librados: init done 2024-03-27T21:30:22.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 1 -- 172.21.15.28:0/987506167 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f07440313a0 con 0x7f0754136d00 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f0751d9b640 10 monclient: dump: 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.475 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f07591a4640 5 monclient: authenticate success, global_id 4265 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f07591a4640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.450+0000 7f07591a4640 4 set_mon_vals no callback set 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 10 monclient: shutdown 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 -- 172.21.15.28:0/987506167 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 msgr2=0x7f07541370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 0x7f07541370e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f07440097a0 tx=0x7f074402b6f0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 -- 172.21.15.28:0/987506167 shutdown_connections 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f07541339e0 0x7f0754133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 --2- 172.21.15.28:0/987506167 >> v2:172.21.15.63:3300/0 conn(0x7f07540a3d70 0x7f0754137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 --2- 172.21.15.28:0/987506167 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f0754136d00 0x7f07541370e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.451+0000 7f07591a4640 1 -- 172.21.15.28:0/987506167 >> 172.21.15.28:0/987506167 conn(0x7f07540a9430 msgr2=0x7f07540a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f5c76eaf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f07591a4640 1 -- 172.21.15.28:0/987506167 shutdown_connections 2024-03-27T21:30:22.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f07591a4640 1 -- 172.21.15.28:0/987506167 wait complete. 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f5c76eaf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f5c76eaf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c70070bb0 con 0x7f5c70066b10 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.452+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f5c64003610 con 0x7f5c70066b10 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c5403a280 0x7f5c5403c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f5c6406b580 con 0x7f5c70066b10 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 10 client.4243.objecter ms_dispatch 0x7f5c70000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 3 client.4243.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 3 client.4243.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 20 client.4243.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6ffff640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c5403a280 0x7f5c5403c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6ffff640 10 monclient: get_auth_request con 0x7f5c5403a280 auth_method 0 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f07591a4640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f07591a4640 10 monclient: monmap: 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.480 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6ffff640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c5403a280 0x7f5c5403c740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c000f60 tx=0x7f5c5c0079b0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.453+0000 7f5c6d7fa640 10 client.4243.objecter ms_handle_connect 0x7f5c5403a280 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 1 librados: starting msgr at 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 1 librados: starting objecter 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 1 Processor -- start 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 1 -- start start 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 1 librados: setting wanted keys 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 1 librados: calling monclient init 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.454+0000 7f07591a4640 10 monclient: init 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 10 monclient: _add_conns ranks=[3,1,0,6,8,4,7,2,5] 2024-03-27T21:30:22.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f07540a3d70 0x7f0754132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 10 monclient(hunting): picked mon.noname-g con 0x7f07540a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 0x7f0754132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 10 monclient(hunting): picked mon.noname-f con 0x7f07541339e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f07591a4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0754136d00 0x7f075409c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.455+0000 7f0752d9d640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f07540a3d70 0x7f0754132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 10 monclient(hunting): picked mon.noname-a con 0x7f0754136d00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07541cbfb0 con 0x7f0754136d00 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075411ff10 con 0x7f07541339e0 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754120440 con 0x7f07540a3d70 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f07591a4640 10 monclient(hunting): authenticate will time out at 844.762806s 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 0x7f0754132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 0x7f0754132fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:37942/0 (socket says 172.21.15.28:37942) 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 -- 172.21.15.28:0/325424209 learned_addr learned my addr 172.21.15.28:0/325424209 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): get_auth_request con 0x7f07541339e0 auth_method 0 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075359e640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0754136d00 0x7f075409c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): get_auth_request con 0x7f07540a3d70 auth_method 0 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075359e640 10 monclient(hunting): get_auth_request con 0x7f0754136d00 auth_method 0 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075359e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075359e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f0752d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient(hunting): handle_auth_done global_id 4438 payload 824 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 -- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f07540a3d70 msgr2=0x7f0754132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f07540a3d70 0x7f0754132a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 -- 172.21.15.28:0/325424209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0754136d00 msgr2=0x7f075409c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0754136d00 0x7f075409c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 monclient: found mon.noname-f 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 -- 172.21.15.28:0/325424209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744009400 con 0x7f07541339e0 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f075259c640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 0x7f0754132fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f074800e870 tx=0x7f074800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f073b7fe640 10 client.?.objecter ms_handle_connect 0x7f07541339e0 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f073b7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f074800cd50 con 0x7f07541339e0 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.456+0000 7f073b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: dump: 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0748013470 con 0x7f07541339e0 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0748013a50 con 0x7f07541339e0 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f073b7fe640 10 monclient: dump: 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.498 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f075159a640 4 set_mon_vals no callback set 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 5 monclient: authenticate success, global_id 4438 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 10 monclient: _renew_subs 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07540a1690 con 0x7f07541339e0 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 10 client.4438.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 10 monclient: _renew_subs 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075409e230 con 0x7f07541339e0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.457+0000 7f07591a4640 1 librados: init done 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.458+0000 7f07591a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.458+0000 7f07591a4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.458+0000 7f07591a4640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.458+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754120080 con 0x7f07541339e0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f0748013bb0 con 0x7f07541339e0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f074003a280 0x7f074003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f074804a310 con 0x7f07541339e0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 10 client.4438.objecter ms_dispatch 0x7f0754000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 3 client.4438.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 3 client.4438.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 20 client.4438.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f0752d9d640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f074003a280 0x7f074003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f0752d9d640 10 monclient: get_auth_request con 0x7f074003a280 auth_method 0 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f073b7fe640 10 client.4438.objecter ms_handle_connect 0x7f074003a280 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.459+0000 7f0752d9d640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f074003a280 0x7f074003c740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0744034000 tx=0x7f0744008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.461+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f5c6403a970 con 0x7f5c70066b10 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.461+0000 7f5c6d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.461+0000 7f5c6d7fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.464+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f07480135e0 con 0x7f07541339e0 2024-03-27T21:30:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.464+0000 7f073b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.464+0000 7f073b7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.489+0000 7fa454910640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.489+0000 7fa454910640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.489+0000 7fa454910640 10 monclient: monmap: 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.490115+0000 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.490115+0000 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.504 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 Processor -- start 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 -- start start 2024-03-27T21:30:22.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient: init 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient: _add_conns ranks=[4,5,1,8,10,6,3,7,2,9,0] 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 0x7fa4480275b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): picked mon.noname-c con 0x7fa4480271d0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa448020ab0 0x7fa448027af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): picked mon.noname-h con 0x7fa448020ab0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa4480bd470 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480042c0 con 0x7fa4480bd470 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa448021b30 con 0x7fa4480271d0 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa448028030 con 0x7fa448020ab0 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa454910640 10 monclient(hunting): authenticate will time out at 844.797429s 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 0x7fa4480275b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 0x7fa4480275b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48416/0 (socket says 172.21.15.28:48416) 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 1 -- 172.21.15.28:0/2049833619 learned_addr learned my addr 172.21.15.28:0/2049833619 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): get_auth_request con 0x7fa4480271d0 auth_method 0 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.490+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44e59c640 1 --2- 172.21.15.28:0/2049833619 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa448020ab0 0x7fa448027af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44e59c640 10 monclient(hunting): get_auth_request con 0x7fa448020ab0 auth_method 0 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_done global_id 4252 payload 274 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 1 -- 172.21.15.28:0/2049833619 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa448020ab0 msgr2=0x7fa448027af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 1 --2- 172.21.15.28:0/2049833619 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa448020ab0 0x7fa448027af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 1 -- 172.21.15.28:0/2049833619 >> v1:172.21.15.63:6789/0 conn(0x7fa4480bd470 legacy=0x7fa4480bd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 1 monclient: found mon.noname-c 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.491+0000 7fa44ed9d640 1 -- 172.21.15.28:0/2049833619 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448007f00 con 0x7fa4480271d0 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fc6a02ed640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fc6a02ed640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fc6a02ed640 10 monclient: monmap: 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.493005+0000 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.493005+0000 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.509 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.510 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44ed9d640 1 --2- 172.21.15.28:0/2049833619 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 0x7fa4480275b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4400098a0 tx=0x7fa44002b7c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=9b0bda49e22361f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 1 -- 172.21.15.28:0/2049833619 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa440031990 con 0x7fa4480271d0 2024-03-27T21:30:22.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fc6a02ed640 1 Processor -- start 2024-03-27T21:30:22.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:22.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: dump: 2024-03-27T21:30:22.512 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.512 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.512 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa454910640 5 monclient: authenticate success, global_id 4252 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa454910640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 1 -- 172.21.15.28:0/2049833619 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440031520 con 0x7fa4480271d0 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa454910640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa454910640 4 set_mon_vals no callback set 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 1 -- 172.21.15.28:0/2049833619 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa440031990 con 0x7fa4480271d0 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.492+0000 7fa44dd9b640 10 monclient: dump: 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.514 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.515 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 10 monclient: shutdown 2024-03-27T21:30:22.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fb5151a9640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fb5151a9640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 -- 172.21.15.28:0/2049833619 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 msgr2=0x7fa4480275b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 --2- 172.21.15.28:0/2049833619 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 0x7fa4480275b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4400098a0 tx=0x7fa44002b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fc6a02ed640 1 -- start start 2024-03-27T21:30:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fc6a02ed640 10 monclient: init 2024-03-27T21:30:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 -- 172.21.15.28:0/2049833619 shutdown_connections 2024-03-27T21:30:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 --2- 172.21.15.28:0/2049833619 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa448020ab0 0x7fa448027af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 --2- 172.21.15.28:0/2049833619 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa4480271d0 0x7fa4480275b0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa4400098a0 tx=0x7fa44002b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 -- 172.21.15.28:0/2049833619 >> 172.21.15.28:0/2049833619 conn(0x7fa4480088e0 msgr2=0x7fa448008cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fb5151a9640 10 monclient: monmap: 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.494272+0000 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.494272+0000 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.518 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 -- 172.21.15.28:0/2049833619 shutdown_connections 2024-03-27T21:30:22.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fa454910640 1 -- 172.21.15.28:0/2049833619 wait complete. 2024-03-27T21:30:22.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fc6a02ed640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.493+0000 7fc6a02ed640 10 monclient: _add_conns ranks=[3,4,2,9,8,1,6,0,5,7,10] 2024-03-27T21:30:22.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 0x7fc6981370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): picked mon.noname-g con 0x7fc698136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fc6980a3d70 0x7fc698137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): picked mon.noname-c con 0x7fc6980a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fc6981339e0 0x7fc698133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): picked mon.noname-b con 0x7fc6981339e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980a25b0 con 0x7fc6981339e0 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc698137b60 con 0x7fc698136d00 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980a13f0 con 0x7fc6980a3d70 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc6a02ed640 10 monclient(hunting): authenticate will time out at 844.800805s 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 0x7fc6981370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 0x7fc6981370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.28:54976/0 (socket says 172.21.15.28:54976) 2024-03-27T21:30:22.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 1 -- 172.21.15.28:0/2303807978 learned_addr learned my addr 172.21.15.28:0/2303807978 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): get_auth_request con 0x7fc698136d00 auth_method 0 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fc6980a3d70 0x7fc698137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): get_auth_request con 0x7fc6980a3d70 auth_method 0 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fb5151a9640 1 Processor -- start 2024-03-27T21:30:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e88a640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fc6981339e0 0x7fc698133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fa454910640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient(hunting): handle_auth_done global_id 4261 payload 274 2024-03-27T21:30:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 -- 172.21.15.28:0/2303807978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 msgr2=0x7fc6981370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 0x7fc6981370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 -- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fc6981339e0 msgr2=0x7fc698133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fc6981339e0 0x7fc698133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 monclient: found mon.noname-c 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69d888640 1 -- 172.21.15.28:0/2303807978 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6980618f0 con 0x7fc6980a3d70 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fa454910640 10 monclient: monmap: 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.525 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.526 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7f295b142640 10 monclient: get_monmap_and_config 2024-03-27T21:30:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7f295b142640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 1 librados: starting msgr at 2024-03-27T21:30:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fc69e089640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 0x7fc6981370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fc69e88a640 10 monclient: get_auth_request con 0x7fc6981339e0 auth_method 0 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fc69e88a640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fc6981339e0 0x7fc698133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 1 librados: starting objecter 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7f295b142640 10 monclient: monmap: 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:22.495816+0000 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:22.495816+0000 2024-03-27T21:30:22.528 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:22.529 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fb5151a9640 1 -- start start 2024-03-27T21:30:22.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.494+0000 7fb5151a9640 10 monclient: init 2024-03-27T21:30:22.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient: _add_conns ranks=[9,5,8,4,6,0,1,3,10,7,2] 2024-03-27T21:30:22.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 1 Processor -- start 2024-03-27T21:30:22.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb510136d00 0x7fb5101370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 1 -- start start 2024-03-27T21:30:22.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): picked mon.noname-a con 0x7fb510136d00 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:22.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 1 librados: setting wanted keys 2024-03-27T21:30:22.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 1 librados: calling monclient init 2024-03-27T21:30:22.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fa454910640 10 monclient: init 2024-03-27T21:30:22.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb5100a3d70 0x7fb510137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): picked mon.noname-h con 0x7fb5100a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5101339e0 0x7fb510133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): picked mon.noname-e con 0x7fb5101339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fc69d888640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fc6980a3d70 0x7fc698137620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc6940097d0 tx=0x7fc69402b6d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=9517f903dd5d6ba2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100a25b0 con 0x7fb510136d00 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb510137b60 con 0x7fb5100a3d70 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100a13f0 con 0x7fb5101339e0 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb5151a9640 10 monclient(hunting): authenticate will time out at 844.802028s 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb510136d00 0x7fb5101370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb510136d00 0x7fb5101370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38468/0 (socket says 172.21.15.28:38468) 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 1 -- 172.21.15.28:0/1700183555 learned_addr learned my addr 172.21.15.28:0/1700183555 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): get_auth_request con 0x7fb510136d00 auth_method 0 2024-03-27T21:30:22.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 1 -- 172.21.15.28:0/2303807978 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc694030980 con 0x7fc6980a3d70 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: dump: 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.535 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 1 -- 172.21.15.28:0/2303807978 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69402e050 con 0x7fc6980a3d70 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 1 -- 172.21.15.28:0/2303807978 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc6940313a0 con 0x7fc6980a3d70 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc69d087640 10 monclient: dump: 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.537 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 Processor -- start 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 -- start start 2024-03-27T21:30:22.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient: init 2024-03-27T21:30:22.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5101339e0 0x7fb510133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa454910640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa454910640 10 monclient: _add_conns ranks=[2,6,5,4,3,0,8,1,7] 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): get_auth_request con 0x7fb5101339e0 auth_method 0 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50e59c640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb5100a3d70 0x7fb510137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.495+0000 7fb50f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 1 -- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5101339e0 msgr2=0x7fb510133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5101339e0 0x7fb510133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 1 -- 172.21.15.28:0/1700183555 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb5100a3d70 msgr2=0x7fb510137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb5100a3d70 0x7fb510137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 1 monclient: found mon.noname-a 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:22.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50ed9d640 1 -- 172.21.15.28:0/1700183555 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5100618f0 con 0x7fb510136d00 2024-03-27T21:30:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa454910640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 0x7fa4480b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50e59c640 10 monclient: get_auth_request con 0x7fb5100a3d70 auth_method 0 2024-03-27T21:30:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fb50e59c640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb5100a3d70 0x7fb510137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:22.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa44ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 0x7fa4480b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc6a02ed640 5 monclient: authenticate success, global_id 4261 2024-03-27T21:30:22.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc6a02ed640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fc6a02ed640 4 set_mon_vals no callback set 2024-03-27T21:30:22.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa44ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 0x7fa4480b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36486/0 (socket says 172.21.15.28:36486) 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa44ed9d640 1 -- 172.21.15.28:0/1807040337 learned_addr learned my addr 172.21.15.28:0/1807040337 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7fa454910640 10 monclient(hunting): picked mon.noname-b con 0x7fa448020ab0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4480bd470 0x7fa4480b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient: _add_conns ranks=[5,8,9,6,10,1,0,2,4,3,7] 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f295413b1e0 0x7f295413b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): picked mon.noname-h con 0x7f295413b1e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 0x7f29540a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): picked mon.noname-e con 0x7f295413bb00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f29540a42b0 0x7f29540a4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): picked mon.noname-a con 0x7f29540a42b0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29540a0870 con 0x7f29540a42b0 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29540a3780 con 0x7f295413b1e0 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f29540a0c80 con 0x7f295413bb00 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.496+0000 7f295b142640 10 monclient(hunting): authenticate will time out at 844.803596s 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2958ede640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f295413b1e0 0x7f295413b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): picked mon.noname-d con 0x7fa4480bd470 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50ed9d640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb510136d00 0x7fb5101370e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009870 tx=0x7fb4f802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825a8cb0842d4dc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa44801be30 0x7fa44801c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.546 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 0x7f29540a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f29540a42b0 0x7f29540a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 0x7f29540a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42394/0 (socket says 172.21.15.28:42394) 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 -- 172.21.15.28:0/523055805 learned_addr learned my addr 172.21.15.28:0/523055805 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): get_auth_request con 0x7f295413bb00 auth_method 0 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): get_auth_request con 0x7f29540a42b0 auth_method 0 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): picked mon.noname-h con 0x7fa44801be30 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4480a69d0 con 0x7fa448020ab0 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa448025120 con 0x7fa44801be30 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa448020f00 con 0x7fa4480bd470 2024-03-27T21:30:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa454910640 10 monclient(hunting): authenticate will time out at 844.804239s 2024-03-27T21:30:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2024-03-27T21:30:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 -- 172.21.15.28:0/523055805 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f295413b1e0 msgr2=0x7f295413b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 --2- 172.21.15.28:0/523055805 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f295413b1e0 0x7f295413b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 1 -- 172.21.15.28:0/1700183555 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb4f8031990 con 0x7fb510136d00 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 10 monclient: shutdown 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fc6980a3d70 msgr2=0x7fc698137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fc6980a3d70 0x7fc698137620 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc6940097d0 tx=0x7fc69402b6d0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: dump: 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.552 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 1 -- 172.21.15.28:0/1700183555 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f8031b10 con 0x7fb510136d00 2024-03-27T21:30:22.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 -- 172.21.15.28:0/523055805 >> v2:172.21.15.28:3300/0 conn(0x7f29540a42b0 msgr2=0x7f29540a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:22.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 --2- 172.21.15.28:0/523055805 >> v2:172.21.15.28:3300/0 conn(0x7f29540a42b0 0x7f29540a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 monclient: found mon.noname-e 2024-03-27T21:30:22.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2953fff640 1 -- 172.21.15.28:0/523055805 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540618f0 con 0x7f295413bb00 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f29596df640 1 --2- 172.21.15.28:0/523055805 >> v2:172.21.15.28:3300/0 conn(0x7f29540a42b0 0x7f29540a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 1 -- 172.21.15.28:0/1700183555 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb4f8031cc0 con 0x7fb510136d00 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2958ede640 10 monclient: get_auth_request con 0x7f295413b1e0 auth_method 0 2024-03-27T21:30:22.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7f2958ede640 1 --2- 172.21.15.28:0/523055805 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f295413b1e0 0x7f295413b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb50dd9b640 10 monclient: dump: 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.556 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2303807978 shutdown_connections 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fc6981339e0 0x7fc698133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fc6980a3d70 0x7fc698137620 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2303807978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc698136d00 0x7fc6981370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2303807978 >> 172.21.15.28:0/2303807978 conn(0x7fc6980a9430 msgr2=0x7fc6980a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fb5151a9640 5 monclient: authenticate success, global_id 4383 2024-03-27T21:30:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 4 set_mon_vals no callback set 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): get_auth_request con 0x7fa448020ab0 auth_method 0 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44f59e640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa44801be30 0x7fa44801c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44e59c640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4480bd470 0x7fa4480b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.497+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44e59c640 10 monclient(hunting): get_auth_request con 0x7fa4480bd470 auth_method 0 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44f59e640 10 monclient(hunting): get_auth_request con 0x7fa44801be30 auth_method 0 2024-03-27T21:30:22.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 10 monclient(hunting): handle_auth_done global_id 4250 payload 824 2024-03-27T21:30:22.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 -- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4480bd470 msgr2=0x7fa4480b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2303807978 shutdown_connections 2024-03-27T21:30:22.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2303807978 wait complete. 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4480bd470 0x7fa4480b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 -- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa44801be30 msgr2=0x7fa44801c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa44801be30 0x7fa44801c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 monclient: found mon.noname-b 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4400094d0 con 0x7fa448020ab0 2024-03-27T21:30:22.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44e59c640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4480bd470 0x7fa4480b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 10 monclient: shutdown 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 -- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb510136d00 msgr2=0x7fb5101370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb510136d00 0x7fb5101370e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009870 tx=0x7fb4f802b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 -- 172.21.15.28:0/1700183555 shutdown_connections 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5101339e0 0x7fb510133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb5100a3d70 0x7fb510137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 --2- 172.21.15.28:0/1700183555 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb510136d00 0x7fb5101370e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 -- 172.21.15.28:0/1700183555 >> 172.21.15.28:0/1700183555 conn(0x7fb5100a9430 msgr2=0x7fb5100a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fb5151a9640 1 -- 172.21.15.28:0/1700183555 shutdown_connections 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fc6a02ed640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fc6a02ed640 10 monclient: monmap: 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.564 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa44ed9d640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 0x7fa4480b74e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4400090b0 tx=0x7fa4400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa4377fe640 10 client.?.objecter ms_handle_connect 0x7fa448020ab0 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.498+0000 7fa4377fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fb5151a9640 1 -- 172.21.15.28:0/1700183555 wait complete. 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa440031990 con 0x7fa448020ab0 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: dump: 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.566 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa440003a80 con 0x7fa448020ab0 2024-03-27T21:30:22.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa454910640 5 monclient: authenticate success, global_id 4250 2024-03-27T21:30:22.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 1 librados: starting msgr at 2024-03-27T21:30:22.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 1 librados: starting objecter 2024-03-27T21:30:22.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa454910640 10 monclient: _renew_subs 2024-03-27T21:30:22.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa454910640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa44801e460 con 0x7fa448020ab0 2024-03-27T21:30:22.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa440003bf0 con 0x7fa448020ab0 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa454910640 10 client.4250.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa4377fe640 10 monclient: dump: 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.569 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 1 Processor -- start 2024-03-27T21:30:22.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7f2953fff640 1 --2- 172.21.15.28:0/523055805 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 0x7f29540a3d70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29400098a0 tx=0x7f294002b7b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a2e8888b15194d79 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fb5151a9640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fb5151a9640 10 monclient: monmap: 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.571 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7f29537fe640 1 -- 172.21.15.28:0/523055805 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2940031980 con 0x7f295413bb00 2024-03-27T21:30:22.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7f29537fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fa44d59a640 4 set_mon_vals no callback set 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7f29537fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7f29537fe640 10 monclient: dump: 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.573 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f29537fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f29537fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f29537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f295b142640 5 monclient: authenticate success, global_id 4283 2024-03-27T21:30:22.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f295b142640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:22.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 1 librados: starting msgr at 2024-03-27T21:30:22.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 1 librados: starting objecter 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 1 -- start start 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 1 librados: setting wanted keys 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 1 librados: calling monclient init 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.499+0000 7fc6a02ed640 10 monclient: init 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient: _add_conns ranks=[3,6,7,1,0,4,2,8,5] 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc6980a3d70 0x7fc6981cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): picked mon.noname-g con 0x7fc6980a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 0x7fc6981d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): picked mon.noname-d con 0x7fc6981339e0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc698136d00 0x7fc69809b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): picked mon.noname-i con 0x7fc698136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6980a11e0 con 0x7fc6980a3d70 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fc698128570 con 0x7fc6981339e0 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fc69809db70 con 0x7fc698136d00 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc6a02ed640 10 monclient(hunting): authenticate will time out at 844.806880s 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 1 Processor -- start 2024-03-27T21:30:22.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 1 -- start start 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 0x7fc6981d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 1 librados: setting wanted keys 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 0x7fc6981d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43354/0 (socket says 172.21.15.28:43354) 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 1 -- 172.21.15.28:0/2058462059 learned_addr learned my addr 172.21.15.28:0/2058462059 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): get_auth_request con 0x7fc6981339e0 auth_method 0 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 1 librados: calling monclient init 2024-03-27T21:30:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fb5151a9640 10 monclient: init 2024-03-27T21:30:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc698136d00 0x7fc69809b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): get_auth_request con 0x7fc698136d00 auth_method 0 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e089640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc6980a3d70 0x7fc6981cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f29537fe640 1 -- 172.21.15.28:0/523055805 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294002f050 con 0x7f295413bb00 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f29537fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f295b142640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:22.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7f295b142640 4 set_mon_vals no callback set 2024-03-27T21:30:22.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e089640 10 monclient(hunting): get_auth_request con 0x7fc6980a3d70 auth_method 0 2024-03-27T21:30:22.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa44003a040 con 0x7fa448020ab0 2024-03-27T21:30:22.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fa4377fe640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa43c03a250 0x7fa43c03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e089640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa454910640 10 monclient: _renew_subs 2024-03-27T21:30:22.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa454910640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44801d890 con 0x7fa448020ab0 2024-03-27T21:30:22.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 10 monclient: shutdown 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 -- 172.21.15.28:0/523055805 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 msgr2=0x7f29540a3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 --2- 172.21.15.28:0/523055805 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 0x7f29540a3d70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29400098a0 tx=0x7f294002b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 -- 172.21.15.28:0/523055805 shutdown_connections 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 --2- 172.21.15.28:0/523055805 >> v2:172.21.15.28:3300/0 conn(0x7f29540a42b0 0x7f29540a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 --2- 172.21.15.28:0/523055805 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f295413bb00 0x7f29540a3d70 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f29400098a0 tx=0x7f294002b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 --2- 172.21.15.28:0/523055805 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f295413b1e0 0x7f295413b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 -- 172.21.15.28:0/523055805 >> 172.21.15.28:0/523055805 conn(0x7f29540a9430 msgr2=0x7f29540a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa44e59c640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa43c03a250 0x7fa43c03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient: _add_conns ranks=[8,6,7,3,0,5,2,4,1] 2024-03-27T21:30:22.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa440033e30 con 0x7fa448020ab0 2024-03-27T21:30:22.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa4377fe640 10 client.4250.objecter ms_dispatch 0x7fa450000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 0x7fb5101c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa44e59c640 10 monclient: get_auth_request con 0x7fa43c03a250 auth_method 0 2024-03-27T21:30:22.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): picked mon.noname-e con 0x7fb5100a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:22.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 0x7fb5101c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa4377fe640 3 client.4250.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa4377fe640 3 client.4250.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa4377fe640 20 client.4250.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 0x7fb5101c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42402/0 (socket says 172.21.15.28:42402) 2024-03-27T21:30:22.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fa454910640 1 librados: init done 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e089640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e089640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69e88a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 10 monclient(hunting): handle_auth_done global_id 4254 payload 824 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.500+0000 7fc69d888640 1 -- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc698136d00 msgr2=0x7fc69809b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc698136d00 0x7fc69809b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 1 -- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc6980a3d70 msgr2=0x7fc6981cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc6980a3d70 0x7fc6981cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 1 monclient: found mon.noname-d 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 1 -- 172.21.15.28:0/2058462059 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6880094d0 con 0x7fc6981339e0 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69d888640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 0x7fc6981d0300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc694035040 tx=0x7fc6940046c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 client.?.objecter ms_handle_connect 0x7fc6981339e0 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc694003ea0 con 0x7fc6981339e0 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: dump: 2024-03-27T21:30:22.588 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6940044c0 con 0x7fc6981339e0 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc694030df0 con 0x7fc6981339e0 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb5101339e0 0x7fb5101c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 1 -- 172.21.15.28:0/714768596 learned_addr learned my addr 172.21.15.28:0/714768596 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): picked mon.noname-d con 0x7fb5101339e0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb5101c7a10 0x7fb5101319c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): picked mon.noname-i con 0x7fb5101c7a10 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fb5101c7e30 con 0x7fb5101339e0 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fb51009e6a0 con 0x7fb5101c7a10 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fb51009e8f0 con 0x7fb5100a3d70 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb5151a9640 10 monclient(hunting): authenticate will time out at 844.808334s 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): get_auth_request con 0x7fb5100a3d70 auth_method 0 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb5101339e0 0x7fb5101c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): get_auth_request con 0x7fb5101339e0 auth_method 0 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7f295b142640 1 -- 172.21.15.28:0/523055805 shutdown_connections 2024-03-27T21:30:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fb50f59e640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb5101c7a10 0x7fb5101319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50f59e640 10 monclient(hunting): get_auth_request con 0x7fb5101c7a10 auth_method 0 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 10 monclient(hunting): handle_auth_done global_id 4263 payload 824 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 -- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 msgr2=0x7fb5101c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 0x7fb5101c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 -- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb5101c7a10 msgr2=0x7fb5101319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb5101c7a10 0x7fb5101319c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 monclient: found mon.noname-d 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80094d0 con 0x7fb5101339e0 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc68effd640 10 monclient: dump: 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.595 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc69c886640 4 set_mon_vals no callback set 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc6a02ed640 5 monclient: authenticate success, global_id 4254 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc6a02ed640 10 monclient: _renew_subs 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc6a02ed640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.501+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc694009400 con 0x7fc6981339e0 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fc6a02ed640 10 client.4254.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fc6a02ed640 10 monclient: _renew_subs 2024-03-27T21:30:22.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fc6a02ed640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc69809ead0 con 0x7fc6981339e0 2024-03-27T21:30:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fc6a02ed640 1 librados: init done 2024-03-27T21:30:22.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7f295b142640 1 -- 172.21.15.28:0/523055805 wait complete. 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50ed9d640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 0x7fb5101c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb50e59c640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb5101339e0 0x7fb5101c74d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb50800cef0 tx=0x7fb50800a710 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb5077fe640 10 client.?.objecter ms_handle_connect 0x7fb5101339e0 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fb5077fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb508007a00 con 0x7fb5101339e0 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: dump: 2024-03-27T21:30:22.598 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fa454910640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fa454910640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fa454910640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.502+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4480a6b10 con 0x7fa448020ab0 2024-03-27T21:30:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 5 monclient: authenticate success, global_id 4263 2024-03-27T21:30:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 10 monclient: _renew_subs 2024-03-27T21:30:22.601 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5100a11e0 con 0x7fb5101339e0 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 10 client.4263.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 10 monclient: _renew_subs 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb51009f870 con 0x7fb5101339e0 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 10 monclient: build_initial_monmap 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 10 monclient: monmap: 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:22.602 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 1 librados: starting msgr at 2024-03-27T21:30:22.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 1 librados: starting objecter 2024-03-27T21:30:22.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 1 Processor -- start 2024-03-27T21:30:22.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fa44e59c640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa43c03a250 0x7fa43c03c710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa448009a00 tx=0x7fa444008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fa4377fe640 10 client.4250.objecter ms_handle_connect 0x7fa43c03a250 2024-03-27T21:30:22.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 1 -- start start 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 1 librados: setting wanted keys 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 1 librados: calling monclient init 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7f295b142640 10 monclient: init 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5151a9640 1 librados: init done 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50800d640 con 0x7fb5101339e0 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb50800dc60 con 0x7fb5101339e0 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb5077fe640 10 monclient: dump: 2024-03-27T21:30:22.605 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.606 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.607 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.503+0000 7fb50cd99640 4 set_mon_vals no callback set 2024-03-27T21:30:22.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fc6a02ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fc6a02ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fc6a02ed640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fb5151a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fb5151a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fb5151a9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f4005040 con 0x7fb5101339e0 2024-03-27T21:30:22.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6981370e0 con 0x7fc6981339e0 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient: _add_conns ranks=[4,3,6,1,8,5,0,7,2] 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f29540a42b0 0x7f29541cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): picked mon.noname-c con 0x7f29540a42b0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f295413b1e0 0x7f295413a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): picked mon.noname-g con 0x7f295413b1e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 0x7f295409b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): picked mon.noname-d con 0x7f295413a950 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295409e110 con 0x7f295413b1e0 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f295409ef90 con 0x7f29540a42b0 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f29540a1270 con 0x7f295413a950 2024-03-27T21:30:22.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:22.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7f295b142640 10 monclient(hunting): authenticate will time out at 844.811532s 2024-03-27T21:30:22.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.504+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fc694030510 con 0x7fc6981339e0 2024-03-27T21:30:22.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 0x7f295409b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f29540a42b0 0x7f29541cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 0x7f295409b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43384/0 (socket says 172.21.15.28:43384) 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 -- 172.21.15.28:0/3332458321 learned_addr learned my addr 172.21.15.28:0/3332458321 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): get_auth_request con 0x7f295413a950 auth_method 0 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): get_auth_request con 0x7f29540a42b0 auth_method 0 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:22.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc68effd640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc67c03a280 0x7fc67c03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fc69406c010 con 0x7fc6981339e0 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc68effd640 10 client.4254.objecter ms_dispatch 0x7fc698000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc68effd640 3 client.4254.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc68effd640 3 client.4254.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc68effd640 20 client.4254.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc69e089640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc67c03a280 0x7fc67c03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fc69e089640 10 monclient: get_auth_request con 0x7fc67c03a280 auth_method 0 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2953fff640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f295413b1e0 0x7f295413a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient(hunting): handle_auth_done global_id 4272 payload 824 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 -- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f29540a42b0 msgr2=0x7f29541cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f29540a42b0 0x7f29541cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 -- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f295413b1e0 msgr2=0x7f295413a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f295413b1e0 0x7f295413a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient: _finish_hunting 0 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 monclient: found mon.noname-d 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 -- 172.21.15.28:0/3332458321 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c009a70 con 0x7f295413a950 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f2958ede640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f29540a42b0 0x7f29541cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29596df640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 0x7f295409b850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f294c00efc0 tx=0x7f294c00c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29517fa640 10 client.?.objecter ms_handle_connect 0x7f295413a950 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7f29517fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fb50800d7f0 con 0x7fb5101339e0 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fb5077fe640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb4f003a250 0x7fb4f003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fb50804a900 con 0x7fb5101339e0 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fb5077fe640 10 client.4263.objecter ms_dispatch 0x7fb510000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fb5077fe640 3 client.4263.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.505+0000 7fb5077fe640 3 client.4263.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fb5077fe640 20 client.4263.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fb50ed9d640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb4f003a250 0x7fb4f003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fb50ed9d640 10 monclient: get_auth_request con 0x7fb4f003a250 auth_method 0 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fc68effd640 10 client.4254.objecter ms_handle_connect 0x7fc67c03a280 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fc69e089640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc67c03a280 0x7fc67c03c740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc688009bd0 tx=0x7fc688008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fb5077fe640 10 client.4263.objecter ms_handle_connect 0x7fb4f003a250 2024-03-27T21:30:22.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.506+0000 7fb50ed9d640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb4f003a250 0x7fb4f003c710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097c0 tx=0x7fb4f8030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.509+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa4480a6b10 con 0x7fa448020ab0 2024-03-27T21:30:22.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.509+0000 7fa4377fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.509+0000 7fa4377fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:22.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.510+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fc69409f580 con 0x7fc6981339e0 2024-03-27T21:30:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.510+0000 7fc68effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.510+0000 7fc68effd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f294c00cd30 con 0x7f295413a950 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: dump: 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.620 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c00f040 con 0x7f295413a950 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f294c014d60 con 0x7f295413a950 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:22.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29517fa640 10 monclient: dump: 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:22.622 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 5 monclient: authenticate success, global_id 4272 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 10 monclient: _renew_subs 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29400094d0 con 0x7f295413a950 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb50800daa0 con 0x7fb5101339e0 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7fb5077fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7fb5077fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f29527fc640 4 set_mon_vals no callback set 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 10 client.4272.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 10 monclient: _renew_subs 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295409fd00 con 0x7f295413a950 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.519+0000 7f295b142640 1 librados: init done 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f294c014480 con 0x7f295413a950 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f293803a250 0x7f293803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f295b142640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f295b142640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f295b142640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29540672e0 con 0x7f295413a950 2024-03-27T21:30:22.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f294c04a710 con 0x7f295413a950 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 10 client.4272.objecter ms_dispatch 0x7f2954000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 3 client.4272.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 3 client.4272.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f29517fa640 20 client.4272.objecter dump_active .. 0 homeless 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.521+0000 7f2958ede640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f293803a250 0x7f293803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.522+0000 7f2958ede640 10 monclient: get_auth_request con 0x7f293803a250 auth_method 0 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.522+0000 7f29517fa640 10 client.4272.objecter ms_handle_connect 0x7f293803a250 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.522+0000 7f2958ede640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f293803a250 0x7f293803c710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f294800ae10 tx=0x7f2948008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.531+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f294c01d460 con 0x7f295413a950 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.531+0000 7f29517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:22.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.531+0000 7f29517fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc6a02ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc6a02ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc6a02ed640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6980672e0 con 0x7fc6981339e0 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc68effd640 1 -- 172.21.15.28:0/2058462059 <== mon.6 v2:172.21.15.28:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc694037020 con 0x7fc6981339e0 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc68effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-03-27T21:30:22.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.707+0000 7fc68effd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:22.697 INFO:teuthology.orchestra.run.smithi028.stdout:51539607554 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 10 librados: watch_flush enter 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 10 librados: watch_flush exit 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 20 client.4254.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 10 client.4254.objecter successfully canceled tick 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc67c03a280 msgr2=0x7fc67c03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc67c03a280 0x7fc67c03c740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc688009bd0 tx=0x7fc688008040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 10 monclient: shutdown 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 msgr2=0x7fc6981d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.709+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 0x7fc6981d0300 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc694035040 tx=0x7fc6940046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 shutdown_connections 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc67c03a280 0x7fc67c03c740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc698136d00 0x7fc69809b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fc6981339e0 0x7fc6981d0300 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 --2- 172.21.15.28:0/2058462059 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc6980a3d70 0x7fc6981cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 >> 172.21.15.28:0/2058462059 conn(0x7fc6980a9430 msgr2=0x7fc698134830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 shutdown_connections 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 -- 172.21.15.28:0/2058462059 wait complete. 2024-03-27T21:30:22.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.710+0000 7fc6a02ed640 1 librados: shutdown 2024-03-27T21:30:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.716+0000 7fb5151a9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-03-27T21:30:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.716+0000 7fb5151a9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-03-27T21:30:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.716+0000 7fb5151a9640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.716+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb4f40052f0 con 0x7fb5101339e0 2024-03-27T21:30:22.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.717+0000 7fb5077fe640 1 -- 172.21.15.28:0/714768596 <== mon.6 v2:172.21.15.28:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb508008b10 con 0x7fb5101339e0 2024-03-27T21:30:22.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.717+0000 7fb5077fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-03-27T21:30:22.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.717+0000 7fb5077fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:22.706 INFO:teuthology.orchestra.run.smithi028.stdout:51539607555 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 10 librados: watch_flush enter 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 10 librados: watch_flush exit 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 20 client.4263.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 10 client.4263.objecter successfully canceled tick 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb4f003a250 msgr2=0x7fb4f003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb4f003a250 0x7fb4f003c710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097c0 tx=0x7fb4f8030000 comp rx=0 tx=0).stop 2024-03-27T21:30:22.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 10 monclient: shutdown 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb5101339e0 msgr2=0x7fb5101c74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb5101339e0 0x7fb5101c74d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb50800cef0 tx=0x7fb50800a710 comp rx=0 tx=0).stop 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 shutdown_connections 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb4f003a250 0x7fb4f003c710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb5101c7a10 0x7fb5101319c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fb5101339e0 0x7fb5101c74d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 --2- 172.21.15.28:0/714768596 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb5100a3d70 0x7fb5101c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 >> 172.21.15.28:0/714768596 conn(0x7fb5100a9430 msgr2=0x7fb5101349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 shutdown_connections 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 -- 172.21.15.28:0/714768596 wait complete. 2024-03-27T21:30:22.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.719+0000 7fb5151a9640 1 librados: shutdown 2024-03-27T21:30:22.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.3 2024-03-27T21:30:22.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607555 for osd.4 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.811+0000 7fa454910640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.811+0000 7fa454910640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.811+0000 7fa454910640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.811+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa4480a6b10 con 0x7fa448020ab0 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.812+0000 7fa4377fe640 1 -- 172.21.15.28:0/1807040337 <== mon.2 v2:172.21.15.28:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4480a6b10 con 0x7fa448020ab0 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.812+0000 7fa4377fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.812+0000 7fa4377fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:22.801 INFO:teuthology.orchestra.run.smithi028.stdout:47244640257 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 10 librados: watch_flush enter 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 10 librados: watch_flush exit 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 20 client.4250.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 10 client.4250.objecter successfully canceled tick 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa43c03a250 msgr2=0x7fa43c03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa43c03a250 0x7fa43c03c710 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa448009a00 tx=0x7fa444008040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 10 monclient: shutdown 2024-03-27T21:30:22.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 msgr2=0x7fa4480b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 0x7fa4480b74e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa4400090b0 tx=0x7fa4400046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 shutdown_connections 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa43c03a250 0x7fa43c03c710 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa44801be30 0x7fa44801c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4480bd470 0x7fa4480b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 --2- 172.21.15.28:0/1807040337 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa448020ab0 0x7fa4480b74e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 >> 172.21.15.28:0/1807040337 conn(0x7fa4480088e0 msgr2=0x7fa4480bbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 shutdown_connections 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 -- 172.21.15.28:0/1807040337 wait complete. 2024-03-27T21:30:22.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.814+0000 7fa454910640 1 librados: shutdown 2024-03-27T21:30:22.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.817+0000 7f07591a4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-03-27T21:30:22.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.817+0000 7f07591a4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-03-27T21:30:22.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.817+0000 7f07591a4640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:22.806 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.817+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07540672e0 con 0x7f07541339e0 2024-03-27T21:30:22.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.818+0000 7f073b7fe640 1 -- 172.21.15.28:0/325424209 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f074801ae80 con 0x7f07541339e0 2024-03-27T21:30:22.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.818+0000 7f073b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-03-27T21:30:22.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.818+0000 7f073b7fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:22.807 INFO:teuthology.orchestra.run.smithi028.stdout:47244640257 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c76eaf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c76eaf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c76eaf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c70074b30 con 0x7f5c70066b10 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c6d7fa640 1 -- 172.21.15.28:0/3732580579 <== mon.4 v2:172.21.15.28:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c6403b3f0 con 0x7f5c70066b10 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c6d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-03-27T21:30:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.819+0000 7f5c6d7fa640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:22.809 INFO:teuthology.orchestra.run.smithi028.stdout:47244640258 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 10 librados: watch_flush enter 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 10 librados: watch_flush exit 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 20 client.4438.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 10 client.4438.objecter successfully canceled tick 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f074003a280 msgr2=0x7f074003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f074003a280 0x7f074003c740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0744034000 tx=0x7f0744008030 comp rx=0 tx=0).stop 2024-03-27T21:30:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 10 monclient: shutdown 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 msgr2=0x7f0754132fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 0x7f0754132fc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f074800e870 tx=0x7f074800ed30 comp rx=0 tx=0).stop 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 shutdown_connections 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f074003a280 0x7f074003c740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0754136d00 0x7f075409c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07541339e0 0x7f0754132fc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 --2- 172.21.15.28:0/325424209 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f07540a3d70 0x7f0754132a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 >> 172.21.15.28:0/325424209 conn(0x7f07540a9430 msgr2=0x7f07540a4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 shutdown_connections 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 -- 172.21.15.28:0/325424209 wait complete. 2024-03-27T21:30:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.820+0000 7f07591a4640 1 librados: shutdown 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 10 librados: watch_flush enter 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 10 librados: watch_flush exit 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 20 client.4243.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 10 client.4243.objecter successfully canceled tick 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c5403a280 msgr2=0x7f5c5403c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c5403a280 0x7f5c5403c740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c000f60 tx=0x7f5c5c0079b0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 10 monclient: shutdown 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 msgr2=0x7f5c7006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.821+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c7006e330 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5c640097c0 tx=0x7f5c640046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 shutdown_connections 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c5403a280 0x7f5c5403c740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c7013c700 0x7f5c7006edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c70099a80 0x7f5c7006e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 --2- 172.21.15.28:0/3732580579 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c70066b10 0x7f5c7006e330 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 >> 172.21.15.28:0/3732580579 conn(0x7f5c700a2040 msgr2=0x7f5c70139f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 shutdown_connections 2024-03-27T21:30:22.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 -- 172.21.15.28:0/3732580579 wait complete. 2024-03-27T21:30:22.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.822+0000 7f5c76eaf640 1 librados: shutdown 2024-03-27T21:30:22.816 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.0 2024-03-27T21:30:22.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2024-03-27T21:30:22.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.2 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f295b142640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f295b142640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f295b142640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2954074b10 con 0x7f295413a950 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f29517fa640 1 -- 172.21.15.28:0/3332458321 <== mon.6 v2:172.21.15.28:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f294c012340 con 0x7f295413a950 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f29517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-03-27T21:30:22.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.843+0000 7f29517fa640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:22.833 INFO:teuthology.orchestra.run.smithi028.stdout:47244640258 2024-03-27T21:30:22.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 10 librados: watch_flush enter 2024-03-27T21:30:22.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 10 librados: watch_flush exit 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 20 client.4272.objecter shutdown clearing up homeless session... 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 10 client.4272.objecter successfully canceled tick 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f293803a250 msgr2=0x7f293803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f293803a250 0x7f293803c710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f294800ae10 tx=0x7f2948008040 comp rx=0 tx=0).stop 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 10 monclient: shutdown 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 msgr2=0x7f295409b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 0x7f295409b850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f294c00efc0 tx=0x7f294c00c490 comp rx=0 tx=0).stop 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 shutdown_connections 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f293803a250 0x7f293803c710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f295413a950 0x7f295409b850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f295413b1e0 0x7f295413a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 --2- 172.21.15.28:0/3332458321 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f29540a42b0 0x7f29541cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:22.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 >> 172.21.15.28:0/3332458321 conn(0x7f29540a9430 msgr2=0x7f29540a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:22.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 shutdown_connections 2024-03-27T21:30:22.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 -- 172.21.15.28:0/3332458321 wait complete. 2024-03-27T21:30:22.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:22.845+0000 7f295b142640 1 librados: shutdown 2024-03-27T21:30:22.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2024-03-27T21:30:23.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-27T21:30:23.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-27T21:30:23.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-27T21:30:23.823 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-27T21:30:23.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-27T21:30:23.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.837+0000 7fb4643a3640 10 monclient: get_monmap_and_config 2024-03-27T21:30:23.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.837+0000 7fb4643a3640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.837+0000 7fb4643a3640 10 monclient: monmap: 2024-03-27T21:30:23.827 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.827 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:23.838606+0000 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:23.838606+0000 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.828 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.838+0000 7fb4643a3640 1 Processor -- start 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.838+0000 7fb4643a3640 1 -- start start 2024-03-27T21:30:23.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.838+0000 7fb4643a3640 10 monclient: init 2024-03-27T21:30:23.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient: _add_conns ranks=[5,7,2,6,8,9,10,4,1,0,3] 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb45c0a31f0 0x7fb45c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): picked mon.noname-h con 0x7fb45c0a31f0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb45c09dc90 0x7fb45c0a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): picked mon.noname-i con 0x7fb45c09dc90 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 0x7fb45c133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): picked mon.noname-b con 0x7fb45c0a23c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0a03c0 con 0x7fb45c0a23c0 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0a35d0 con 0x7fb45c0a31f0 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c09f140 con 0x7fb45c09dc90 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb4643a3640 10 monclient(hunting): authenticate will time out at 846.146010s 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 0x7fb45c133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 0x7fb45c133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36492/0 (socket says 172.21.15.28:36492) 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 -- 172.21.15.28:0/277575331 learned_addr learned my addr 172.21.15.28:0/277575331 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): get_auth_request con 0x7fb45c0a23c0 auth_method 0 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb45c09dc90 0x7fb45c0a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb45c0a31f0 0x7fb45c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): get_auth_request con 0x7fb45c09dc90 auth_method 0 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): get_auth_request con 0x7fb45c0a31f0 auth_method 0 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46193e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb46213f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient(hunting): handle_auth_done global_id 4259 payload 274 2024-03-27T21:30:23.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 -- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb45c09dc90 msgr2=0x7fb45c0a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb45c09dc90 0x7fb45c0a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 -- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb45c0a31f0 msgr2=0x7fb45c0a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb45c0a31f0 0x7fb45c0a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 monclient: found mon.noname-b 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.839+0000 7fb462940640 1 -- 172.21.15.28:0/277575331 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0618f0 con 0x7fb45c0a23c0 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.840+0000 7fb462940640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 0x7fb45c133860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb45400bf20 tx=0x7fb454034620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f668afb44c2ff691 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 1 -- 172.21.15.28:0/277575331 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb454034ea0 con 0x7fb45c0a23c0 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: dump: 2024-03-27T21:30:23.843 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.844 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 1 -- 172.21.15.28:0/277575331 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb454037050 con 0x7fb45c0a23c0 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb4643a3640 5 monclient: authenticate success, global_id 4259 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb4643a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb4643a3640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 1 -- 172.21.15.28:0/277575331 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb45400b2e0 con 0x7fb45c0a23c0 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb4643a3640 4 set_mon_vals no callback set 2024-03-27T21:30:23.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.841+0000 7fb46113d640 10 monclient: dump: 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.846 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 10 monclient: shutdown 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 -- 172.21.15.28:0/277575331 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 msgr2=0x7fb45c133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 0x7fb45c133860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb45400bf20 tx=0x7fb454034620 comp rx=0 tx=0).stop 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 -- 172.21.15.28:0/277575331 shutdown_connections 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fb45c0a23c0 0x7fb45c133860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fb45c09dc90 0x7fb45c0a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 --2- 172.21.15.28:0/277575331 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fb45c0a31f0 0x7fb45c0a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 -- 172.21.15.28:0/277575331 >> 172.21.15.28:0/277575331 conn(0x7fb45c0a65f0 msgr2=0x7fb45c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 -- 172.21.15.28:0/277575331 shutdown_connections 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 1 -- 172.21.15.28:0/277575331 wait complete. 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.842+0000 7fb4643a3640 10 monclient: monmap: 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 librados: starting msgr at 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 librados: starting objecter 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 Processor -- start 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 -- start start 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 librados: setting wanted keys 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 librados: calling monclient init 2024-03-27T21:30:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 10 monclient: init 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 10 monclient: _add_conns ranks=[1,0,4,5,7,6,8,2,3] 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c09dc90 0x7fb45c1c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 10 monclient(hunting): picked mon.noname-f con 0x7fb45c09dc90 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 0x7fb45c12ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 10 monclient(hunting): picked mon.noname-a con 0x7fb45c0a23c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.843+0000 7fb4643a3640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb45c0a31f0 0x7fb45c1c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 0x7fb45c12ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 10 monclient(hunting): picked mon.noname-c con 0x7fb45c0a31f0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb45c0a31f0 0x7fb45c1c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 0x7fb45c12ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38476/0 (socket says 172.21.15.28:38476) 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 -- 172.21.15.28:0/3560619529 learned_addr learned my addr 172.21.15.28:0/3560619529 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c11de50 con 0x7fb45c0a23c0 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c070c80 con 0x7fb45c09dc90 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0719e0 con 0x7fb45c0a31f0 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb4643a3640 10 monclient(hunting): authenticate will time out at 846.150827s 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): get_auth_request con 0x7fb45c0a31f0 auth_method 0 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): get_auth_request con 0x7fb45c0a23c0 auth_method 0 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c09dc90 0x7fb45c1c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): get_auth_request con 0x7fb45c09dc90 auth_method 0 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient(hunting): handle_auth_done global_id 4401 payload 824 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 -- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb45c0a31f0 msgr2=0x7fb45c1c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb45c0a31f0 0x7fb45c1c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 -- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c09dc90 msgr2=0x7fb45c1c3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c09dc90 0x7fb45c1c3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 monclient: found mon.noname-a 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45400bb50 con 0x7fb45c0a23c0 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb462940640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb45c0a31f0 0x7fb45c1c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46213f640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c09dc90 0x7fb45c1c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb46193e640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 0x7fb45c12ed10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b9d0 tx=0x7fb44c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb452ffd640 10 client.?.objecter ms_handle_connect 0x7fb45c0a23c0 2024-03-27T21:30:23.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.844+0000 7fb452ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb44c008d10 con 0x7fb45c0a23c0 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: dump: 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.855 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c008e70 con 0x7fb45c0a23c0 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb44c015870 con 0x7fb45c0a23c0 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:23.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb452ffd640 10 monclient: dump: 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.857 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb46093c640 4 set_mon_vals no callback set 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 5 monclient: authenticate success, global_id 4401 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 10 monclient: _renew_subs 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0712a0 con 0x7fb45c0a23c0 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 10 monclient: _renew_subs 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c11e6f0 con 0x7fb45c0a23c0 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.845+0000 7fb4643a3640 1 librados: init done 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fb44c015400 con 0x7fb45c0a23c0 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb44003a250 0x7fb44003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fb44c04a120 con 0x7fb45c0a23c0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 10 client.4401.objecter ms_dispatch 0x7fb45c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 3 client.4401.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 3 client.4401.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb452ffd640 20 client.4401.objecter dump_active .. 0 homeless 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.846+0000 7fb46213f640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb44003a250 0x7fb44003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb46213f640 10 monclient: get_auth_request con 0x7fb44003a250 auth_method 0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb4643a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb4643a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb4643a3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c074b30 con 0x7fb45c0a23c0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb452ffd640 10 client.4401.objecter ms_handle_connect 0x7fb44003a250 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.847+0000 7fb46213f640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb44003a250 0x7fb44003c710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e10 tx=0x7fb458009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.854+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fb44c01e400 con 0x7fb45c0a23c0 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.854+0000 7fb452ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.854+0000 7fb452ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:23.860 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.898+0000 7f17688ce640 10 monclient: get_monmap_and_config 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.898+0000 7f17688ce640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.898+0000 7f17688ce640 10 monclient: monmap: 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:23.899043+0000 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:23.899043+0000 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:23.888 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.899+0000 7f17688ce640 1 Processor -- start 2024-03-27T21:30:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.899+0000 7f17688ce640 1 -- start start 2024-03-27T21:30:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.899+0000 7f17688ce640 10 monclient: init 2024-03-27T21:30:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient: _add_conns ranks=[7,4,1,6,3,8,5,9,0,2,10] 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f176409fee0 0x7f176409f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): picked mon.noname-i con 0x7f176409fee0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 0x7f17640a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): picked mon.noname-c con 0x7f17640a1940 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 0x7f17640a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 0x7f17640a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48454/0 (socket says 172.21.15.28:48454) 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 -- 172.21.15.28:0/610476787 learned_addr learned my addr 172.21.15.28:0/610476787 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f17640a22a0 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17640618f0 con 0x7f17640a22a0 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f176409ea00 con 0x7f17640a1940 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f176406ab30 con 0x7f176409fee0 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f17688ce640 10 monclient(hunting): authenticate will time out at 846.207167s 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): get_auth_request con 0x7f17640a1940 auth_method 0 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f176259c640 1 --2- 172.21.15.28:0/610476787 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f176409fee0 0x7f176409f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f176259c640 10 monclient(hunting): get_auth_request con 0x7f176409fee0 auth_method 0 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f176259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f176259c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f176259c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient(hunting): handle_auth_done global_id 4288 payload 274 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 -- 172.21.15.28:0/610476787 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f176409fee0 msgr2=0x7f176409f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 --2- 172.21.15.28:0/610476787 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f176409fee0 0x7f176409f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 -- 172.21.15.28:0/610476787 >> v1:172.21.15.63:6789/0 conn(0x7f17640a22a0 legacy=0x7f176413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 monclient: found mon.noname-c 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.900+0000 7f1761d9b640 1 -- 172.21.15.28:0/610476787 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640a2720 con 0x7f17640a1940 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f1761d9b640 1 --2- 172.21.15.28:0/610476787 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 0x7f17640a1d60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f17580098a0 tx=0x7f1758033fd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=7be40c31822aa222 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 1 -- 172.21.15.28:0/610476787 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f175803a340 con 0x7f17640a1940 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: dump: 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.909 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f17688ce640 5 monclient: authenticate success, global_id 4288 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f17688ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 1 -- 172.21.15.28:0/610476787 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758034b80 con 0x7f17640a1940 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f17688ce640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f17688ce640 4 set_mon_vals no callback set 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 1 -- 172.21.15.28:0/610476787 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1758034d70 con 0x7f17640a1940 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.902+0000 7f176159a640 10 monclient: dump: 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.911 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 10 monclient: shutdown 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 msgr2=0x7f17640a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 --2- 172.21.15.28:0/610476787 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 0x7f17640a1d60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f17580098a0 tx=0x7f1758033fd0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 shutdown_connections 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 --2- 172.21.15.28:0/610476787 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f17640a1940 0x7f17640a1d60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 --2- 172.21.15.28:0/610476787 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f176409fee0 0x7f176409f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 >> 172.21.15.28:0/610476787 conn(0x7f17640a65f0 msgr2=0x7f17640a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 shutdown_connections 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.903+0000 7f17688ce640 1 -- 172.21.15.28:0/610476787 wait complete. 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.904+0000 7f17688ce640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.904+0000 7f17688ce640 10 monclient: monmap: 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.913 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 1 librados: starting msgr at 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 1 librados: starting objecter 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 1 Processor -- start 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 1 -- start start 2024-03-27T21:30:23.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 1 librados: setting wanted keys 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 1 librados: calling monclient init 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.905+0000 7f17688ce640 10 monclient: init 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient: _add_conns ranks=[6,7,8,1,4,0,5,3,2] 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 0x7f17641c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 0x7f17641c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 0x7f17641c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43390/0 (socket says 172.21.15.28:43390) 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 1 -- 172.21.15.28:0/3388983364 learned_addr learned my addr 172.21.15.28:0/3388983364 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): picked mon.noname-d con 0x7f176409fee0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f17640a1940 0x7f17641b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): picked mon.noname-i con 0x7f17640a1940 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f17640a22a0 0x7f17641b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f1762d9d640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f17640a22a0 0x7f17641b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f1761d9b640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f17640a1940 0x7f17641b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): picked mon.noname-e con 0x7f17640a22a0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f17641a1f60 con 0x7f176409fee0 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f17641c8330 con 0x7f17640a1940 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f1764071600 con 0x7f17640a22a0 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f17688ce640 10 monclient(hunting): authenticate will time out at 846.213600s 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 10 monclient(hunting): get_auth_request con 0x7f176409fee0 auth_method 0 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.906+0000 7f176259c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): get_auth_request con 0x7f17640a22a0 auth_method 0 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): get_auth_request con 0x7f17640a1940 auth_method 0 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 10 monclient(hunting): handle_auth_done global_id 4281 payload 824 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 1 -- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f17640a22a0 msgr2=0x7f17641b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f17640a22a0 0x7f17641b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 1 -- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f17640a1940 msgr2=0x7f17641b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f17640a1940 0x7f17641b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 1 monclient: found mon.noname-d 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f176259c640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580094d0 con 0x7f176409fee0 2024-03-27T21:30:23.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1762d9d640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f17640a22a0 0x7f17641b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.907+0000 7f1761d9b640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f17640a1940 0x7f17641b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f176259c640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 0x7f17641c7660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f175400d8f0 tx=0x7f175400ddb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 client.?.objecter ms_handle_connect 0x7f176409fee0 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f175400bad0 con 0x7f176409fee0 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 monclient: dump: 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.919 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.920 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400bc70 con 0x7f176409fee0 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1752ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.908+0000 7f1760d99640 4 set_mon_vals no callback set 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f175400bde0 con 0x7f176409fee0 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f1752ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f1752ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f1752ffd640 10 monclient: dump: 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.921 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f17688ce640 5 monclient: authenticate success, global_id 4281 2024-03-27T21:30:23.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f17688ce640 10 monclient: _renew_subs 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f17688ce640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176409d430 con 0x7f176409fee0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.909+0000 7f17688ce640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.910+0000 7f17688ce640 10 monclient: _renew_subs 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.910+0000 7f17688ce640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.910+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17641a1910 con 0x7f176409fee0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.910+0000 7f17688ce640 1 librados: init done 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f17688ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f175400b660 con 0x7f176409fee0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f17688ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f17688ce640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1764074b30 con 0x7f176409fee0 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f1752ffd640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f174403a180 0x7f174403c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f175404a6b0 con 0x7f176409fee0 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f1752ffd640 10 client.4281.objecter ms_dispatch 0x7f1764000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f1752ffd640 3 client.4281.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.911+0000 7f1752ffd640 3 client.4281.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.912+0000 7f1752ffd640 20 client.4281.objecter dump_active .. 0 homeless 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.912+0000 7f1761d9b640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f174403a180 0x7f174403c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.912+0000 7f1761d9b640 10 monclient: get_auth_request con 0x7f174403a180 auth_method 0 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.912+0000 7f1752ffd640 10 client.4281.objecter ms_handle_connect 0x7f174403a180 2024-03-27T21:30:23.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.912+0000 7f1761d9b640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f174403a180 0x7f174403c640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f175803e000 tx=0x7f1758038000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.920+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f175400b910 con 0x7f176409fee0 2024-03-27T21:30:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.920+0000 7f1752ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.921+0000 7f1752ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:23.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.950+0000 7f0afebae640 10 monclient: get_monmap_and_config 2024-03-27T21:30:23.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.950+0000 7f0afebae640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.950+0000 7f0afebae640 10 monclient: monmap: 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:23.950861+0000 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:23.950861+0000 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.939 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.940 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.940 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.940 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:23.940 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:23.940 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.950+0000 7f0afebae640 1 Processor -- start 2024-03-27T21:30:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.950+0000 7f0afebae640 1 -- start start 2024-03-27T21:30:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.950+0000 7f0afebae640 10 monclient: init 2024-03-27T21:30:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 10 monclient: _add_conns ranks=[5,6,0,2,10,4,7,1,3,9,8] 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0af8136d00 0x7f0af81370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 10 monclient(hunting): picked mon.noname-h con 0x7f0af8136d00 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0af80a3d70 0x7f0af8137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 10 monclient(hunting): picked mon.noname-d con 0x7f0af80a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afd14b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0af81339e0 0x7f0af8133e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52946/0 (socket says 172.21.15.28:52946) 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afd14b640 1 -- 172.21.15.28:0/4193478947 learned_addr learned my addr 172.21.15.28:0/4193478947 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0af7fff640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0af80a3d70 0x7f0af8137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.951+0000 7f0afebae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0af81339e0 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0af8136d00 0x7f0af81370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af80618f0 con 0x7f0af81339e0 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80a25b0 con 0x7f0af8136d00 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8137b60 con 0x7f0af80a3d70 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afebae640 10 monclient(hunting): authenticate will time out at 846.258979s 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471708466 0 0) 0x7f0af80618f0 con 0x7f0af81339e0 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient(hunting): _negotiate 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient(hunting): my global_id is 4410 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ae8003520 con 0x7f0af81339e0 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): get_auth_request con 0x7f0af8136d00 auth_method 0 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3770157657 0 0) 0x7f0ae8003520 con 0x7f0af81339e0 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0af80a3d70 msgr2=0x7f0af8137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0af80a3d70 0x7f0af8137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0af8136d00 msgr2=0x7f0af81370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0af8136d00 0x7f0af81370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 monclient: found mon.noname-a-legacy 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.28:6789/0 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af80a13f0 con 0x7f0af81339e0 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (unknown 3833802671 0 0) 0x7f0af0001c60 con 0x7f0af81339e0 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: dump: 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.958 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] but i'm connected to v1:172.21.15.28:6789/0, reconnecting 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 >> v1:172.21.15.28:6789/0 conn(0x7f0af81339e0 legacy=0x7f0af8133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient: _add_conns ranks=[5,7,6,0,8,3,1,4,2] 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0ae80041f0 0x7f0ae80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient(hunting): picked mon.h con 0x7f0ae80041f0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0ae8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 10 monclient(hunting): picked mon.i con 0x7f0ae8004d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.952+0000 7f0af77fe640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0ae800c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 10 monclient(hunting): picked mon.d con 0x7f0ae8009bc0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80a25b0 con 0x7f0ae80041f0 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8137b60 con 0x7f0ae8009bc0 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae800c8e0 con 0x7f0ae8004d00 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af77fe640 10 monclient(hunting): _finish_auth 0 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0af8136d00 0x7f0af81370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): get_auth_request con 0x7f0af80a3d70 auth_method 0 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0af80a3d70 0x7f0af8137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0ae80041f0 0x7f0ae80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0ae800c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): get_auth_request con 0x7f0ae8009bc0 auth_method 0 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): get_auth_request con 0x7f0ae80041f0 auth_method 0 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0ae8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afd14b640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): get_auth_request con 0x7f0ae8004d00 auth_method 0 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0af7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient(hunting): handle_auth_done global_id 4410 payload 293 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 -- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 msgr2=0x7f0ae8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0ae8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 -- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 msgr2=0x7f0ae800c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0ae800c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 monclient: found mon.h 2024-03-27T21:30:23.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 1 -- 172.21.15.28:0/4193478947 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8003520 con 0x7f0ae80041f0 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.953+0000 7f0afc94a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.954+0000 7f0afebae640 5 monclient: authenticate success, global_id 4410 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.954+0000 7f0afebae640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0afc94a640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0ae80041f0 0x7f0ae80047c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0af80a58a0 tx=0x7f0ae80057f0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=360c8acc8aa77f5a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0aec0044a0 con 0x7f0ae80041f0 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: dump: 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.963 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec02c710 con 0x7f0ae80041f0 2024-03-27T21:30:23.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 1 -- 172.21.15.28:0/4193478947 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0aec02ccf0 con 0x7f0ae80041f0 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0af77fe640 10 monclient: dump: 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.965 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0afebae640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.955+0000 7f0afebae640 4 set_mon_vals no callback set 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 10 monclient: shutdown 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0ae80041f0 msgr2=0x7f0ae80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0ae80041f0 0x7f0ae80047c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0af80a58a0 tx=0x7f0ae80057f0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 shutdown_connections 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0ae800c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0ae8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 --2- 172.21.15.28:0/4193478947 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0ae80041f0 0x7f0ae80047c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.956+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 >> 172.21.15.28:0/4193478947 conn(0x7f0af80a9430 msgr2=0x7f0af80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.957+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 shutdown_connections 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.957+0000 7f0afebae640 1 -- 172.21.15.28:0/4193478947 wait complete. 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.958+0000 7f0afebae640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.958+0000 7f0afebae640 10 monclient: monmap: 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:23.967 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.958+0000 7f0afebae640 1 librados: starting msgr at 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.958+0000 7f0afebae640 1 librados: starting objecter 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.958+0000 7f0afebae640 1 Processor -- start 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.959+0000 7f0afebae640 1 -- start start 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.959+0000 7f0afebae640 1 librados: setting wanted keys 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.959+0000 7f0afebae640 1 librados: calling monclient init 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.959+0000 7f0afebae640 10 monclient: init 2024-03-27T21:30:23.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient: _add_conns ranks=[3,7,6,5,0,4,8,1,2] 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0ae80041f0 0x7f0af81caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): picked mon.noname-g con 0x7f0ae80041f0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0af8131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): picked mon.noname-i con 0x7f0ae8004d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0af809b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): picked mon.noname-d con 0x7f0ae8009bc0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80a1630 con 0x7f0ae80041f0 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0af80a11e0 con 0x7f0ae8009bc0 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0af809ede0 con 0x7f0ae8004d00 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afebae640 10 monclient(hunting): authenticate will time out at 846.267229s 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afc94a640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0ae80041f0 0x7f0af81caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0af8131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0af8131ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3303/0 says I am v2:172.21.15.28:35968/0 (socket says 172.21.15.28:35968) 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 1 -- 172.21.15.28:0/3959105972 learned_addr learned my addr 172.21.15.28:0/3959105972 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 10 monclient(hunting): get_auth_request con 0x7f0ae8004d00 auth_method 0 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0af7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afc94a640 10 monclient(hunting): get_auth_request con 0x7f0ae80041f0 auth_method 0 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afc94a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afc94a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.960+0000 7f0afc94a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0af809b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): get_auth_request con 0x7f0ae8009bc0 auth_method 0 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0af7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0af7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0af7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afc94a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient(hunting): handle_auth_done global_id 4290 payload 824 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 -- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 msgr2=0x7f0af8131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0af8131ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 -- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0ae80041f0 msgr2=0x7f0af81caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0ae80041f0 0x7f0af81caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 monclient: found mon.noname-d 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.961+0000 7f0afd14b640 1 -- 172.21.15.28:0/3959105972 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af809f0c0 con 0x7f0ae8009bc0 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.962+0000 7f0afd14b640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0af809b6f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0af0007740 tx=0x7f0af0007b40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.962+0000 7f0af57fa640 10 client.?.objecter ms_handle_connect 0x7f0ae8009bc0 2024-03-27T21:30:23.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.962+0000 7f0af57fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0af00133f0 con 0x7f0ae8009bc0 2024-03-27T21:30:23.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 10 monclient: dump: 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.975 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 5 monclient: authenticate success, global_id 4290 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 10 monclient: _renew_subs 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af809d320 con 0x7f0ae8009bc0 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 10 client.4290.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:23.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 10 monclient: _renew_subs 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af81cbd80 con 0x7f0ae8009bc0 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0afebae640 1 librados: init done 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af000fae0 con 0x7f0ae8009bc0 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af57fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.966+0000 7f0af6ffd640 4 set_mon_vals no callback set 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.967+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0af000fc50 con 0x7f0ae8009bc0 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.967+0000 7f0af57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.967+0000 7f0af57fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.967+0000 7f0af57fa640 10 monclient: dump: 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.977 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.978 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.968+0000 7f0afebae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.968+0000 7f0afebae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.968+0000 7f0afebae640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.968+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8005040 con 0x7f0ae8009bc0 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.968+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f0af0024350 con 0x7f0ae8009bc0 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0af57fa640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0adc03a280 0x7f0adc03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f0af004a790 con 0x7f0ae8009bc0 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0af57fa640 10 client.4290.objecter ms_dispatch 0x7f0af8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0af57fa640 3 client.4290.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:23.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0af57fa640 3 client.4290.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0afc94a640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0adc03a280 0x7f0adc03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0afc94a640 10 monclient: get_auth_request con 0x7f0adc03a280 auth_method 0 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.973+0000 7f0af57fa640 20 client.4290.objecter dump_active .. 0 homeless 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.974+0000 7f0afc94a640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0adc03a280 0x7f0adc03c740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0aec035000 tx=0x7f0aec030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.974+0000 7f0af57fa640 10 client.4290.objecter ms_handle_connect 0x7f0adc03a280 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.978+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0af0023d60 con 0x7f0ae8009bc0 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.978+0000 7f0af57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:23.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.978+0000 7f0af57fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.978+0000 7fe7400f7640 10 monclient: get_monmap_and_config 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.978+0000 7fe7400f7640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.979+0000 7fe7400f7640 10 monclient: monmap: 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:23.979767+0000 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:23.979767+0000 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:23.988 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.979+0000 7fe7400f7640 1 Processor -- start 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.979+0000 7fe7400f7640 1 -- start start 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.979+0000 7fe7400f7640 10 monclient: init 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient: _add_conns ranks=[10,5,6,2,7,9,8,0,4,3,1] 2024-03-27T21:30:23.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe738136d00 0x7fe7381370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): picked mon.noname-f con 0x7fe738136d00 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe7380a3d70 0x7fe738137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): picked mon.noname-h con 0x7fe7380a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7381339e0 0x7fe738133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): picked mon.noname-d con 0x7fe7381339e0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7380a25b0 con 0x7fe738136d00 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe738137b60 con 0x7fe7380a3d70 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380a13f0 con 0x7fe7381339e0 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe7400f7640 10 monclient(hunting): authenticate will time out at 846.287252s 2024-03-27T21:30:23.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7381339e0 0x7fe738133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7381339e0 0x7fe738133e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43420/0 (socket says 172.21.15.28:43420) 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 1 -- 172.21.15.28:0/2984682898 learned_addr learned my addr 172.21.15.28:0/2984682898 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): get_auth_request con 0x7fe7381339e0 auth_method 0 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73d692640 1 --2- 172.21.15.28:0/2984682898 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe7380a3d70 0x7fe738137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73d692640 10 monclient(hunting): get_auth_request con 0x7fe7380a3d70 auth_method 0 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73d692640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73d692640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73d692640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.980+0000 7fe73e694640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 10 monclient(hunting): handle_auth_done global_id 4307 payload 274 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73de93640 1 --2- 172.21.15.28:0/2984682898 >> v2:172.21.15.63:3300/0 conn(0x7fe738136d00 0x7fe7381370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 1 -- 172.21.15.28:0/2984682898 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7381339e0 msgr2=0x7fe738133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 1 --2- 172.21.15.28:0/2984682898 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7381339e0 0x7fe738133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 1 -- 172.21.15.28:0/2984682898 >> v2:172.21.15.63:3300/0 conn(0x7fe738136d00 msgr2=0x7fe7381370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 1 --2- 172.21.15.28:0/2984682898 >> v2:172.21.15.63:3300/0 conn(0x7fe738136d00 0x7fe7381370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 10 monclient: _finish_hunting 0 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 1 monclient: found mon.noname-h 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73d692640 1 -- 172.21.15.28:0/2984682898 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7380618f0 con 0x7fe7380a3d70 2024-03-27T21:30:23.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73de93640 10 monclient: get_auth_request con 0x7fe738136d00 auth_method 0 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.981+0000 7fe73de93640 1 --2- 172.21.15.28:0/2984682898 >> v2:172.21.15.63:3300/0 conn(0x7fe738136d00 0x7fe7381370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73d692640 1 --2- 172.21.15.28:0/2984682898 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe7380a3d70 0x7fe738137620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7280097a0 tx=0x7fe72802b6f0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=a0e5015a31e6243e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 1 -- 172.21.15.28:0/2984682898 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe728030980 con 0x7fe7380a3d70 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: dump: 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.993 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: _finish_auth 0 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: _check_auth_tickets 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 1 -- 172.21.15.28:0/2984682898 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72802e050 con 0x7fe7380a3d70 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 1 -- 172.21.15.28:0/2984682898 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe7280313a0 con 0x7fe7380a3d70 2024-03-27T21:30:23.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:23.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:23.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.982+0000 7fe73ce91640 10 monclient: dump: 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:23.997 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 5 monclient: authenticate success, global_id 4307 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 4 set_mon_vals no callback set 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 10 monclient: shutdown 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 1 -- 172.21.15.28:0/2984682898 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe7380a3d70 msgr2=0x7fe738137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:23.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2984682898 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe7380a3d70 0x7fe738137620 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe7280097a0 tx=0x7fe72802b6f0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 1 -- 172.21.15.28:0/2984682898 shutdown_connections 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.983+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2984682898 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7381339e0 0x7fe738133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2984682898 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe7380a3d70 0x7fe738137620 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2984682898 >> v2:172.21.15.63:3300/0 conn(0x7fe738136d00 0x7fe7381370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 1 -- 172.21.15.28:0/2984682898 >> 172.21.15.28:0/2984682898 conn(0x7fe7380a9430 msgr2=0x7fe7380a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 1 -- 172.21.15.28:0/2984682898 shutdown_connections 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 1 -- 172.21.15.28:0/2984682898 wait complete. 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 10 monclient: build_initial_monmap 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.984+0000 7fe7400f7640 10 monclient: monmap: 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:23.999 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 1 librados: starting msgr at 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 1 librados: starting objecter 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 1 Processor -- start 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 1 -- start start 2024-03-27T21:30:24.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 1 librados: setting wanted keys 2024-03-27T21:30:24.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 1 librados: calling monclient init 2024-03-27T21:30:24.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fe7400f7640 10 monclient: init 2024-03-27T21:30:24.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fa3c2688640 10 monclient: get_monmap_and_config 2024-03-27T21:30:24.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.985+0000 7fa3c2688640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fa3c2688640 10 monclient: monmap: 2024-03-27T21:30:24.001 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:23.986791+0000 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:23.986791+0000 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.002 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.003 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:24.003 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:24.003 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient: _add_conns ranks=[6,7,8,0,4,3,2,1,5] 2024-03-27T21:30:24.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 0x7fe738132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): picked mon.noname-d con 0x7fe7380a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe7381339e0 0x7fe7381cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 0x7fe738132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 0x7fe738132e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43426/0 (socket says 172.21.15.28:43426) 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): picked mon.noname-i con 0x7fe7381339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 1 -- 172.21.15.28:0/2983792363 learned_addr learned my addr 172.21.15.28:0/2983792363 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe738136d00 0x7fe7381cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73d692640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe7381339e0 0x7fe7381cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): picked mon.noname-e con 0x7fe738136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe73809df70 con 0x7fe7380a3d70 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe73809f470 con 0x7fe7381339e0 2024-03-27T21:30:24.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fe7380a1630 con 0x7fe738136d00 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73e694640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe738136d00 0x7fe7381cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe7400f7640 10 monclient(hunting): authenticate will time out at 846.293607s 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 10 monclient(hunting): get_auth_request con 0x7fe7380a3d70 auth_method 0 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73de93640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fa3c2688640 1 Processor -- start 2024-03-27T21:30:24.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73d692640 10 monclient(hunting): get_auth_request con 0x7fe7381339e0 auth_method 0 2024-03-27T21:30:24.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73d692640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73d692640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.986+0000 7fe73d692640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): get_auth_request con 0x7fe738136d00 auth_method 0 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73e694640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73de93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73de93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73de93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 -- start start 2024-03-27T21:30:24.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient: init 2024-03-27T21:30:24.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 10 monclient(hunting): handle_auth_done global_id 4381 payload 824 2024-03-27T21:30:24.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 1 -- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe738136d00 msgr2=0x7fe7381cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe738136d00 0x7fe7381cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 1 -- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 msgr2=0x7fe738132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 0x7fe738132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient: _add_conns ranks=[6,9,7,2,1,3,5,10,0,8,4] 2024-03-27T21:30:24.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa3b4028ac0 0x7fa3b40ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): picked mon.noname-d con 0x7fa3b4028ac0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3b40ba5b0 0x7fa3b4028ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b40ba5b0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa3b40293e0 0x7fa3b40bd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): picked mon.noname-i con 0x7fa3b40293e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b4026150 con 0x7fa3b40ba5b0 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40258b0 con 0x7fa3b4028ac0 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4025e70 con 0x7fa3b40293e0 2024-03-27T21:30:24.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fa3c2688640 10 monclient(hunting): authenticate will time out at 846.294680s 2024-03-27T21:30:24.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 1 monclient: found mon.noname-i 2024-03-27T21:30:24.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:30:24.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.987+0000 7fe73d692640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728009400 con 0x7fe7381339e0 2024-03-27T21:30:24.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe73de93640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 0x7fe738132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:24.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3b40ba5b0 0x7fa3b4028ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa3b4028ac0 0x7fa3b40ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa3b40ba5b0 0x7fa3b4028ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38482/0 (socket says 172.21.15.28:38482) 2024-03-27T21:30:24.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe73d692640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe7381339e0 0x7fe7381cb3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe728032000 tx=0x7fe7280046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 client.?.objecter ms_handle_connect 0x7fe7381339e0 2024-03-27T21:30:24.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 1 -- 172.21.15.28:0/430893781 learned_addr learned my addr 172.21.15.28:0/430893781 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): get_auth_request con 0x7fa3b4028ac0 auth_method 0 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): get_auth_request con 0x7fa3b40ba5b0 auth_method 0 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe728030980 con 0x7fe7381339e0 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: dump: 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.017 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe728030b40 con 0x7fe7381339e0 2024-03-27T21:30:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe728030cb0 con 0x7fe7381339e0 2024-03-27T21:30:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72ffff640 4 set_mon_vals no callback set 2024-03-27T21:30:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe72e7fc640 10 monclient: dump: 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe7400f7640 5 monclient: authenticate success, global_id 4381 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1e87640 1 --2- 172.21.15.28:0/430893781 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa3b40293e0 0x7fa3b40bd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1e87640 10 monclient(hunting): get_auth_request con 0x7fa3b40293e0 auth_method 0 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1e87640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1e87640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c0e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient(hunting): handle_auth_done global_id 4317 payload 274 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 -- 172.21.15.28:0/430893781 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa3b40293e0 msgr2=0x7fa3b40bd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 --2- 172.21.15.28:0/430893781 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa3b40293e0 0x7fa3b40bd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 -- 172.21.15.28:0/430893781 >> v2:172.21.15.28:3300/0 conn(0x7fa3b40ba5b0 msgr2=0x7fa3b4028ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 --2- 172.21.15.28:0/430893781 >> v2:172.21.15.28:3300/0 conn(0x7fa3b40ba5b0 0x7fa3b4028ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 monclient: found mon.noname-d 2024-03-27T21:30:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fa3c1686640 1 -- 172.21.15.28:0/430893781 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40042c0 con 0x7fa3b4028ac0 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe7400f7640 10 monclient: _renew_subs 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe7400f7640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.988+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7380a11e0 con 0x7fe7381339e0 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fe7400f7640 10 client.4381.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fe7400f7640 10 monclient: _renew_subs 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fe7400f7640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe738120270 con 0x7fe7381339e0 2024-03-27T21:30:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fe7400f7640 1 librados: init done 2024-03-27T21:30:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fa3c1686640 1 --2- 172.21.15.28:0/430893781 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa3b4028ac0 0x7fa3b40ba070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc04f2a0 tx=0x7fa3bc0a58b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c5f7608ccfed29aa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.989+0000 7fa3b3fff640 1 -- 172.21.15.28:0/430893781 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa3bc0af070 con 0x7fa3b4028ac0 2024-03-27T21:30:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: dump: 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3c2688640 5 monclient: authenticate success, global_id 4317 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3c2688640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 1 -- 172.21.15.28:0/430893781 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0aa7d0 con 0x7fa3b4028ac0 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 1 -- 172.21.15.28:0/430893781 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa3bc0a7040 con 0x7fa3b4028ac0 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3b3fff640 10 monclient: dump: 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3c2688640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:24.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fa3c2688640 4 set_mon_vals no callback set 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fe728030510 con 0x7fe7381339e0 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe7400f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe7400f7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe7400f7640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe738120580 con 0x7fe7381339e0 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe71c03a250 0x7fe71c03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fe72806c0c0 con 0x7fe7381339e0 2024-03-27T21:30:24.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 10 client.4381.objecter ms_dispatch 0x7fe738000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:24.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 3 client.4381.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:24.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 3 client.4381.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:24.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.990+0000 7fe72e7fc640 20 client.4381.objecter dump_active .. 0 homeless 2024-03-27T21:30:24.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fe73de93640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe71c03a250 0x7fe71c03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fe73de93640 10 monclient: get_auth_request con 0x7fe71c03a250 auth_method 0 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 10 monclient: shutdown 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 -- 172.21.15.28:0/430893781 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa3b4028ac0 msgr2=0x7fa3b40ba070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 --2- 172.21.15.28:0/430893781 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa3b4028ac0 0x7fa3b40ba070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc04f2a0 tx=0x7fa3bc0a58b0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 -- 172.21.15.28:0/430893781 shutdown_connections 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 --2- 172.21.15.28:0/430893781 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa3b40293e0 0x7fa3b40bd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 --2- 172.21.15.28:0/430893781 >> v2:172.21.15.28:3300/0 conn(0x7fa3b40ba5b0 0x7fa3b4028ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 --2- 172.21.15.28:0/430893781 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa3b4028ac0 0x7fa3b40ba070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 -- 172.21.15.28:0/430893781 >> 172.21.15.28:0/430893781 conn(0x7fa3b4008050 msgr2=0x7fa3b4008460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 -- 172.21.15.28:0/430893781 shutdown_connections 2024-03-27T21:30:24.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fa3c2688640 1 -- 172.21.15.28:0/430893781 wait complete. 2024-03-27T21:30:24.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fe72e7fc640 10 client.4381.objecter ms_handle_connect 0x7fe71c03a250 2024-03-27T21:30:24.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.991+0000 7fe73de93640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe71c03a250 0x7fe71c03c710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe73400aed0 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.992+0000 7fa3c2688640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.992+0000 7fa3c2688640 10 monclient: monmap: 2024-03-27T21:30:24.038 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 librados: starting msgr at 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 librados: starting objecter 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 Processor -- start 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 -- start start 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 librados: setting wanted keys 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 librados: calling monclient init 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient: init 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient: _add_conns ranks=[4,2,5,7,8,0,3,6,1] 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa3b4028ac0 0x7fa3b4151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b4028ac0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 0x7fa3b4152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b40ba5b0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa3b4021850 0x7fa3b4021cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient(hunting): picked mon.noname-h con 0x7fa3b4021850 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.993+0000 7fa3c2688640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40a7a10 con 0x7fa3b40ba5b0 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c2688640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c2688640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40a7fd0 con 0x7fa3b4028ac0 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c2688640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c2688640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40a82b0 con 0x7fa3b4021850 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c2688640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c2688640 10 monclient(hunting): authenticate will time out at 846.300735s 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1686640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa3b4028ac0 0x7fa3b4151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 0x7fa3b4152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 0x7fa3b4152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36506/0 (socket says 172.21.15.28:36506) 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 1 -- 172.21.15.28:0/862154343 learned_addr learned my addr 172.21.15.28:0/862154343 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): get_auth_request con 0x7fa3b40ba5b0 auth_method 0 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa3b4021850 0x7fa3b4021cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): get_auth_request con 0x7fa3b4021850 auth_method 0 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient(hunting): handle_auth_done global_id 4316 payload 824 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 -- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa3b4028ac0 msgr2=0x7fa3b4151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa3b4028ac0 0x7fa3b4151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 -- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 msgr2=0x7fa3b4152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 0x7fa3b4152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 monclient: found mon.noname-h 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 -- 172.21.15.28:0/862154343 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4025340 con 0x7fa3b4021850 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c0e85640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 0x7fa3b4152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3c1e87640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa3b4021850 0x7fa3b4021cb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009d10 tx=0x7fa3b800d910 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3b1ffb640 10 client.?.objecter ms_handle_connect 0x7fa3b4021850 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.994+0000 7fa3b1ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:24.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa3b8012a60 con 0x7fa3b4021850 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: dump: 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.044 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8012be0 con 0x7fa3b4021850 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa3b8012d50 con 0x7fa3b4021850 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b1ffb640 10 monclient: dump: 2024-03-27T21:30:24.045 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.046 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 5 monclient: authenticate success, global_id 4316 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 10 monclient: _renew_subs 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4024df0 con 0x7fa3b4021850 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 10 client.4316.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 10 monclient: _renew_subs 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b40a5ee0 con 0x7fa3b4021850 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3c2688640 1 librados: init done 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.995+0000 7fa3b37fe640 4 set_mon_vals no callback set 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa3b80125f0 con 0x7fa3b4021850 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa3a003a280 0x7fa3a003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa3b804a1d0 con 0x7fa3b4021850 2024-03-27T21:30:24.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 10 client.4316.objecter ms_dispatch 0x7fa3bc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 3 client.4316.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 3 client.4316.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3b1ffb640 20 client.4316.objecter dump_active .. 0 homeless 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.996+0000 7fa3c1686640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa3a003a280 0x7fa3a003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3c2688640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3c1686640 10 monclient: get_auth_request con 0x7fa3a003a280 auth_method 0 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe728037080 con 0x7fe7381339e0 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fe72e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fe72e7fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3c2688640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3c2688640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b40a7b80 con 0x7fa3b4021850 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3b1ffb640 10 client.4316.objecter ms_handle_connect 0x7fa3a003a280 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:23.997+0000 7fa3c1686640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa3a003a280 0x7fa3a003c740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40259f0 tx=0x7fa3bc0aa000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.002+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa3b80128a0 con 0x7fa3b4021850 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.002+0000 7fa3b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.002+0000 7fa3b1ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:24.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.026+0000 7f23a4381640 10 monclient: get_monmap_and_config 2024-03-27T21:30:24.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.026+0000 7f23a4381640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.026+0000 7f23a4381640 10 monclient: monmap: 2024-03-27T21:30:24.058 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.058 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.058 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:24.027490+0000 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:24.027490+0000 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:24.059 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.027+0000 7f23a4381640 1 Processor -- start 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.027+0000 7f23a4381640 1 -- start start 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.027+0000 7f23a4381640 10 monclient: init 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient: _add_conns ranks=[7,6,0,1,9,8,4,2,10,3,5] 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f239c0a0920 0x7f239c134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): picked mon.noname-i con 0x7f239c0a0920 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c135460 0x7f239c0a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): picked mon.noname-d con 0x7f239c135460 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f239c06ff10 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239c0618f0 con 0x7f239c06ff10 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a291e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f239c06ff10 0x7f239c0a2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52958/0 (socket says 172.21.15.28:52958) 2024-03-27T21:30:24.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a291e640 1 -- 172.21.15.28:0/6178322 learned_addr learned my addr 172.21.15.28:0/6178322 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0716a0 con 0x7f239c135460 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 1 -- 172.21.15.28:0/6178322 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f239c0713c0 con 0x7f239c0a0920 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a4381640 10 monclient(hunting): authenticate will time out at 846.335196s 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f239c0a0920 0x7f239c134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): get_auth_request con 0x7f239c0a0920 auth_method 0 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c135460 0x7f239c0a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): get_auth_request con 0x7f239c135460 auth_method 0 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a111b640 1 -- 172.21.15.28:0/6178322 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438957592 0 0) 0x7f239c0618f0 con 0x7f239c06ff10 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a211d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a111b640 10 monclient(hunting): _negotiate 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a111b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a111b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a111b640 10 monclient(hunting): my global_id is 4428 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a111b640 1 -- 172.21.15.28:0/6178322 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2388003520 con 0x7f239c06ff10 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.028+0000 7f23a191c640 10 monclient(hunting): handle_auth_done global_id 4326 payload 274 2024-03-27T21:30:24.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 1 -- 172.21.15.28:0/6178322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f239c0a0920 msgr2=0x7f239c134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f239c0a0920 0x7f239c134f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 1 -- 172.21.15.28:0/6178322 >> v1:172.21.15.28:6789/0 conn(0x7f239c06ff10 legacy=0x7f239c0a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 1 monclient: found mon.noname-d 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.029+0000 7f23a191c640 1 -- 172.21.15.28:0/6178322 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c0a46c0 con 0x7f239c135460 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a191c640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c135460 0x7f239c0a0d00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f238c00dbf0 tx=0x7f238c02fb00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ed6c8314a8752719 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 1 -- 172.21.15.28:0/6178322 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f238c00d2e0 con 0x7f239c135460 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: dump: 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.063 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a4381640 5 monclient: authenticate success, global_id 4326 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a4381640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 1 -- 172.21.15.28:0/6178322 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c0314b0 con 0x7f239c135460 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a4381640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a4381640 4 set_mon_vals no callback set 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 1 -- 172.21.15.28:0/6178322 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f238c031a90 con 0x7f239c135460 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.030+0000 7f23a111b640 10 monclient: dump: 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.065 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 10 monclient: shutdown 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 -- 172.21.15.28:0/6178322 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c135460 msgr2=0x7f239c0a0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c135460 0x7f239c0a0d00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f238c00dbf0 tx=0x7f238c02fb00 comp rx=0 tx=0).stop 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 -- 172.21.15.28:0/6178322 shutdown_connections 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c135460 0x7f239c0a0d00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 --2- 172.21.15.28:0/6178322 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f239c0a0920 0x7f239c134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 -- 172.21.15.28:0/6178322 >> 172.21.15.28:0/6178322 conn(0x7f239c0a7810 msgr2=0x7f239c0a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 -- 172.21.15.28:0/6178322 shutdown_connections 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.031+0000 7f23a4381640 1 -- 172.21.15.28:0/6178322 wait complete. 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.032+0000 7f23a4381640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.032+0000 7f23a4381640 10 monclient: monmap: 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:24.067 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 1 librados: starting msgr at 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 1 librados: starting objecter 2024-03-27T21:30:24.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 1 Processor -- start 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 1 -- start start 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 1 librados: setting wanted keys 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 1 librados: calling monclient init 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.033+0000 7f23a4381640 10 monclient: init 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 10 monclient: _add_conns ranks=[1,6,8,7,4,3,5,0,2] 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 0x7f239c099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 10 monclient(hunting): picked mon.noname-f con 0x7f239c06ff10 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 0x7f239c099f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 10 monclient(hunting): picked mon.noname-d con 0x7f239c0a0920 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a4381640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 0x7f239c09a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a211d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 0x7f239c099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a211d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 0x7f239c099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:37962/0 (socket says 172.21.15.28:37962) 2024-03-27T21:30:24.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a191c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 0x7f239c099f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.034+0000 7f23a191c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 0x7f239c099f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43450/0 (socket says 172.21.15.28:43450) 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 0x7f239c09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 0x7f239c09a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42432/0 (socket says 172.21.15.28:42432) 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 10 monclient(hunting): picked mon.noname-e con 0x7f239c09d4a0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239c070640 con 0x7f239c06ff10 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f239c09c890 con 0x7f239c0a0920 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f239c09c240 con 0x7f239c09d4a0 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a4381640 10 monclient(hunting): authenticate will time out at 846.342124s 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 1 -- 172.21.15.28:0/3117722634 learned_addr learned my addr 172.21.15.28:0/3117722634 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): get_auth_request con 0x7f239c06ff10 auth_method 0 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a191c640 10 monclient(hunting): get_auth_request con 0x7f239c0a0920 auth_method 0 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a191c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a191c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a191c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): get_auth_request con 0x7f239c09d4a0 auth_method 0 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a291e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 10 monclient(hunting): handle_auth_done global_id 4456 payload 824 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.035+0000 7f23a211d640 1 -- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 msgr2=0x7f239c09a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 0x7f239c09a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 1 -- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 msgr2=0x7f239c099f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 0x7f239c099f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 1 monclient: found mon.noname-f 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 1 -- 172.21.15.28:0/3117722634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c00d8a0 con 0x7f239c06ff10 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a191c640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 0x7f239c099f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:24.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a291e640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 0x7f239c09a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a211d640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 0x7f239c099a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f239800e9b0 tx=0x7f239800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 client.?.objecter ms_handle_connect 0x7f239c06ff10 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2398009670 con 0x7f239c06ff10 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: dump: 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.073 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239800ce10 con 0x7f239c06ff10 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f23980138e0 con 0x7f239c06ff10 2024-03-27T21:30:24.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a091a640 4 set_mon_vals no callback set 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f2392ffd640 10 monclient: dump: 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.075 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a4381640 5 monclient: authenticate success, global_id 4456 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a4381640 10 monclient: _renew_subs 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a4381640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.036+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f239c09c520 con 0x7f239c06ff10 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.037+0000 7f23a4381640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.037+0000 7f23a4381640 10 monclient: _renew_subs 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.037+0000 7f23a4381640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.037+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239c06cc10 con 0x7f239c06ff10 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.037+0000 7f23a4381640 1 librados: init done 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f2398013470 con 0x7f239c06ff10 2024-03-27T21:30:24.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f23a4381640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f23a4381640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f23a4381640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239c067350 con 0x7f239c06ff10 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f238003a250 0x7f238003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f239804a3a0 con 0x7f239c06ff10 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 10 client.4456.objecter ms_dispatch 0x7f239c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 3 client.4456.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 3 client.4456.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f2392ffd640 20 client.4456.objecter dump_active .. 0 homeless 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f23a191c640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f238003a250 0x7f238003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.038+0000 7f23a191c640 10 monclient: get_auth_request con 0x7f238003a250 auth_method 0 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.039+0000 7f23a191c640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f238003a250 0x7f238003c710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f238c039000 tx=0x7f238c00d000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.039+0000 7f2392ffd640 10 client.4456.objecter ms_handle_connect 0x7f238003a250 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.043+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f239801b3b0 con 0x7f239c06ff10 2024-03-27T21:30:24.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.043+0000 7f2392ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.043+0000 7f2392ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.163+0000 7f17688ce640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.163+0000 7f17688ce640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.163+0000 7f17688ce640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.163+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f17641a1d10 con 0x7f176409fee0 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7f1752ffd640 1 -- 172.21.15.28:0/3388983364 <== mon.6 v2:172.21.15.28:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1754013b80 con 0x7f176409fee0 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7f1752ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7f1752ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:24.153 INFO:teuthology.orchestra.run.smithi028.stdout:51539607556 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7fb4643a3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7fb4643a3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7fb4643a3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.164+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb45c06a260 con 0x7fb45c0a23c0 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.165+0000 7fb452ffd640 1 -- 172.21.15.28:0/3560619529 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb44c03f090 con 0x7fb45c0a23c0 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.165+0000 7fb452ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.165+0000 7fb452ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:24.154 INFO:teuthology.orchestra.run.smithi028.stdout:51539607555 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 10 librados: watch_flush enter 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 10 librados: watch_flush exit 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 20 client.4281.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 10 client.4281.objecter successfully canceled tick 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f174403a180 msgr2=0x7f174403c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f174403a180 0x7f174403c640 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f175803e000 tx=0x7f1758038000 comp rx=0 tx=0).stop 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 10 monclient: shutdown 2024-03-27T21:30:24.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 msgr2=0x7f17641c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.166+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 0x7f17641c7660 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f175400d8f0 tx=0x7f175400ddb0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 shutdown_connections 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f174403a180 0x7f174403c640 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f17640a1940 0x7f17641b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f17640a22a0 0x7f17641b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 --2- 172.21.15.28:0/3388983364 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f176409fee0 0x7f17641c7660 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 >> 172.21.15.28:0/3388983364 conn(0x7f17640a65f0 msgr2=0x7f17640662e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 shutdown_connections 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 -- 172.21.15.28:0/3388983364 wait complete. 2024-03-27T21:30:24.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.167+0000 7f17688ce640 1 librados: shutdown 2024-03-27T21:30:24.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 10 librados: watch_flush enter 2024-03-27T21:30:24.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 10 librados: watch_flush exit 2024-03-27T21:30:24.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 20 client.4401.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 10 client.4401.objecter successfully canceled tick 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb44003a250 msgr2=0x7fb44003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb44003a250 0x7fb44003c710 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb458009e10 tx=0x7fb458009190 comp rx=0 tx=0).stop 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 10 monclient: shutdown 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 msgr2=0x7fb45c12ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.168+0000 7fb4643a3640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 0x7fb45c12ed10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b9d0 tx=0x7fb44c00be90 comp rx=0 tx=0).stop 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 shutdown_connections 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb44003a250 0x7fb44003c710 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb45c0a31f0 0x7fb45c1c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb45c0a23c0 0x7fb45c12ed10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 --2- 172.21.15.28:0/3560619529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb45c09dc90 0x7fb45c1c3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 >> 172.21.15.28:0/3560619529 conn(0x7fb45c0a65f0 msgr2=0x7fb45c0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 shutdown_connections 2024-03-27T21:30:24.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 -- 172.21.15.28:0/3560619529 wait complete. 2024-03-27T21:30:24.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.169+0000 7fb4643a3640 1 librados: shutdown 2024-03-27T21:30:24.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607556 got 51539607556 for osd.4 2024-03-27T21:30:24.169 DEBUG:teuthology.parallel:result is None 2024-03-27T21:30:24.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607555 for osd.3 2024-03-27T21:30:24.175 DEBUG:teuthology.parallel:result is None 2024-03-27T21:30:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.194+0000 7f0afebae640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-03-27T21:30:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.194+0000 7f0afebae640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-03-27T21:30:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.194+0000 7f0afebae640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.194+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ad80052f0 con 0x7f0ae8009bc0 2024-03-27T21:30:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.195+0000 7f0af57fa640 1 -- 172.21.15.28:0/3959105972 <== mon.6 v2:172.21.15.28:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0af0023300 con 0x7f0ae8009bc0 2024-03-27T21:30:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.195+0000 7f0af57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-03-27T21:30:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.195+0000 7f0af57fa640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:24.184 INFO:teuthology.orchestra.run.smithi028.stdout:47244640258 2024-03-27T21:30:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 10 librados: watch_flush enter 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 10 librados: watch_flush exit 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 20 client.4290.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 10 client.4290.objecter successfully canceled tick 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0adc03a280 msgr2=0x7f0adc03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0adc03a280 0x7f0adc03c740 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0aec035000 tx=0x7f0aec030000 comp rx=0 tx=0).stop 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 10 monclient: shutdown 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 msgr2=0x7f0af809b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0af809b6f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0af0007740 tx=0x7f0af0007b40 comp rx=0 tx=0).stop 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 shutdown_connections 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0adc03a280 0x7f0adc03c740 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0ae8009bc0 0x7f0af809b6f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0ae8004d00 0x7f0af8131ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 --2- 172.21.15.28:0/3959105972 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0ae80041f0 0x7f0af81caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 >> 172.21.15.28:0/3959105972 conn(0x7f0af80a9430 msgr2=0x7f0af81358f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 shutdown_connections 2024-03-27T21:30:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 -- 172.21.15.28:0/3959105972 wait complete. 2024-03-27T21:30:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.197+0000 7f0afebae640 1 librados: shutdown 2024-03-27T21:30:24.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640258 for osd.0 2024-03-27T21:30:24.197 DEBUG:teuthology.parallel:result is None 2024-03-27T21:30:24.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.275+0000 7fe7400f7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-03-27T21:30:24.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.275+0000 7fe7400f7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-03-27T21:30:24.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.275+0000 7fe7400f7640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:30:24.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.275+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe7380672e0 con 0x7fe7381339e0 2024-03-27T21:30:24.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.276+0000 7fe72e7fc640 1 -- 172.21.15.28:0/2983792363 <== mon.7 v2:172.21.15.63:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe728042020 con 0x7fe7381339e0 2024-03-27T21:30:24.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.276+0000 7fe72e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-03-27T21:30:24.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.276+0000 7fe72e7fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:24.265 INFO:teuthology.orchestra.run.smithi028.stdout:47244640259 2024-03-27T21:30:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 10 librados: watch_flush enter 2024-03-27T21:30:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 10 librados: watch_flush exit 2024-03-27T21:30:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 20 client.4381.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 10 client.4381.objecter successfully canceled tick 2024-03-27T21:30:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe71c03a250 msgr2=0x7fe71c03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe71c03a250 0x7fe71c03c710 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe73400aed0 tx=0x7fe734008040 comp rx=0 tx=0).stop 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 10 monclient: shutdown 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe7381339e0 msgr2=0x7fe7381cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe7381339e0 0x7fe7381cb3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe728032000 tx=0x7fe7280046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 shutdown_connections 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe71c03a250 0x7fe71c03c710 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe7381339e0 0x7fe7381cb3e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe738136d00 0x7fe7381cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 --2- 172.21.15.28:0/2983792363 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe7380a3d70 0x7fe738132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 >> 172.21.15.28:0/2983792363 conn(0x7fe7380a9430 msgr2=0x7fe7380662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 shutdown_connections 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 -- 172.21.15.28:0/2983792363 wait complete. 2024-03-27T21:30:24.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.278+0000 7fe7400f7640 1 librados: shutdown 2024-03-27T21:30:24.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2024-03-27T21:30:24.278 DEBUG:teuthology.parallel:result is None 2024-03-27T21:30:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3c2688640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-03-27T21:30:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3c2688640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-03-27T21:30:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3c2688640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3b4007300 con 0x7fa3b4021850 2024-03-27T21:30:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3b1ffb640 1 -- 172.21.15.28:0/862154343 <== mon.5 v2:172.21.15.63:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa3b801bb50 con 0x7fa3b4021850 2024-03-27T21:30:24.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-03-27T21:30:24.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.301+0000 7fa3b1ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:24.291 INFO:teuthology.orchestra.run.smithi028.stdout:47244640258 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.303+0000 7fa3c2688640 10 librados: watch_flush enter 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.303+0000 7fa3c2688640 10 librados: watch_flush exit 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.303+0000 7fa3c2688640 20 client.4316.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.303+0000 7fa3c2688640 10 client.4316.objecter successfully canceled tick 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa3a003a280 msgr2=0x7fa3a003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa3a003a280 0x7fa3a003c740 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40259f0 tx=0x7fa3bc0aa000 comp rx=0 tx=0).stop 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 10 monclient: shutdown 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa3b4021850 msgr2=0x7fa3b4021cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa3b4021850 0x7fa3b4021cb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009d10 tx=0x7fa3b800d910 comp rx=0 tx=0).stop 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 shutdown_connections 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa3a003a280 0x7fa3a003c740 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa3b4021850 0x7fa3b4021cb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa3b40ba5b0 0x7fa3b4152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 --2- 172.21.15.28:0/862154343 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa3b4028ac0 0x7fa3b4151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 >> 172.21.15.28:0/862154343 conn(0x7fa3b4008050 msgr2=0x7fa3b40b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 shutdown_connections 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 -- 172.21.15.28:0/862154343 wait complete. 2024-03-27T21:30:24.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.304+0000 7fa3c2688640 1 librados: shutdown 2024-03-27T21:30:24.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640258 for osd.2 2024-03-27T21:30:24.303 DEBUG:teuthology.parallel:result is None 2024-03-27T21:30:24.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.330+0000 7f23a4381640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-03-27T21:30:24.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.330+0000 7f23a4381640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-03-27T21:30:24.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.330+0000 7f23a4381640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:24.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.330+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f239c09c6b0 con 0x7f239c06ff10 2024-03-27T21:30:24.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.331+0000 7f2392ffd640 1 -- 172.21.15.28:0/3117722634 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2398017020 con 0x7f239c06ff10 2024-03-27T21:30:24.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.331+0000 7f2392ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-03-27T21:30:24.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.331+0000 7f2392ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:24.320 INFO:teuthology.orchestra.run.smithi028.stdout:47244640259 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 10 librados: watch_flush enter 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 10 librados: watch_flush exit 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 20 client.4456.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 10 client.4456.objecter successfully canceled tick 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f238003a250 msgr2=0x7f238003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f238003a250 0x7f238003c710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f238c039000 tx=0x7f238c00d000 comp rx=0 tx=0).stop 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 10 monclient: shutdown 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.323 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 msgr2=0x7f239c099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 0x7f239c099a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f239800e9b0 tx=0x7f239800ee70 comp rx=0 tx=0).stop 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 shutdown_connections 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f238003a250 0x7f238003c710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f239c09d4a0 0x7f239c09a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f239c0a0920 0x7f239c099f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 --2- 172.21.15.28:0/3117722634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f239c06ff10 0x7f239c099a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 >> 172.21.15.28:0/3117722634 conn(0x7f239c0a7810 msgr2=0x7f239c132bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 shutdown_connections 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 -- 172.21.15.28:0/3117722634 wait complete. 2024-03-27T21:30:24.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.333+0000 7f23a4381640 1 librados: shutdown 2024-03-27T21:30:24.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2024-03-27T21:30:24.332 DEBUG:teuthology.parallel:result is None 2024-03-27T21:30:24.333 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-27T21:30:24.333 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.483+0000 7fa8deb59640 10 monclient: get_monmap_and_config 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.483+0000 7fa8deb59640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.484+0000 7fa8deb59640 10 monclient: monmap: 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:24.484765+0000 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:24.484765+0000 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.473 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.484+0000 7fa8deb59640 1 Processor -- start 2024-03-27T21:30:24.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.484+0000 7fa8deb59640 1 -- start start 2024-03-27T21:30:24.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.484+0000 7fa8deb59640 10 monclient: init 2024-03-27T21:30:24.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient: _add_conns ranks=[3,10,2,8,0,9,6,7,1,4,5] 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d80a4830 0x7fa8d80a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): picked mon.noname-g con 0x7fa8d80a4830 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8d80a3c50 0x7fa8d8136dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): picked mon.noname-f con 0x7fa8d80a3c50 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 0x7fa8d81377c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): picked mon.noname-b con 0x7fa8d8137310 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d809cf30 con 0x7fa8d80a3c50 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80a2280 con 0x7fa8d8137310 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d80a5150 con 0x7fa8d80a4830 2024-03-27T21:30:24.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8deb59640 10 monclient(hunting): authenticate will time out at 846.791889s 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 0x7fa8d81377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 0x7fa8d81377c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36514/0 (socket says 172.21.15.28:36514) 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 -- 172.21.15.28:0/1656994670 learned_addr learned my addr 172.21.15.28:0/1656994670 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): get_auth_request con 0x7fa8d8137310 auth_method 0 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8d7fff640 1 --2- 172.21.15.28:0/1656994670 >> v2:172.21.15.63:3300/0 conn(0x7fa8d80a3c50 0x7fa8d8136dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8d7fff640 10 monclient(hunting): get_auth_request con 0x7fa8d80a3c50 auth_method 0 2024-03-27T21:30:24.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8d7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dc8f5640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d80a4830 0x7fa8d80a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient(hunting): handle_auth_done global_id 4277 payload 274 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 -- 172.21.15.28:0/1656994670 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d80a4830 msgr2=0x7fa8d80a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d80a4830 0x7fa8d80a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 -- 172.21.15.28:0/1656994670 >> v2:172.21.15.63:3300/0 conn(0x7fa8d80a3c50 msgr2=0x7fa8d8136dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 --2- 172.21.15.28:0/1656994670 >> v2:172.21.15.63:3300/0 conn(0x7fa8d80a3c50 0x7fa8d8136dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 monclient: found mon.noname-b 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dd0f6640 1 -- 172.21.15.28:0/1656994670 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d80618f0 con 0x7fa8d8137310 2024-03-27T21:30:24.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dc8f5640 10 monclient: get_auth_request con 0x7fa8d80a4830 auth_method 0 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8dc8f5640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d80a4830 0x7fa8d80a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.485+0000 7fa8d7fff640 1 --2- 172.21.15.28:0/1656994670 >> v2:172.21.15.63:3300/0 conn(0x7fa8d80a3c50 0x7fa8d8136dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8dd0f6640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 0x7fa8d81377c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00098a0 tx=0x7fa8c002b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db1eb7640ec2447 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 1 -- 172.21.15.28:0/1656994670 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8c0031980 con 0x7fa8d8137310 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: dump: 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.487 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 1 -- 172.21.15.28:0/1656994670 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c002f050 con 0x7fa8d8137310 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8deb59640 5 monclient: authenticate success, global_id 4277 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8deb59640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 1 -- 172.21.15.28:0/1656994670 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8c00323a0 con 0x7fa8d8137310 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8d77fe640 10 monclient: dump: 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.489 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8deb59640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.486+0000 7fa8deb59640 4 set_mon_vals no callback set 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 10 monclient: shutdown 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 -- 172.21.15.28:0/1656994670 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 msgr2=0x7fa8d81377c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 0x7fa8d81377c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00098a0 tx=0x7fa8c002b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 -- 172.21.15.28:0/1656994670 shutdown_connections 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d8137310 0x7fa8d81377c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 --2- 172.21.15.28:0/1656994670 >> v2:172.21.15.63:3300/0 conn(0x7fa8d80a3c50 0x7fa8d8136dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 --2- 172.21.15.28:0/1656994670 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d80a4830 0x7fa8d80a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 -- 172.21.15.28:0/1656994670 >> 172.21.15.28:0/1656994670 conn(0x7fa8d80a9390 msgr2=0x7fa8d80a97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 -- 172.21.15.28:0/1656994670 shutdown_connections 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 -- 172.21.15.28:0/1656994670 wait complete. 2024-03-27T21:30:24.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 10 monclient: monmap: 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.492 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 librados: starting msgr at 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.487+0000 7fa8deb59640 1 librados: starting objecter 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 Processor -- start 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 -- start start 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 librados: setting wanted keys 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 librados: calling monclient init 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient: init 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient: _add_conns ranks=[0,2,3,1,7,6,5,8,4] 2024-03-27T21:30:24.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8d80a3c50 0x7fa8d81cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): picked mon.noname-a con 0x7fa8d80a3c50 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 0x7fa8d8134300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): picked mon.noname-b con 0x7fa8d80a4830 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d8137310 0x7fa8d8134840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): picked mon.noname-g con 0x7fa8d8137310 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81cc440 con 0x7fa8d80a3c50 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d81cbc40 con 0x7fa8d80a4830 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d8120290 con 0x7fa8d8137310 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8deb59640 10 monclient(hunting): authenticate will time out at 846.795491s 2024-03-27T21:30:24.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 0x7fa8d8134300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 0x7fa8d8134300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36528/0 (socket says 172.21.15.28:36528) 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 1 -- 172.21.15.28:0/4128168490 learned_addr learned my addr 172.21.15.28:0/4128168490 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 10 monclient(hunting): get_auth_request con 0x7fa8d80a4830 auth_method 0 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8dc8f5640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8d80a3c50 0x7fa8d81cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8dc8f5640 10 monclient(hunting): get_auth_request con 0x7fa8d80a3c50 auth_method 0 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8dc8f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8dc8f5640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8dc8f5640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.488+0000 7fa8d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dc8f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dc8f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dc8f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dd0f6640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d8137310 0x7fa8d8134840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dd0f6640 10 monclient(hunting): get_auth_request con 0x7fa8d8137310 auth_method 0 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dd0f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dd0f6640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dd0f6640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 10 monclient(hunting): handle_auth_done global_id 4286 payload 824 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 -- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d8137310 msgr2=0x7fa8d8134840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d8137310 0x7fa8d8134840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 -- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8d80a3c50 msgr2=0x7fa8d81cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8d80a3c50 0x7fa8d81cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 monclient: found mon.noname-b 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 -- 172.21.15.28:0/4128168490 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00094d0 con 0x7fa8d80a4830 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8dc8f5640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8d80a3c50 0x7fa8d81cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d7fff640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 0x7fa8d8134300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e810 tx=0x7fa8c800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 client.?.objecter ms_handle_connect 0x7fa8d80a4830 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8c800ee00 con 0x7fa8d80a4830 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:24.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: dump: 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.498 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800cb40 con 0x7fa8d80a4830 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 5 monclient: authenticate success, global_id 4286 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 10 monclient: _renew_subs 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d80a17e0 con 0x7fa8d80a4830 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa8c800ccb0 con 0x7fa8d80a4830 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d57fa640 10 monclient: dump: 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.500 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8d6ffd640 4 set_mon_vals no callback set 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 10 client.4286.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 10 monclient: _renew_subs 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d81217b0 con 0x7fa8d80a4830 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.489+0000 7fa8deb59640 1 librados: init done 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa8c800c6d0 con 0x7fa8d80a4830 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa8b803a250 0x7fa8b803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa8c8049ce0 con 0x7fa8d80a4830 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 10 client.4286.objecter ms_dispatch 0x7fa8d8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 3 client.4286.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:24.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 3 client.4286.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8deb59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8deb59640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8deb59640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8d57fa640 20 client.4286.objecter dump_active .. 0 homeless 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d8067350 con 0x7fa8d80a4830 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8dc8f5640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa8b803a250 0x7fa8b803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.490+0000 7fa8dc8f5640 10 monclient: get_auth_request con 0x7fa8b803a250 auth_method 0 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.491+0000 7fa8d57fa640 10 client.4286.objecter ms_handle_connect 0x7fa8b803a250 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.491+0000 7fa8dc8f5640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa8b803a250 0x7fa8b803c710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000d8a0 tx=0x7fa8d0007810 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.495+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa8c800c980 con 0x7fa8d80a4830 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.495+0000 7fa8d57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.495+0000 7fa8d57fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:24.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.672+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8d80a2840 con 0x7fa8b803a250 2024-03-27T21:30:24.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.674+0000 7fa8d57fa640 1 -- 172.21.15.28:0/4128168490 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39282 (secure 0 0 0) 0x7fa8d000de80 con 0x7fa8b803a250 2024-03-27T21:30:24.663 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:24.664 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 10 librados: watch_flush enter 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 10 librados: watch_flush exit 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 20 client.4286.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 10 client.4286.objecter successfully canceled tick 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa8b803a250 msgr2=0x7fa8b803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa8b803a250 0x7fa8b803c710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8d000d8a0 tx=0x7fa8d0007810 comp rx=0 tx=0).stop 2024-03-27T21:30:24.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 10 monclient: shutdown 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 msgr2=0x7fa8d8134300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 0x7fa8d8134300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8c800e810 tx=0x7fa8c800ecd0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 shutdown_connections 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa8b803a250 0x7fa8b803c710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa8d8137310 0x7fa8d8134840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa8d80a4830 0x7fa8d8134300 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 --2- 172.21.15.28:0/4128168490 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8d80a3c50 0x7fa8d81cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 >> 172.21.15.28:0/4128168490 conn(0x7fa8d80a9390 msgr2=0x7fa8d81bed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 shutdown_connections 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 -- 172.21.15.28:0/4128168490 wait complete. 2024-03-27T21:30:24.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.676+0000 7fa8deb59640 1 librados: shutdown 2024-03-27T21:30:24.675 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-27T21:30:24.635987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168328,"kb_used_data":1792,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062712,"statfs":{"total":579820584960,"available":579648217088,"internally_reserved":0,"allocated":1835008,"data_stored":1242618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000452"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":161,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.557815+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.557815+0000","last_peered":"2024-03-27T21:30:21.557815+0000","last_clean":"2024-03-27T21:30:21.557815+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.557815+0000","last_undegraded":"2024-03-27T21:30:21.557815+0000","last_fullsized":"2024-03-27T21:30:21.557815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":37955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":602112,"data_stored":505443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:30:24.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:30:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.787+0000 7f2d4e2cf640 10 monclient: get_monmap_and_config 2024-03-27T21:30:24.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.787+0000 7f2d4e2cf640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.787+0000 7f2d4e2cf640 10 monclient: monmap: 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:24.788719+0000 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:24.788719+0000 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.777 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:24.778 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.788+0000 7f2d4e2cf640 1 Processor -- start 2024-03-27T21:30:24.786 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.788+0000 7f2d4e2cf640 1 -- start start 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.788+0000 7f2d4e2cf640 10 monclient: init 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient: _add_conns ranks=[10,0,2,9,3,8,7,5,1,6,4] 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2d480a0920 0x7f2d48134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): picked mon.noname-f con 0x7f2d480a0920 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d48135460 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 0x7f2d4813bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): picked mon.noname-b con 0x7f2d4806ff10 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d480618f0 con 0x7f2d48135460 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d480716a0 con 0x7f2d480a0920 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d480713c0 con 0x7f2d4806ff10 2024-03-27T21:30:24.787 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4e2cf640 10 monclient(hunting): authenticate will time out at 847.095937s 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 0x7f2d4813bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 0x7f2d4813bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36536/0 (socket says 172.21.15.28:36536) 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 -- 172.21.15.28:0/1764839112 learned_addr learned my addr 172.21.15.28:0/1764839112 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): get_auth_request con 0x7f2d4806ff10 auth_method 0 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d47fff640 1 --2- 172.21.15.28:0/1764839112 >> v2:172.21.15.63:3300/0 conn(0x7f2d480a0920 0x7f2d48134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d47fff640 10 monclient(hunting): get_auth_request con 0x7f2d480a0920 auth_method 0 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.788 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d47fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d47fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient(hunting): handle_auth_done global_id 4295 payload 274 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d46ffd640 1 -- 172.21.15.28:0/1764839112 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006480591 0 0) 0x7f2d480618f0 con 0x7f2d48135460 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 -- 172.21.15.28:0/1764839112 >> v2:172.21.15.63:3300/0 conn(0x7f2d480a0920 msgr2=0x7f2d48134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 --2- 172.21.15.28:0/1764839112 >> v2:172.21.15.63:3300/0 conn(0x7f2d480a0920 0x7f2d48134f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 -- 172.21.15.28:0/1764839112 >> v1:172.21.15.28:6789/0 conn(0x7f2d48135460 legacy=0x7f2d480a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 monclient: found mon.noname-b 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d4c86c640 1 -- 172.21.15.28:0/1764839112 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480a1410 con 0x7f2d4806ff10 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.789+0000 7f2d46ffd640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d4c86c640 1 --2- 172.21.15.28:0/1764839112 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 0x7f2d4813bd90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009e50 tx=0x7f2d4002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a06a83b8e31aa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 1 -- 172.21.15.28:0/1764839112 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2d4002cc50 con 0x7f2d4806ff10 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: dump: 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.790 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d4e2cf640 5 monclient: authenticate success, global_id 4295 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d4e2cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 1 -- 172.21.15.28:0/1764839112 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4002cdd0 con 0x7f2d4806ff10 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.791 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d4e2cf640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 1 -- 172.21.15.28:0/1764839112 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2d40034860 con 0x7f2d4806ff10 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d4e2cf640 4 set_mon_vals no callback set 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.790+0000 7f2d46ffd640 10 monclient: dump: 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.792 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 10 monclient: shutdown 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/1764839112 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 msgr2=0x7f2d4813bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/1764839112 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 0x7f2d4813bd90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009e50 tx=0x7f2d4002be40 comp rx=0 tx=0).stop 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/1764839112 shutdown_connections 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/1764839112 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d4806ff10 0x7f2d4813bd90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/1764839112 >> v2:172.21.15.63:3300/0 conn(0x7f2d480a0920 0x7f2d48134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/1764839112 >> 172.21.15.28:0/1764839112 conn(0x7f2d480a7810 msgr2=0x7f2d480a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/1764839112 shutdown_connections 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/1764839112 wait complete. 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 10 monclient: build_initial_monmap 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 10 monclient: monmap: 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:24.794 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 librados: starting msgr at 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.791+0000 7f2d4e2cf640 1 librados: starting objecter 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 Processor -- start 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 -- start start 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 librados: setting wanted keys 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 librados: calling monclient init 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient: init 2024-03-27T21:30:24.795 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient: _add_conns ranks=[3,2,5,8,7,0,4,1,6] 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f2d4806ff10 0x7f2d481c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): picked mon.noname-g con 0x7f2d4806ff10 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 0x7f2d481c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): picked mon.noname-b con 0x7f2d480a0920 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2d481c9f60 0x7f2d48130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): picked mon.noname-h con 0x7f2d481c9f60 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d48099aa0 con 0x7f2d480a0920 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4809ad90 con 0x7f2d4806ff10 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:24.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4809b070 con 0x7f2d481c9f60 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d4e2cf640 10 monclient(hunting): authenticate will time out at 847.099455s 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 0x7f2d481c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 0x7f2d481c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36546/0 (socket says 172.21.15.28:36546) 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 1 -- 172.21.15.28:0/2864626559 learned_addr learned my addr 172.21.15.28:0/2864626559 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): get_auth_request con 0x7f2d480a0920 auth_method 0 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.792+0000 7f2d47fff640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f2d4806ff10 0x7f2d481c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4c86c640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2d481c9f60 0x7f2d48130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4c86c640 10 monclient(hunting): get_auth_request con 0x7f2d481c9f60 auth_method 0 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4c86c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4c86c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4c86c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d47fff640 10 monclient(hunting): get_auth_request con 0x7f2d4806ff10 auth_method 0 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d47fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d47fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d47fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 10 monclient(hunting): handle_auth_done global_id 4304 payload 824 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 -- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2d481c9f60 msgr2=0x7f2d48130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2d481c9f60 0x7f2d48130100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 -- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f2d4806ff10 msgr2=0x7f2d481c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f2d4806ff10 0x7f2d481c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 monclient: found mon.noname-b 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 -- 172.21.15.28:0/2864626559 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009b30 con 0x7f2d480a0920 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d477fe640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 0x7f2d481c9a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c3c0 tx=0x7f2d3800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 client.?.objecter ms_handle_connect 0x7f2d480a0920 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2d380052e0 con 0x7f2d480a0920 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: dump: 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.799 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.800 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38005480 con 0x7f2d480a0920 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 5 monclient: authenticate success, global_id 4304 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 10 monclient: _renew_subs 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d48070a00 con 0x7f2d480a0920 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2d38010300 con 0x7f2d480a0920 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d44ff9640 10 monclient: dump: 2024-03-27T21:30:24.801 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:24.802 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d45ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 10 client.4304.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 10 monclient: _renew_subs 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d48132390 con 0x7f2d480a0920 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.793+0000 7f2d4e2cf640 1 librados: init done 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f2d380035f0 con 0x7f2d480a0920 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d4e2cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d4e2cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d4e2cf640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d48067350 con 0x7f2d480a0920 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2d2803a280 0x7f2d2803c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f2d38049110 con 0x7f2d480a0920 2024-03-27T21:30:24.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 10 client.4304.objecter ms_dispatch 0x7f2d48000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 3 client.4304.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 3 client.4304.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d44ff9640 20 client.4304.objecter dump_active .. 0 homeless 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d47fff640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2d2803a280 0x7f2d2803c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.794+0000 7f2d47fff640 10 monclient: get_auth_request con 0x7f2d2803a280 auth_method 0 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.795+0000 7f2d44ff9640 10 client.4304.objecter ms_handle_connect 0x7f2d2803a280 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.795+0000 7f2d47fff640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2d2803a280 0x7f2d2803c740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006fd0 tx=0x7f2d30008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.799+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2d3800e870 con 0x7f2d480a0920 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.799+0000 7f2d44ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:24.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.799+0000 7f2d44ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:24.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.977+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d481ca340 con 0x7f2d2803a280 2024-03-27T21:30:24.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.979+0000 7f2d44ff9640 1 -- 172.21.15.28:0/2864626559 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39282 (secure 0 0 0) 0x7f2d481ca340 con 0x7f2d2803a280 2024-03-27T21:30:24.968 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:24.968 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.980+0000 7f2d4e2cf640 10 librados: watch_flush enter 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 10 librados: watch_flush exit 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 20 client.4304.objecter shutdown clearing up homeless session... 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 10 client.4304.objecter successfully canceled tick 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2d2803a280 msgr2=0x7f2d2803c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2d2803a280 0x7f2d2803c740 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d30006fd0 tx=0x7f2d30008040 comp rx=0 tx=0).stop 2024-03-27T21:30:24.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 10 monclient: shutdown 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 msgr2=0x7f2d481c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 0x7f2d481c9a20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c3c0 tx=0x7f2d3800c880 comp rx=0 tx=0).stop 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 shutdown_connections 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2d2803a280 0x7f2d2803c740 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2d481c9f60 0x7f2d48130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2d480a0920 0x7f2d481c9a20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 --2- 172.21.15.28:0/2864626559 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f2d4806ff10 0x7f2d481c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 >> 172.21.15.28:0/2864626559 conn(0x7f2d480a7810 msgr2=0x7f2d480662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 shutdown_connections 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 -- 172.21.15.28:0/2864626559 wait complete. 2024-03-27T21:30:24.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:24.981+0000 7f2d4e2cf640 1 librados: shutdown 2024-03-27T21:30:24.980 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-27T21:30:24.635987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168328,"kb_used_data":1792,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062712,"statfs":{"total":579820584960,"available":579648217088,"internally_reserved":0,"allocated":1835008,"data_stored":1242618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000452"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":161,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.557815+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.557815+0000","last_peered":"2024-03-27T21:30:21.557815+0000","last_clean":"2024-03-27T21:30:21.557815+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.557815+0000","last_undegraded":"2024-03-27T21:30:21.557815+0000","last_fullsized":"2024-03-27T21:30:21.557815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":37955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":602112,"data_stored":505443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:30:24.981 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-27T21:30:24.981 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-27T21:30:24.981 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-27T21:30:24.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-27T21:30:25.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.092+0000 7fd458a95640 10 monclient: get_monmap_and_config 2024-03-27T21:30:25.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.092+0000 7fd458a95640 10 monclient: build_initial_monmap 2024-03-27T21:30:25.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.092+0000 7fd458a95640 10 monclient: monmap: 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:25.093168+0000 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:25.093168+0000 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:25.082 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.092+0000 7fd458a95640 1 Processor -- start 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.092+0000 7fd458a95640 1 -- start start 2024-03-27T21:30:25.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.092+0000 7fd458a95640 10 monclient: init 2024-03-27T21:30:25.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:25.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient: _add_conns ranks=[3,2,9,10,8,0,4,1,7,5,6] 2024-03-27T21:30:25.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd45409bd70 0x7fd45406a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): picked mon.noname-g con 0x7fd45409bd70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 0x7fd45406ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): picked mon.noname-b con 0x7fd45406aa50 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd454139810 0x7fd45413bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): picked mon.noname-a con 0x7fd454139810 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45406b390 con 0x7fd454139810 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd454099d70 con 0x7fd45406aa50 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45409a050 con 0x7fd45409bd70 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd458a95640 10 monclient(hunting): authenticate will time out at 847.400325s 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 0x7fd45406ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd454139810 0x7fd45413bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 0x7fd45406ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36560/0 (socket says 172.21.15.28:36560) 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd454139810 0x7fd45413bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38498/0 (socket says 172.21.15.28:38498) 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 1 -- 172.21.15.28:0/3206006227 learned_addr learned my addr 172.21.15.28:0/3206006227 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): get_auth_request con 0x7fd45406aa50 auth_method 0 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): get_auth_request con 0x7fd454139810 auth_method 0 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd451d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.093+0000 7fd452d9d640 10 monclient(hunting): handle_auth_done global_id 4455 payload 274 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 -- 172.21.15.28:0/3206006227 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd45409bd70 msgr2=0x7fd45406a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd45259c640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd45409bd70 0x7fd45406a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd45409bd70 0x7fd45406a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 -- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 msgr2=0x7fd45406ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 0x7fd45406ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 monclient: found mon.noname-a 2024-03-27T21:30:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 -- 172.21.15.28:0/3206006227 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540618f0 con 0x7fd454139810 2024-03-27T21:30:25.098 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd451d9b640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 0x7fd45406ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd452d9d640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45413bc00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44402bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3a8c9a7ce22308 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd45159a640 1 -- 172.21.15.28:0/3206006227 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd44402cd00 con 0x7fd454139810 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd45159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd45159a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.094+0000 7fd45159a640 10 monclient: dump: 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.099 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 10 monclient: _finish_auth 0 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 10 monclient: _check_auth_tickets 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 5 monclient: authenticate success, global_id 4455 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 1 -- 172.21.15.28:0/3206006227 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44402ce80 con 0x7fd454139810 2024-03-27T21:30:25.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 4 set_mon_vals no callback set 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 1 -- 172.21.15.28:0/3206006227 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd4440327b0 con 0x7fd454139810 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd45159a640 10 monclient: dump: 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.101 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.102 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 10 monclient: shutdown 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 -- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 msgr2=0x7fd45413bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45413bc00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd444009d90 tx=0x7fd44402bce0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 -- 172.21.15.28:0/3206006227 shutdown_connections 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45413bc00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fd45406aa50 0x7fd45406ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 --2- 172.21.15.28:0/3206006227 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd45409bd70 0x7fd45406a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.103 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 -- 172.21.15.28:0/3206006227 >> 172.21.15.28:0/3206006227 conn(0x7fd4540a3140 msgr2=0x7fd4540a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 -- 172.21.15.28:0/3206006227 shutdown_connections 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.095+0000 7fd458a95640 1 -- 172.21.15.28:0/3206006227 wait complete. 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 10 monclient: build_initial_monmap 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 10 monclient: monmap: 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:25.104 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 1 librados: starting msgr at 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 1 librados: starting objecter 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 1 Processor -- start 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 1 -- start start 2024-03-27T21:30:25.105 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 1 librados: setting wanted keys 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 1 librados: calling monclient init 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.096+0000 7fd458a95640 10 monclient: init 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient: _add_conns ranks=[8,1,0,5,6,2,4,3,7] 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 0x7fd4541c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): picked mon.noname-e con 0x7fd45406aa50 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd45409bd70 0x7fd4541ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): picked mon.noname-f con 0x7fd45409bd70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): picked mon.noname-a con 0x7fd454139810 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540711f0 con 0x7fd454139810 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4541ca7d0 con 0x7fd45409bd70 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fd454071bf0 con 0x7fd45406aa50 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient(hunting): authenticate will time out at 847.403805s 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 0x7fd4541c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 0x7fd4541c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42436/0 (socket says 172.21.15.28:42436) 2024-03-27T21:30:25.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 1 -- 172.21.15.28:0/3436848274 learned_addr learned my addr 172.21.15.28:0/3436848274 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): get_auth_request con 0x7fd45406aa50 auth_method 0 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): get_auth_request con 0x7fd454139810 auth_method 0 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd45409bd70 0x7fd4541ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): get_auth_request con 0x7fd45409bd70 auth_method 0 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd451d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient(hunting): handle_auth_done global_id 4464 payload 824 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 -- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 msgr2=0x7fd4541c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 0x7fd4541c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 -- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd45409bd70 msgr2=0x7fd4541ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd45409bd70 0x7fd4541ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 monclient: found mon.noname-a 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:25.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 -- 172.21.15.28:0/3436848274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c0094d0 con 0x7fd454139810 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd45259c640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 0x7fd4541c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd452d9d640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45406ec10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd444033000 tx=0x7fd444004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 client.?.objecter ms_handle_connect 0x7fd454139810 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd444009450 con 0x7fd454139810 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: dump: 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.111 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.112 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: _finish_auth 0 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4440046c0 con 0x7fd454139810 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 5 monclient: authenticate success, global_id 4464 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient: _renew_subs 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd444009a70 con 0x7fd454139810 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd444004830 con 0x7fd454139810 2024-03-27T21:30:25.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd450d99640 4 set_mon_vals no callback set 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 client.4464.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd44affd640 10 monclient: dump: 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.114 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient: _renew_subs 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.097+0000 7fd458a95640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:25.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4540707f0 con 0x7fd454139810 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd458a95640 1 librados: init done 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fd44403b070 con 0x7fd454139810 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd43403a280 0x7fd43403c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fd44406c3c0 con 0x7fd454139810 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 10 client.4464.objecter ms_dispatch 0x7fd454000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 3 client.4464.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 3 client.4464.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd458a95640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd458a95640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd458a95640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd454067320 con 0x7fd454139810 2024-03-27T21:30:25.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.098+0000 7fd44affd640 20 client.4464.objecter dump_active .. 0 homeless 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.099+0000 7fd45259c640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd43403a280 0x7fd43403c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.099+0000 7fd45259c640 10 monclient: get_auth_request con 0x7fd43403a280 auth_method 0 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.099+0000 7fd44affd640 10 client.4464.objecter ms_handle_connect 0x7fd43403a280 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.099+0000 7fd45259c640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd43403a280 0x7fd43403c740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006fd0 tx=0x7fd44c008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.103+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fd444004250 con 0x7fd454139810 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.103+0000 7fd44affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.103+0000 7fd44affd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.320+0000 7fd458a95640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-03-27T21:30:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.320+0000 7fd458a95640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-03-27T21:30:25.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.320+0000 7fd458a95640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.320+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd454074770 con 0x7fd454139810 2024-03-27T21:30:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.321+0000 7fd44affd640 1 -- 172.21.15.28:0/3436848274 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd454074770 con 0x7fd454139810 2024-03-27T21:30:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.321+0000 7fd44affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-03-27T21:30:25.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.321+0000 7fd44affd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:25.310 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:25.310 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 10 librados: watch_flush enter 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 10 librados: watch_flush exit 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 20 client.4464.objecter shutdown clearing up homeless session... 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 10 client.4464.objecter successfully canceled tick 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd43403a280 msgr2=0x7fd43403c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd43403a280 0x7fd43403c740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd44c006fd0 tx=0x7fd44c008040 comp rx=0 tx=0).stop 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 10 monclient: shutdown 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:25.312 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 msgr2=0x7fd45406ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.322+0000 7fd458a95640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45406ec10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd444033000 tx=0x7fd444004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 shutdown_connections 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd43403a280 0x7fd43403c740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd454139810 0x7fd45406ec10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd45409bd70 0x7fd4541ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 --2- 172.21.15.28:0/3436848274 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd45406aa50 0x7fd4541c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 >> 172.21.15.28:0/3436848274 conn(0x7fd4540a3140 msgr2=0x7fd454132bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 shutdown_connections 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 -- 172.21.15.28:0/3436848274 wait complete. 2024-03-27T21:30:25.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.323+0000 7fd458a95640 1 librados: shutdown 2024-03-27T21:30:25.322 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-27T21:30:25.322 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-03-27T21:30:25.334 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-03-27T21:30:25.335 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T21:30:25.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.446+0000 7faed027d640 10 monclient: get_monmap_and_config 2024-03-27T21:30:25.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.446+0000 7faed027d640 10 monclient: build_initial_monmap 2024-03-27T21:30:25.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.446+0000 7faed027d640 10 monclient: monmap: 2024-03-27T21:30:25.435 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:25.447063+0000 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:25.447063+0000 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:25.436 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:25.437 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:25.437 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:25.437 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.446+0000 7faed027d640 1 Processor -- start 2024-03-27T21:30:25.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.446+0000 7faed027d640 1 -- start start 2024-03-27T21:30:25.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.446+0000 7faed027d640 10 monclient: init 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient: _add_conns ranks=[9,8,5,0,3,2,1,7,10,4,6] 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 0x7faec8134e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): picked mon.noname-a con 0x7faec809ece0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faec809f0c0 0x7faec80a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): picked mon.noname-e con 0x7faec809f0c0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faec809f4e0 0x7faec80a1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): picked mon.noname-h con 0x7faec809f4e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec81353c0 con 0x7faec809ece0 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec809cfc0 con 0x7faec809f4e0 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7faec809bdf0 con 0x7faec809f0c0 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faed027d640 10 monclient(hunting): authenticate will time out at 847.754247s 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 0x7faec8134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faec809f0c0 0x7faec80a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 0x7faec8134e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38528/0 (socket says 172.21.15.28:38528) 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 1 -- 172.21.15.28:0/2725690738 learned_addr learned my addr 172.21.15.28:0/2725690738 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): get_auth_request con 0x7faec809ece0 auth_method 0 2024-03-27T21:30:25.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): get_auth_request con 0x7faec809f0c0 auth_method 0 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece81a640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faec809f4e0 0x7faec80a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece81a640 10 monclient(hunting): get_auth_request con 0x7faec809f4e0 auth_method 0 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece81a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece81a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient(hunting): handle_auth_done global_id 4337 payload 274 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 -- 172.21.15.28:0/2725690738 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faec809f4e0 msgr2=0x7faec80a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faec809f4e0 0x7faec80a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 -- 172.21.15.28:0/2725690738 >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 msgr2=0x7faec8134e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 --2- 172.21.15.28:0/2725690738 >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 0x7faec8134e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient: _finish_hunting 0 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 monclient: found mon.noname-e 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:25.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faecd818640 1 -- 172.21.15.28:0/2725690738 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec80618f0 con 0x7faec809f0c0 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.447+0000 7faece019640 1 --2- 172.21.15.28:0/2725690738 >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 0x7faec8134e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faece81a640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faec809f4e0 0x7faec80a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd818640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faec809f0c0 0x7faec80a0fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faebc0097a0 tx=0x7faebc02b6f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2823dea5754db8d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 1 -- 172.21.15.28:0/2725690738 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faebc030980 con 0x7faec809f0c0 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: dump: 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.452 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: _finish_auth 0 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: _check_auth_tickets 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faed027d640 5 monclient: authenticate success, global_id 4337 2024-03-27T21:30:25.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faed027d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 1 -- 172.21.15.28:0/2725690738 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc02e050 con 0x7faec809f0c0 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faed027d640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faed027d640 4 set_mon_vals no callback set 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 1 -- 172.21.15.28:0/2725690738 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faebc0313a0 con 0x7faec809f0c0 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.448+0000 7faecd017640 10 monclient: dump: 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.454 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 10 monclient: shutdown 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 -- 172.21.15.28:0/2725690738 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faec809f0c0 msgr2=0x7faec80a0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faec809f0c0 0x7faec80a0fe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faebc0097a0 tx=0x7faebc02b6f0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 -- 172.21.15.28:0/2725690738 shutdown_connections 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7faec809f4e0 0x7faec80a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 --2- 172.21.15.28:0/2725690738 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7faec809f0c0 0x7faec80a0fe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 --2- 172.21.15.28:0/2725690738 >> v2:172.21.15.28:3300/0 conn(0x7faec809ece0 0x7faec8134e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 -- 172.21.15.28:0/2725690738 >> 172.21.15.28:0/2725690738 conn(0x7faec80a20d0 msgr2=0x7faec80a24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 -- 172.21.15.28:0/2725690738 shutdown_connections 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.449+0000 7faed027d640 1 -- 172.21.15.28:0/2725690738 wait complete. 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient: build_initial_monmap 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient: monmap: 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:25.456 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 librados: starting msgr at 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 librados: starting objecter 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 Processor -- start 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 -- start start 2024-03-27T21:30:25.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 librados: setting wanted keys 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 librados: calling monclient init 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient: init 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient: _add_conns ranks=[4,7,3,0,8,2,6,1,5] 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 0x7faec8133f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): picked mon.noname-c con 0x7faec809ece0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7faec809f0c0 0x7faec8134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): picked mon.noname-i con 0x7faec809f0c0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faec809f4e0 0x7faec81c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): picked mon.noname-g con 0x7faec809f4e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec812fa60 con 0x7faec809f4e0 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec812f430 con 0x7faec809ece0 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7faec812f710 con 0x7faec809f0c0 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faed027d640 10 monclient(hunting): authenticate will time out at 847.757581s 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 0x7faec8133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 0x7faec8133f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48476/0 (socket says 172.21.15.28:48476) 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 1 -- 172.21.15.28:0/2569516509 learned_addr learned my addr 172.21.15.28:0/2569516509 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 10 monclient(hunting): get_auth_request con 0x7faec809ece0 auth_method 0 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.450+0000 7faece019640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7faec809f0c0 0x7faec8134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece81a640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faec809f4e0 0x7faec81c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): get_auth_request con 0x7faec809f0c0 auth_method 0 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece81a640 10 monclient(hunting): get_auth_request con 0x7faec809f4e0 auth_method 0 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece81a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece81a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece81a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecd818640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 10 monclient(hunting): handle_auth_done global_id 4297 payload 824 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 -- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7faec809f0c0 msgr2=0x7faec8134490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7faec809f0c0 0x7faec8134490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 -- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faec809f4e0 msgr2=0x7faec81c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faec809f4e0 0x7faec81c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 10 monclient: _finish_hunting 0 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 monclient: found mon.noname-c 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 -- 172.21.15.28:0/2569516509 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb8009b30 con 0x7faec809ece0 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece81a640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faec809f4e0 0x7faec81c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faece019640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 0x7faec8133f50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009f20 tx=0x7faeb800c550 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 client.?.objecter ms_handle_connect 0x7faec809ece0 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faeb80090d0 con 0x7faec809ece0 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:25.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: dump: 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.462 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 5 monclient: authenticate success, global_id 4297 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb800f040 con 0x7faec809ece0 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 10 monclient: _renew_subs 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc009400 con 0x7faec809ece0 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7faeb8009250 con 0x7faec809ece0 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 10 client.4297.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faecc816640 4 set_mon_vals no callback set 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faec6ffd640 10 monclient: dump: 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.464 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 10 monclient: _renew_subs 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec812d850 con 0x7faec809ece0 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.451+0000 7faed027d640 1 librados: init done 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7faeb8014480 con 0x7faec809ece0 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7faeb403a250 0x7faeb403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faed027d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faed027d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faed027d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec812d180 con 0x7faec809ece0 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7faeb804a5e0 con 0x7faec809ece0 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 10 client.4297.objecter ms_dispatch 0x7faec8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:25.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 3 client.4297.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 3 client.4297.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faec6ffd640 20 client.4297.objecter dump_active .. 0 homeless 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faecd818640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7faeb403a250 0x7faeb403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.452+0000 7faecd818640 10 monclient: get_auth_request con 0x7faeb403a250 auth_method 0 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.453+0000 7faecd818640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7faeb403a250 0x7faeb403c710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faebc034000 tx=0x7faebc008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.453+0000 7faec6ffd640 10 client.4297.objecter ms_handle_connect 0x7faeb403a250 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.457+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7faeb8012930 con 0x7faec809ece0 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.457+0000 7faec6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.457+0000 7faec6ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.639+0000 7faed027d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.639+0000 7faed027d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.639+0000 7faed027d640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:25.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.639+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faec812d6a0 con 0x7faec809ece0 2024-03-27T21:30:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.640+0000 7faec6ffd640 1 -- 172.21.15.28:0/2569516509 <== mon.4 v2:172.21.15.28:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11794 (secure 0 0 0) 0x7faeb8012340 con 0x7faec809ece0 2024-03-27T21:30:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.640+0000 7faec6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:30:25.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.640+0000 7faec6ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:25.629 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:25.629 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:21.931135+0000","last_up_change":"2024-03-27T21:30:18.879901+0000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T21:30:18.680135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-27T21:30:19.526407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6801","nonce":33278},{"type":"v1","addr":"172.21.15.28:6803","nonce":33278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6805","nonce":33278},{"type":"v1","addr":"172.21.15.28:6807","nonce":33278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":33278},{"type":"v1","addr":"172.21.15.28:6815","nonce":33278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":33278},{"type":"v1","addr":"172.21.15.28:6811","nonce":33278}]},"public_addr":"172.21.15.28:6803/33278","cluster_addr":"172.21.15.28:6807/33278","heartbeat_back_addr":"172.21.15.28:6815/33278","heartbeat_front_addr":"172.21.15.28:6811/33278","state":["exists","up"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":33279},{"type":"v1","addr":"172.21.15.28:6802","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":33279},{"type":"v1","addr":"172.21.15.28:6806","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":33279},{"type":"v1","addr":"172.21.15.28:6814","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":33279},{"type":"v1","addr":"172.21.15.28:6810","nonce":33279}]},"public_addr":"172.21.15.28:6802/33279","cluster_addr":"172.21.15.28:6806/33279","heartbeat_back_addr":"172.21.15.28:6814/33279","heartbeat_front_addr":"172.21.15.28:6810/33279","state":["exists","up"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":33280},{"type":"v1","addr":"172.21.15.28:6817","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":33280},{"type":"v1","addr":"172.21.15.28:6819","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":33280},{"type":"v1","addr":"172.21.15.28:6823","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":33280},{"type":"v1","addr":"172.21.15.28:6821","nonce":33280}]},"public_addr":"172.21.15.28:6817/33280","cluster_addr":"172.21.15.28:6819/33280","heartbeat_back_addr":"172.21.15.28:6823/33280","heartbeat_front_addr":"172.21.15.28:6821/33280","state":["exists","up"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33504},{"type":"v1","addr":"172.21.15.63:6805","nonce":33504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":33504},{"type":"v1","addr":"172.21.15.63:6810","nonce":33504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33504},{"type":"v1","addr":"172.21.15.63:6815","nonce":33504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33504},{"type":"v1","addr":"172.21.15.63:6813","nonce":33504}]},"public_addr":"172.21.15.63:6805/33504","cluster_addr":"172.21.15.63:6810/33504","heartbeat_back_addr":"172.21.15.63:6815/33504","heartbeat_front_addr":"172.21.15.63:6813/33504","state":["exists","up"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33505},{"type":"v1","addr":"172.21.15.63:6817","nonce":33505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33505},{"type":"v1","addr":"172.21.15.63:6819","nonce":33505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33505},{"type":"v1","addr":"172.21.15.63:6823","nonce":33505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33505},{"type":"v1","addr":"172.21.15.63:6821","nonce":33505}]},"public_addr":"172.21.15.63:6817/33505","cluster_addr":"172.21.15.63:6819/33505","heartbeat_back_addr":"172.21.15.63:6823/33505","heartbeat_front_addr":"172.21.15.63:6821/33505","state":["exists","up"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33506},{"type":"v1","addr":"172.21.15.63:6801","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":33506},{"type":"v1","addr":"172.21.15.63:6804","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":33506},{"type":"v1","addr":"172.21.15.63:6811","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33506},{"type":"v1","addr":"172.21.15.63:6808","nonce":33506}]},"public_addr":"172.21.15.63:6801/33506","cluster_addr":"172.21.15.63:6804/33506","heartbeat_back_addr":"172.21.15.63:6811/33506","heartbeat_front_addr":"172.21.15.63:6808/33506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.360569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.424079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.458359+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.423025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.452402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.398176+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:30:25.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 10 librados: watch_flush enter 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 10 librados: watch_flush exit 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 20 client.4297.objecter shutdown clearing up homeless session... 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 10 client.4297.objecter successfully canceled tick 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7faeb403a250 msgr2=0x7faeb403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7faeb403a250 0x7faeb403c710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faebc034000 tx=0x7faebc008030 comp rx=0 tx=0).stop 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 10 monclient: shutdown 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 msgr2=0x7faec8133f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 0x7faec8133f50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009f20 tx=0x7faeb800c550 comp rx=0 tx=0).stop 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 shutdown_connections 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7faeb403a250 0x7faeb403c710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7faec809f0c0 0x7faec8134490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7faec809f4e0 0x7faec81c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 --2- 172.21.15.28:0/2569516509 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7faec809ece0 0x7faec8133f50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 >> 172.21.15.28:0/2569516509 conn(0x7faec80a20d0 msgr2=0x7faec81bc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 shutdown_connections 2024-03-27T21:30:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 -- 172.21.15.28:0/2569516509 wait complete. 2024-03-27T21:30:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.642+0000 7faed027d640 1 librados: shutdown 2024-03-27T21:30:25.642 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T21:30:18.680135+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-27T21:30:19.526407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T21:30:25.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.756+0000 7f4932281640 10 monclient: get_monmap_and_config 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.756+0000 7f4932281640 10 monclient: build_initial_monmap 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.756+0000 7f4932281640 10 monclient: monmap: 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:25.757032+0000 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:25.757032+0000 2024-03-27T21:30:25.745 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.756+0000 7f4932281640 1 Processor -- start 2024-03-27T21:30:25.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.756+0000 7f4932281640 1 -- start start 2024-03-27T21:30:25.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.756+0000 7f4932281640 10 monclient: init 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient: _add_conns ranks=[2,3,6,10,8,5,4,9,0,7,1] 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 0x7f492c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): picked mon.noname-b con 0x7f492c070f10 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137020 0x7f492c0a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): picked mon.noname-g con 0x7f492c137020 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 0x7f492c0a2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): picked mon.noname-d con 0x7f492c137460 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c06bfa0 con 0x7f492c070f10 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.755 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c06f840 con 0x7f492c137020 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f492c06ba50 con 0x7f492c137460 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f4932281640 10 monclient(hunting): authenticate will time out at 848.064149s 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 0x7f492c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 0x7f492c0a2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 0x7f492c0a2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43454/0 (socket says 172.21.15.28:43454) 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 0x7f492c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36574/0 (socket says 172.21.15.28:36574) 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 -- 172.21.15.28:0/1402615265 learned_addr learned my addr 172.21.15.28:0/1402615265 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): get_auth_request con 0x7f492c137460 auth_method 0 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): get_auth_request con 0x7f492c070f10 auth_method 0 2024-03-27T21:30:25.756 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137020 0x7f492c0a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): get_auth_request con 0x7f492c137020 auth_method 0 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.757 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient(hunting): handle_auth_done global_id 4344 payload 274 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 -- 172.21.15.28:0/1402615265 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137020 msgr2=0x7f492c0a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137020 0x7f492c0a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 -- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 msgr2=0x7f492c0712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 0x7f492c0712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient: _finish_hunting 0 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 monclient: found mon.noname-d 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f493081e640 1 -- 172.21.15.28:0/1402615265 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c0618f0 con 0x7f492c137460 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.757+0000 7f492bfff640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 0x7f492c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f493081e640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 0x7f492c0a2fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4924009e80 tx=0x7f492402bd70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=49d925aa770c7522 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 1 -- 172.21.15.28:0/1402615265 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f492402cb80 con 0x7f492c137460 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: dump: 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.759 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: _finish_auth 0 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 1 -- 172.21.15.28:0/1402615265 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492402cd00 con 0x7f492c137460 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f4932281640 5 monclient: authenticate success, global_id 4344 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f4932281640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:25.760 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f4932281640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 1 -- 172.21.15.28:0/1402615265 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4924034860 con 0x7f492c137460 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f4932281640 4 set_mon_vals no callback set 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.758+0000 7f492affd640 10 monclient: dump: 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.761 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 10 monclient: shutdown 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 -- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 msgr2=0x7f492c0a2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 0x7f492c0a2fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4924009e80 tx=0x7f492402bd70 comp rx=0 tx=0).stop 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 -- 172.21.15.28:0/1402615265 shutdown_connections 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f492c137460 0x7f492c0a2fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137020 0x7f492c0a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 --2- 172.21.15.28:0/1402615265 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f492c070f10 0x7f492c0712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 -- 172.21.15.28:0/1402615265 >> 172.21.15.28:0/1402615265 conn(0x7f492c0a44c0 msgr2=0x7f492c069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 -- 172.21.15.28:0/1402615265 shutdown_connections 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 1 -- 172.21.15.28:0/1402615265 wait complete. 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 10 monclient: build_initial_monmap 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.759+0000 7f4932281640 10 monclient: monmap: 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:25.763 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 librados: starting msgr at 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 librados: starting objecter 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 Processor -- start 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 -- start start 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 librados: setting wanted keys 2024-03-27T21:30:25.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 librados: calling monclient init 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient: init 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient: _add_conns ranks=[4,8,3,2,1,6,0,5,7] 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f492c070f10 0x7f492c1cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): picked mon.noname-c con 0x7f492c070f10 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 0x7f492c135760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): picked mon.noname-e con 0x7f492c137020 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137460 0x7f492c135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): picked mon.noname-g con 0x7f492c137460 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c06c490 con 0x7f492c137460 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1cc0f0 con 0x7f492c070f10 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:25.765 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f492c06c9c0 con 0x7f492c137020 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f4932281640 10 monclient(hunting): authenticate will time out at 848.067533s 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 0x7f492c135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 0x7f492c135760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42452/0 (socket says 172.21.15.28:42452) 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 1 -- 172.21.15.28:0/1486842482 learned_addr learned my addr 172.21.15.28:0/1486842482 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 10 monclient(hunting): get_auth_request con 0x7f492c137020 auth_method 0 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492bfff640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f492c070f10 0x7f492c1cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492bfff640 10 monclient(hunting): get_auth_request con 0x7f492c070f10 auth_method 0 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.760+0000 7f492bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137460 0x7f492c135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): get_auth_request con 0x7f492c137460 auth_method 0 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:25.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f493081e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 10 monclient(hunting): handle_auth_done global_id 4346 payload 824 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 -- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f492c070f10 msgr2=0x7f492c1cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f492c070f10 0x7f492c1cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 -- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137460 msgr2=0x7f492c135ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137460 0x7f492c135ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 monclient: found mon.noname-e 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 -- 172.21.15.28:0/1486842482 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009400 con 0x7f492c137020 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492b7fe640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 0x7f492c135760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f492000e980 tx=0x7f492000ee40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 client.?.objecter ms_handle_connect 0x7f492c137020 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4920009670 con 0x7f492c137020 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: dump: 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.769 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:25.770 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 5 monclient: authenticate success, global_id 4346 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000ce70 con 0x7f492c137020 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f49200138e0 con 0x7f492c137020 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 10 monclient: _renew_subs 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924009b30 con 0x7f492c137020 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f492a7fc640 4 set_mon_vals no callback set 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 10 client.4346.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4928ff9640 10 monclient: dump: 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:25.771 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:25.772 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 10 monclient: _renew_subs 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c121470 con 0x7f492c137020 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.761+0000 7f4932281640 1 librados: init done 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f4920013470 con 0x7f492c137020 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f491803a250 0x7f491803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4932281640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4932281640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4932281640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c074b30 con 0x7f492c137020 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f492004a2c0 con 0x7f492c137020 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 10 client.4346.objecter ms_dispatch 0x7f492c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 3 client.4346.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 3 client.4346.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:25.773 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f4928ff9640 20 client.4346.objecter dump_active .. 0 homeless 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f492bfff640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f491803a250 0x7f491803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.762+0000 7f492bfff640 10 monclient: get_auth_request con 0x7f491803a250 auth_method 0 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.763+0000 7f4928ff9640 10 client.4346.objecter ms_handle_connect 0x7f491803a250 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.763+0000 7f492bfff640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f491803a250 0x7f491803c710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f491c009cd0 tx=0x7f491c009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.767+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f492000ca00 con 0x7f492c137020 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.767+0000 7f4928ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:25.774 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.767+0000 7f4928ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:25.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.944+0000 7f4932281640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.944+0000 7f4932281640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.944+0000 7f4932281640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.944+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f492c120b20 con 0x7f492c137020 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.945+0000 7f4928ff9640 1 -- 172.21.15.28:0/1486842482 <== mon.8 v2:172.21.15.28:3304/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f492001b3b0 con 0x7f492c137020 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.945+0000 7f4928ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.945+0000 7f4928ff9640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:25.934 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2024-03-27T21:30:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.946+0000 7f4932281640 10 librados: watch_flush enter 2024-03-27T21:30:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 10 librados: watch_flush exit 2024-03-27T21:30:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 20 client.4346.objecter shutdown clearing up homeless session... 2024-03-27T21:30:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 10 client.4346.objecter successfully canceled tick 2024-03-27T21:30:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f491803a250 msgr2=0x7f491803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.936 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f491803a250 0x7f491803c710 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f491c009cd0 tx=0x7f491c009190 comp rx=0 tx=0).stop 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 10 monclient: shutdown 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 msgr2=0x7f492c135760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 0x7f492c135760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f492000e980 tx=0x7f492000ee40 comp rx=0 tx=0).stop 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 shutdown_connections 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f491803a250 0x7f491803c710 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f492c137020 0x7f492c135760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f492c137460 0x7f492c135ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 --2- 172.21.15.28:0/1486842482 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f492c070f10 0x7f492c1cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 >> 172.21.15.28:0/1486842482 conn(0x7f492c0a44c0 msgr2=0x7f492c0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 shutdown_connections 2024-03-27T21:30:25.937 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 -- 172.21.15.28:0/1486842482 wait complete. 2024-03-27T21:30:25.938 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:25.947+0000 7f4932281640 1 librados: shutdown 2024-03-27T21:30:25.946 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-27T21:30:26.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.061+0000 7fe95d3ab640 10 monclient: get_monmap_and_config 2024-03-27T21:30:26.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.061+0000 7fe95d3ab640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.061+0000 7fe95d3ab640 10 monclient: monmap: 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:26.062455+0000 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:26.062455+0000 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.059 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 Processor -- start 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 -- start start 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient: init 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient: _add_conns ranks=[6,7,4,10,2,1,0,8,3,9,5] 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 0x7fe958137070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): picked mon.noname-d con 0x7fe958136c90 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe9580a3ce0 0x7fe9581375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): picked mon.noname-i con 0x7fe9580a3ce0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:26.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 0x7fe9581339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): picked mon.noname-c con 0x7fe95809fe20 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580a2790 con 0x7fe95809fe20 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe958137af0 con 0x7fe958136c90 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580a24b0 con 0x7fe9580a3ce0 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe95d3ab640 10 monclient(hunting): authenticate will time out at 848.369460s 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 0x7fe9581339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe956ffd640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 0x7fe958137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 0x7fe9581339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48492/0 (socket says 172.21.15.28:48492) 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe956ffd640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 0x7fe958137070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43462/0 (socket says 172.21.15.28:43462) 2024-03-27T21:30:26.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 1 -- 172.21.15.28:0/3365762832 learned_addr learned my addr 172.21.15.28:0/3365762832 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 10 monclient(hunting): get_auth_request con 0x7fe95809fe20 auth_method 0 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe9577fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe956ffd640 10 monclient(hunting): get_auth_request con 0x7fe958136c90 auth_method 0 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe956ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe956ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.062+0000 7fe956ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe956ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe956ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe956ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9567fc640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe9580a3ce0 0x7fe9581375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9567fc640 10 monclient(hunting): get_auth_request con 0x7fe9580a3ce0 auth_method 0 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9567fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9567fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9567fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 10 monclient(hunting): handle_auth_done global_id 4315 payload 274 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 -- 172.21.15.28:0/3365762832 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe9580a3ce0 msgr2=0x7fe9581375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe9580a3ce0 0x7fe9581375b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 -- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 msgr2=0x7fe958137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 0x7fe958137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 monclient: found mon.noname-c 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 -- 172.21.15.28:0/3365762832 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580618f0 con 0x7fe95809fe20 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe956ffd640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 0x7fe958137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.063+0000 7fe9577fe640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 0x7fe9581339e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe950009e80 tx=0x7fe95002be00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=42a30a53b16b0196 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 1 -- 172.21.15.28:0/3365762832 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe95002cc10 con 0x7fe95809fe20 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: dump: 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.064 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 5 monclient: authenticate success, global_id 4315 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 1 -- 172.21.15.28:0/3365762832 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95002cd90 con 0x7fe95809fe20 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 4 set_mon_vals no callback set 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 1 -- 172.21.15.28:0/3365762832 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe950034860 con 0x7fe95809fe20 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe955ffb640 10 monclient: dump: 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.066 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 10 monclient: shutdown 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 -- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 msgr2=0x7fe9581339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 0x7fe9581339e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe950009e80 tx=0x7fe95002be00 comp rx=0 tx=0).stop 2024-03-27T21:30:26.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 -- 172.21.15.28:0/3365762832 shutdown_connections 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe95809fe20 0x7fe9581339e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe9580a3ce0 0x7fe9581375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/3365762832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe958136c90 0x7fe958137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 -- 172.21.15.28:0/3365762832 >> 172.21.15.28:0/3365762832 conn(0x7fe9580a9430 msgr2=0x7fe9580a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 -- 172.21.15.28:0/3365762832 shutdown_connections 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.064+0000 7fe95d3ab640 1 -- 172.21.15.28:0/3365762832 wait complete. 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 10 monclient: monmap: 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:26.068 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 1 librados: starting msgr at 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 1 librados: starting objecter 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 1 Processor -- start 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 1 -- start start 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 1 librados: setting wanted keys 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 1 librados: calling monclient init 2024-03-27T21:30:26.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.065+0000 7fe95d3ab640 10 monclient: init 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient: _add_conns ranks=[6,0,4,1,2,7,3,8,5] 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 0x7fe9581cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): picked mon.noname-d con 0x7fe95809fe20 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9580a3ce0 0x7fe958132f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): picked mon.noname-a con 0x7fe9580a3ce0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 0x7fe958133490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): picked mon.noname-c con 0x7fe958136c90 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581cc410 con 0x7fe9580a3ce0 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe958120350 con 0x7fe958136c90 2024-03-27T21:30:26.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580a1170 con 0x7fe95809fe20 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe95d3ab640 10 monclient(hunting): authenticate will time out at 848.373077s 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 0x7fe9581cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 0x7fe958133490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 0x7fe9581cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43464/0 (socket says 172.21.15.28:43464) 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 1 -- 172.21.15.28:0/130105112 learned_addr learned my addr 172.21.15.28:0/130105112 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): get_auth_request con 0x7fe95809fe20 auth_method 0 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 0x7fe958133490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48498/0 (socket says 172.21.15.28:48498) 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): get_auth_request con 0x7fe958136c90 auth_method 0 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9580a3ce0 0x7fe958132f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): get_auth_request con 0x7fe9580a3ce0 auth_method 0 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9567fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient(hunting): handle_auth_done global_id 4324 payload 824 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 -- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 msgr2=0x7fe9581cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 0x7fe9581cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 -- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9580a3ce0 msgr2=0x7fe958132f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9580a3ce0 0x7fe958132f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 monclient: found mon.noname-c 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 -- 172.21.15.28:0/130105112 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948009400 con 0x7fe958136c90 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe956ffd640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 0x7fe9581cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe9577fe640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 0x7fe958133490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe950009e50 tx=0x7fe950004a40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe93f7fe640 10 client.?.objecter ms_handle_connect 0x7fe958136c90 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.066+0000 7fe93f7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe950009510 con 0x7fe958136c90 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: dump: 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.074 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9500046c0 con 0x7fe958136c90 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 5 monclient: authenticate success, global_id 4324 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 10 monclient: _renew_subs 2024-03-27T21:30:26.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe950009b30 con 0x7fe958136c90 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe950004830 con 0x7fe958136c90 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 10 monclient: dump: 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.076 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 10 client.4324.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 10 monclient: _renew_subs 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe9557fa640 4 set_mon_vals no callback set 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95809e7b0 con 0x7fe958136c90 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe95d3ab640 1 librados: init done 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.067+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fe950004250 con 0x7fe958136c90 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe95d3ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe95d3ab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe94403a280 0x7fe94403c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe95d3ab640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe958120690 con 0x7fe958136c90 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fe95006bf30 con 0x7fe958136c90 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 10 client.4324.objecter ms_dispatch 0x7fe958000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 3 client.4324.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 3 client.4324.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 20 client.4324.objecter dump_active .. 0 homeless 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe956ffd640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe94403a280 0x7fe94403c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe956ffd640 10 monclient: get_auth_request con 0x7fe94403a280 auth_method 0 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe93f7fe640 10 client.4324.objecter ms_handle_connect 0x7fe94403a280 2024-03-27T21:30:26.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.068+0000 7fe956ffd640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe94403a280 0x7fe94403c740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe9480113d0 tx=0x7fe948009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.072+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fe958120690 con 0x7fe958136c90 2024-03-27T21:30:26.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.072+0000 7fe93f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.072+0000 7fe93f7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:26.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.252+0000 7fe95d3ab640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-03-27T21:30:26.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.252+0000 7fe95d3ab640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-03-27T21:30:26.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.252+0000 7fe95d3ab640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.252+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe958120690 con 0x7fe958136c90 2024-03-27T21:30:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.253+0000 7fe93f7fe640 1 -- 172.21.15.28:0/130105112 <== mon.4 v2:172.21.15.28:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe958120690 con 0x7fe958136c90 2024-03-27T21:30:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.253+0000 7fe93f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-03-27T21:30:26.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.253+0000 7fe93f7fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:26.242 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 8 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 10 librados: watch_flush enter 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 10 librados: watch_flush exit 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 20 client.4324.objecter shutdown clearing up homeless session... 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 10 client.4324.objecter successfully canceled tick 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe94403a280 msgr2=0x7fe94403c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe94403a280 0x7fe94403c740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe9480113d0 tx=0x7fe948009190 comp rx=0 tx=0).stop 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 10 monclient: shutdown 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 msgr2=0x7fe958133490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.254+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 0x7fe958133490 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe950009e50 tx=0x7fe950004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 shutdown_connections 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe94403a280 0x7fe94403c740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe958136c90 0x7fe958133490 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe9580a3ce0 0x7fe958132f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 --2- 172.21.15.28:0/130105112 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe95809fe20 0x7fe9581cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 >> 172.21.15.28:0/130105112 conn(0x7fe9580a9430 msgr2=0x7fe9580662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 shutdown_connections 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 -- 172.21.15.28:0/130105112 wait complete. 2024-03-27T21:30:26.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.255+0000 7fe95d3ab640 1 librados: shutdown 2024-03-27T21:30:26.254 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-03-27T21:30:26.254 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:30:26.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.365+0000 7f1b7f08b640 10 monclient: get_monmap_and_config 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.365+0000 7f1b7f08b640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.365+0000 7f1b7f08b640 10 monclient: monmap: 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:26.365908+0000 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:26.365908+0000 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.354 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:26.355 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.365+0000 7f1b7f08b640 1 Processor -- start 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.365+0000 7f1b7f08b640 1 -- start start 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.365+0000 7f1b7f08b640 10 monclient: init 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient: _add_conns ranks=[6,3,2,10,7,4,8,1,9,5,0] 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 0x7f1b78134fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): picked mon.noname-d con 0x7f1b7809ed40 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b780a0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): picked mon.noname-g con 0x7f1b7809f120 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b780a1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): picked mon.noname-b con 0x7f1b7809f580 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7809d300 con 0x7f1b7809f580 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7809c070 con 0x7f1b7809f120 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78099070 con 0x7f1b7809ed40 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7f08b640 10 monclient(hunting): authenticate will time out at 848.672980s 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 0x7f1b78134fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b780a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 0x7f1b78134fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43472/0 (socket says 172.21.15.28:43472) 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 -- 172.21.15.28:0/515075832 learned_addr learned my addr 172.21.15.28:0/515075832 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): get_auth_request con 0x7f1b7809ed40 auth_method 0 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): get_auth_request con 0x7f1b7809f580 auth_method 0 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b77fff640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b780a0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b77fff640 10 monclient(hunting): get_auth_request con 0x7f1b7809f120 auth_method 0 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b77fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b77fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient(hunting): handle_auth_done global_id 4371 payload 274 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 -- 172.21.15.28:0/515075832 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 msgr2=0x7f1b780a0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b780a0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 -- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 msgr2=0x7f1b780a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:26.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b780a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 monclient: found mon.noname-d 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7ce27640 1 -- 172.21.15.28:0/515075832 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b780618f0 con 0x7f1b7809ed40 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.366+0000 7f1b7d628640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b780a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b7ce27640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 0x7f1b78134fc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0098d0 tx=0x7f1b6c02b790 comp rx=0 tx=0).ready entity=mon.6 client_cookie=4597bdf844141fab server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 1 -- 172.21.15.28:0/515075832 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1b6c031960 con 0x7f1b7809ed40 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: dump: 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.368 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b7f08b640 5 monclient: authenticate success, global_id 4371 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 1 -- 172.21.15.28:0/515075832 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c031ae0 con 0x7f1b7809ed40 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b7f08b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b7f08b640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 1 -- 172.21.15.28:0/515075832 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1b6c031c50 con 0x7f1b7809ed40 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b7f08b640 4 set_mon_vals no callback set 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.367+0000 7f1b777fe640 10 monclient: dump: 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.370 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 10 monclient: shutdown 2024-03-27T21:30:26.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 -- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 msgr2=0x7f1b78134fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 0x7f1b78134fc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0098d0 tx=0x7f1b6c02b790 comp rx=0 tx=0).stop 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 -- 172.21.15.28:0/515075832 shutdown_connections 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b780a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b780a0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/515075832 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1b7809ed40 0x7f1b78134fc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 -- 172.21.15.28:0/515075832 >> 172.21.15.28:0/515075832 conn(0x7f1b780a2040 msgr2=0x7f1b780a2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 -- 172.21.15.28:0/515075832 shutdown_connections 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 -- 172.21.15.28:0/515075832 wait complete. 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 10 monclient: monmap: 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:26.372 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.368+0000 7f1b7f08b640 1 librados: starting msgr at 2024-03-27T21:30:26.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 librados: starting objecter 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 Processor -- start 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 -- start start 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 librados: setting wanted keys 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 librados: calling monclient init 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient: init 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient: _add_conns ranks=[7,3,2,5,6,8,1,0,4] 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1b7809ed40 0x7f1b780997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): picked mon.noname-i con 0x7f1b7809ed40 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b78099d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): picked mon.noname-g con 0x7f1b7809f120 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b7809a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): picked mon.noname-b con 0x7f1b7809f580 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:26.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78133780 con 0x7f1b7809f580 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78131580 con 0x7f1b7809f120 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f1b78131860 con 0x7f1b7809ed40 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7f08b640 10 monclient(hunting): authenticate will time out at 848.676535s 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b7809a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b7809a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36582/0 (socket says 172.21.15.28:36582) 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 1 -- 172.21.15.28:0/3746805385 learned_addr learned my addr 172.21.15.28:0/3746805385 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 10 monclient(hunting): get_auth_request con 0x7f1b7809f580 auth_method 0 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.369+0000 7f1b7d628640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7ce27640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1b7809ed40 0x7f1b780997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7ce27640 10 monclient(hunting): get_auth_request con 0x7f1b7809ed40 auth_method 0 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7ce27640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7ce27640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7ce27640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b77fff640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b78099d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b77fff640 10 monclient(hunting): get_auth_request con 0x7f1b7809f120 auth_method 0 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b77fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b77fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 10 monclient(hunting): handle_auth_done global_id 4340 payload 824 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 -- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1b7809ed40 msgr2=0x7f1b780997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1b7809ed40 0x7f1b780997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 -- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 msgr2=0x7f1b78099d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b78099d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 monclient: found mon.noname-b 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 -- 172.21.15.28:0/3746805385 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b70009a70 con 0x7f1b7809f580 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7d628640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b7809a260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000efc0 tx=0x7f1b7000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 client.?.objecter ms_handle_connect 0x7f1b7809f580 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1b7000cd30 con 0x7f1b7809f580 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: dump: 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.377 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.378 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.378 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.378 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.378 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.378 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 5 monclient: authenticate success, global_id 4340 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7000f040 con 0x7f1b7809f580 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 10 monclient: _renew_subs 2024-03-27T21:30:26.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1b70014d60 con 0x7f1b7809f580 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b6c0094d0 con 0x7f1b7809f580 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b767fc640 4 set_mon_vals no callback set 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 10 client.4340.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b757fa640 10 monclient: dump: 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.381 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 10 monclient: _renew_subs 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b78134670 con 0x7f1b7809f580 2024-03-27T21:30:26.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.370+0000 7f1b7f08b640 1 librados: init done 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f1b70014480 con 0x7f1b7809f580 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b7f08b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b7f08b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b7f08b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b780a2e50 con 0x7f1b7809f580 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1b5c03a250 0x7f1b5c03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f1b7004a750 con 0x7f1b7809f580 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 10 client.4340.objecter ms_dispatch 0x7f1b78000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 3 client.4340.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 3 client.4340.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b757fa640 20 client.4340.objecter dump_active .. 0 homeless 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b7ce27640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1b5c03a250 0x7f1b5c03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.371+0000 7f1b7ce27640 10 monclient: get_auth_request con 0x7f1b5c03a250 auth_method 0 2024-03-27T21:30:26.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.372+0000 7f1b757fa640 10 client.4340.objecter ms_handle_connect 0x7f1b5c03a250 2024-03-27T21:30:26.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.372+0000 7f1b7ce27640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1b5c03a250 0x7f1b5c03c710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c036000 tx=0x7f1b6c008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.376+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f1b780a2e50 con 0x7f1b7809f580 2024-03-27T21:30:26.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.376+0000 7f1b757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.376+0000 7f1b757fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:26.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.553+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b781316f0 con 0x7f1b5c03a250 2024-03-27T21:30:26.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.555+0000 7f1b757fa640 1 -- 172.21.15.28:0/3746805385 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+39282 (secure 0 0 0) 0x7f1b781316f0 con 0x7f1b5c03a250 2024-03-27T21:30:26.544 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:26.545 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 10 librados: watch_flush enter 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 10 librados: watch_flush exit 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 20 client.4340.objecter shutdown clearing up homeless session... 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 10 client.4340.objecter successfully canceled tick 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1b5c03a250 msgr2=0x7f1b5c03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1b5c03a250 0x7f1b5c03c710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c036000 tx=0x7f1b6c008030 comp rx=0 tx=0).stop 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 10 monclient: shutdown 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 msgr2=0x7f1b7809a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b7809a260 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000efc0 tx=0x7f1b7000c490 comp rx=0 tx=0).stop 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 shutdown_connections 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f1b5c03a250 0x7f1b5c03c710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f1b7809f580 0x7f1b7809a260 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f1b7809f120 0x7f1b78099d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 --2- 172.21.15.28:0/3746805385 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f1b7809ed40 0x7f1b780997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 >> 172.21.15.28:0/3746805385 conn(0x7f1b780a2040 msgr2=0x7f1b781bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 shutdown_connections 2024-03-27T21:30:26.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 -- 172.21.15.28:0/3746805385 wait complete. 2024-03-27T21:30:26.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.557+0000 7f1b7f08b640 1 librados: shutdown 2024-03-27T21:30:26.556 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-03-27T21:30:24.635987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168328,"kb_used_data":1792,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062712,"statfs":{"total":579820584960,"available":579648217088,"internally_reserved":0,"allocated":1835008,"data_stored":1242618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000452"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":161,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.557815+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.557815+0000","last_peered":"2024-03-27T21:30:21.557815+0000","last_clean":"2024-03-27T21:30:21.557815+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.557815+0000","last_undegraded":"2024-03-27T21:30:21.557815+0000","last_fullsized":"2024-03-27T21:30:21.557815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":37955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27924,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343916,"statfs":{"total":96636764160,"available":96608169984,"internally_reserved":0,"allocated":602112,"data_stored":505443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:30:26.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:30:26.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.668+0000 7efc33e41640 10 monclient: get_monmap_and_config 2024-03-27T21:30:26.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.668+0000 7efc33e41640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.668+0000 7efc33e41640 10 monclient: monmap: 2024-03-27T21:30:26.666 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.666 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:26.669036+0000 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:26.669036+0000 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.667 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.668+0000 7efc33e41640 1 Processor -- start 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 1 -- start start 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient: init 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient: _add_conns ranks=[7,4,0,3,5,1,8,10,9,6,2] 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7efc2c09c430 0x7efc2c09c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): picked mon.noname-i con 0x7efc2c09c430 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c134e80 0x7efc2c0a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): picked mon.noname-c con 0x7efc2c134e80 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:26.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efc2c135280 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0618f0 con 0x7efc2c135280 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c09fc60 con 0x7efc2c134e80 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0a00a0 con 0x7efc2c09c430 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc33e41640 10 monclient(hunting): authenticate will time out at 848.976221s 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c134e80 0x7efc2c0a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc323de640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efc2c135280 0x7efc2c0a1e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52982/0 (socket says 172.21.15.28:52982) 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc323de640 1 -- 172.21.15.28:0/1760072688 learned_addr learned my addr 172.21.15.28:0/1760072688 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): get_auth_request con 0x7efc2c134e80 auth_method 0 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc31bdd640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7efc2c09c430 0x7efc2c09c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc31bdd640 10 monclient(hunting): get_auth_request con 0x7efc2c09c430 auth_method 0 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc31bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc31bdd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc31bdd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc30bdb640 1 -- 172.21.15.28:0/1760072688 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530448931 0 0) 0x7efc2c0618f0 con 0x7efc2c135280 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc30bdb640 10 monclient(hunting): _negotiate 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc30bdb640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc30bdb640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc30bdb640 10 monclient(hunting): my global_id is 4491 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc30bdb640 1 -- 172.21.15.28:0/1760072688 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc14003520 con 0x7efc2c135280 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient(hunting): handle_auth_done global_id 4333 payload 274 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 1 -- 172.21.15.28:0/1760072688 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7efc2c09c430 msgr2=0x7efc2c09c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7efc2c09c430 0x7efc2c09c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 1 -- 172.21.15.28:0/1760072688 >> v1:172.21.15.28:6789/0 conn(0x7efc2c135280 legacy=0x7efc2c0a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 1 monclient: found mon.noname-c 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.669+0000 7efc313dc640 1 -- 172.21.15.28:0/1760072688 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c06b290 con 0x7efc2c134e80 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc31bdd640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7efc2c09c430 0x7efc2c09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc313dc640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c134e80 0x7efc2c0a1940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc200097d0 tx=0x7efc2002b790 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6be056ca7b446cef server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 1 -- 172.21.15.28:0/1760072688 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc20031960 con 0x7efc2c134e80 2024-03-27T21:30:26.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: dump: 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.672 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 1 -- 172.21.15.28:0/1760072688 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc20031ae0 con 0x7efc2c134e80 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc33e41640 5 monclient: authenticate success, global_id 4333 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc33e41640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 1 -- 172.21.15.28:0/1760072688 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc20031c50 con 0x7efc2c134e80 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc33e41640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc33e41640 4 set_mon_vals no callback set 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.670+0000 7efc30bdb640 10 monclient: dump: 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.674 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 10 monclient: shutdown 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 -- 172.21.15.28:0/1760072688 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c134e80 msgr2=0x7efc2c0a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c134e80 0x7efc2c0a1940 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efc200097d0 tx=0x7efc2002b790 comp rx=0 tx=0).stop 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 -- 172.21.15.28:0/1760072688 shutdown_connections 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c134e80 0x7efc2c0a1940 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 --2- 172.21.15.28:0/1760072688 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7efc2c09c430 0x7efc2c09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 -- 172.21.15.28:0/1760072688 >> 172.21.15.28:0/1760072688 conn(0x7efc2c0a65f0 msgr2=0x7efc2c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 -- 172.21.15.28:0/1760072688 shutdown_connections 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.671+0000 7efc33e41640 1 -- 172.21.15.28:0/1760072688 wait complete. 2024-03-27T21:30:26.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient: monmap: 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.676 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 librados: starting msgr at 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 librados: starting objecter 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 Processor -- start 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 -- start start 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 librados: setting wanted keys 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 librados: calling monclient init 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient: init 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient: _add_conns ranks=[5,6,4,3,0,8,2,1,7] 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7efc2c09c430 0x7efc2c1cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): picked mon.noname-h con 0x7efc2c09c430 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7efc2c134e80 0x7efc2c1cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): picked mon.noname-d con 0x7efc2c134e80 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:26.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 0x7efc2c09d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): picked mon.noname-c con 0x7efc2c135280 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c133820 con 0x7efc2c135280 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c121e90 con 0x7efc2c09c430 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c06a830 con 0x7efc2c134e80 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.672+0000 7efc33e41640 10 monclient(hunting): authenticate will time out at 848.979647s 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 0x7efc2c09d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7efc2c134e80 0x7efc2c1cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 0x7efc2c09d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48518/0 (socket says 172.21.15.28:48518) 2024-03-27T21:30:26.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7efc2c134e80 0x7efc2c1cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43478/0 (socket says 172.21.15.28:43478) 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 -- 172.21.15.28:0/2129675744 learned_addr learned my addr 172.21.15.28:0/2129675744 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): get_auth_request con 0x7efc2c135280 auth_method 0 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): get_auth_request con 0x7efc2c134e80 auth_method 0 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc313dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc31bdd640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7efc2c09c430 0x7efc2c1cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc31bdd640 10 monclient(hunting): get_auth_request con 0x7efc2c09c430 auth_method 0 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc31bdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc31bdd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc31bdd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient(hunting): handle_auth_done global_id 4342 payload 824 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 -- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7efc2c134e80 msgr2=0x7efc2c1cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7efc2c134e80 0x7efc2c1cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 -- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7efc2c09c430 msgr2=0x7efc2c1cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7efc2c09c430 0x7efc2c1cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 monclient: found mon.noname-c 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 -- 172.21.15.28:0/2129675744 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc20009400 con 0x7efc2c135280 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc323de640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 0x7efc2c09d430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00caa0 tx=0x7efc1c00cf60 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 client.?.objecter ms_handle_connect 0x7efc2c135280 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc1c00ae70 con 0x7efc2c135280 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: dump: 2024-03-27T21:30:26.681 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.682 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c007070 con 0x7efc2c135280 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 5 monclient: authenticate success, global_id 4342 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7efc1c007690 con 0x7efc2c135280 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 10 monclient: _renew_subs 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c071a80 con 0x7efc2c135280 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2bfff640 4 set_mon_vals no callback set 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 10 client.4342.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc2a7fc640 10 monclient: dump: 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.684 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 10 monclient: _renew_subs 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c123200 con 0x7efc2c135280 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.673+0000 7efc33e41640 1 librados: init done 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7efc1c007220 con 0x7efc2c135280 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7efc1803a250 0x7efc1803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc33e41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc33e41640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc33e41640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7efc1c049b80 con 0x7efc2c135280 2024-03-27T21:30:26.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 10 client.4342.objecter ms_dispatch 0x7efc2c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 3 client.4342.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 3 client.4342.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0746e0 con 0x7efc2c135280 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc2a7fc640 20 client.4342.objecter dump_active .. 0 homeless 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc31bdd640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7efc1803a250 0x7efc1803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.674+0000 7efc31bdd640 10 monclient: get_auth_request con 0x7efc1803a250 auth_method 0 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.675+0000 7efc2a7fc640 10 client.4342.objecter ms_handle_connect 0x7efc1803a250 2024-03-27T21:30:26.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.675+0000 7efc31bdd640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7efc1803a250 0x7efc1803c710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc24006fd0 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.679+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7efc1c049e60 con 0x7efc2c135280 2024-03-27T21:30:26.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.679+0000 7efc2a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:26.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.679+0000 7efc2a7fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:26.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.853+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc2c0a2590 con 0x7efc1803a250 2024-03-27T21:30:26.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.855+0000 7efc2a7fc640 1 -- 172.21.15.28:0/2129675744 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+40394 (secure 0 0 0) 0x7efc24009e60 con 0x7efc1803a250 2024-03-27T21:30:26.844 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:30:26.845 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:30:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 10 librados: watch_flush enter 2024-03-27T21:30:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 10 librados: watch_flush exit 2024-03-27T21:30:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 20 client.4342.objecter shutdown clearing up homeless session... 2024-03-27T21:30:26.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 10 client.4342.objecter successfully canceled tick 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7efc1803a250 msgr2=0x7efc1803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7efc1803a250 0x7efc1803c710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efc24006fd0 tx=0x7efc24008040 comp rx=0 tx=0).stop 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 10 monclient: shutdown 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 msgr2=0x7efc2c09d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 0x7efc2c09d430 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00caa0 tx=0x7efc1c00cf60 comp rx=0 tx=0).stop 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 shutdown_connections 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7efc1803a250 0x7efc1803c710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7efc2c135280 0x7efc2c09d430 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7efc2c134e80 0x7efc2c1cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 --2- 172.21.15.28:0/2129675744 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7efc2c09c430 0x7efc2c1cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 >> 172.21.15.28:0/2129675744 conn(0x7efc2c0a65f0 msgr2=0x7efc2c1bc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 shutdown_connections 2024-03-27T21:30:26.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 -- 172.21.15.28:0/2129675744 wait complete. 2024-03-27T21:30:26.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.857+0000 7efc33e41640 1 librados: shutdown 2024-03-27T21:30:26.856 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-03-27T21:30:26.636517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168548,"kb_used_data":1876,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062492,"statfs":{"total":579820584960,"available":579647991808,"internally_reserved":0,"allocated":1921024,"data_stored":1313826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000982"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":161,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.557815+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.557815+0000","last_peered":"2024-03-27T21:30:21.557815+0000","last_clean":"2024-03-27T21:30:21.557815+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.557815+0000","last_undegraded":"2024-03-27T21:30:21.557815+0000","last_fullsized":"2024-03-27T21:30:21.557815+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":675840,"data_stored":571767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]}]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]}]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:30:26.857 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-03-27T21:30:26.858 DEBUG:tasks.mon_thrash:Yielding 2024-03-27T21:30:26.858 INFO:teuthology.run_tasks:Running task workunit... 2024-03-27T21:30:26.871 INFO:tasks.workunit:Pulling workunits from ref 7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:30:26.871 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-27T21:30:26.872 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-27T21:30:26.872 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-03-27T21:30:26.872 INFO:tasks.mon_thrash.mon_thrasher:seed: 1711575026, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: True, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-03-27T21:30:26.872 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-03-27T21:30:26.872 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:30:26.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:30:26.891 INFO:teuthology.orchestra.run.smithi063.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-27T21:30:26.891 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-27T21:30:26.948 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-27T21:30:26.948 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-27T21:30:26.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.985+0000 7f23d29dd640 10 monclient: get_monmap_and_config 2024-03-27T21:30:26.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.985+0000 7f23d29dd640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.985+0000 7f23d29dd640 10 monclient: monmap: 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:26.986692+0000 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:26.986692+0000 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.975 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:26.976 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:26.976 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.986+0000 7f23d29dd640 1 Processor -- start 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.986+0000 7f23d29dd640 1 -- start start 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.986+0000 7f23d29dd640 10 monclient: init 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient: _add_conns ranks=[1,9,3,5,8,7,6,2,0,4,10] 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f23cc06a510 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f23cc0a2030 0x7f23cc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): picked mon.noname-a con 0x7f23cc0a2030 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc13e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): picked mon.noname-g con 0x7f23cc06b000 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23cc0618f0 con 0x7f23cc06a510 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23cc06cde0 con 0x7f23cc0a2030 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.985 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc0a13a0 con 0x7f23cc06b000 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d29dd640 10 monclient(hunting): authenticate will time out at 849.293828s 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f23cc0a2030 0x7f23cc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f23cc0a2030 0x7f23cc06f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38534/0 (socket says 172.21.15.28:38534) 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 -- 172.21.15.28:0/4272441330 learned_addr learned my addr 172.21.15.28:0/4272441330 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): get_auth_request con 0x7f23cc0a2030 auth_method 0 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d0f7a640 1 --2- 172.21.15.28:0/4272441330 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc13e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d0f7a640 10 monclient(hunting): get_auth_request con 0x7f23cc06b000 auth_method 0 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d0f7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d0f7a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23d0f7a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_done global_id 4500 payload 274 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 -- 172.21.15.28:0/4272441330 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 msgr2=0x7f23cc13e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 --2- 172.21.15.28:0/4272441330 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc13e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 -- 172.21.15.28:0/4272441330 >> v1:172.21.15.63:6789/0 conn(0x7f23cc06a510 legacy=0x7f23cc06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 monclient: found mon.noname-a 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.987+0000 7f23cb7fe640 1 -- 172.21.15.28:0/4272441330 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0a15e0 con 0x7f23cc0a2030 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23cb7fe640 1 --2- 172.21.15.28:0/4272441330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23cc0a2030 0x7f23cc06f8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009870 tx=0x7f23c002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b991e0894a140fc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 1 -- 172.21.15.28:0/4272441330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f23c0031a30 con 0x7f23cc0a2030 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: dump: 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.988 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 5 monclient: authenticate success, global_id 4500 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 1 -- 172.21.15.28:0/4272441330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c0031bb0 con 0x7f23cc0a2030 2024-03-27T21:30:26.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 1 -- 172.21.15.28:0/4272441330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f23c0031d20 con 0x7f23cc0a2030 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 4 set_mon_vals no callback set 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23caffd640 10 monclient: dump: 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.990 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 10 monclient: shutdown 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 1 -- 172.21.15.28:0/4272441330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23cc0a2030 msgr2=0x7f23cc06f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 1 --2- 172.21.15.28:0/4272441330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23cc0a2030 0x7f23cc06f8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009870 tx=0x7f23c002b860 comp rx=0 tx=0).stop 2024-03-27T21:30:26.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 1 -- 172.21.15.28:0/4272441330 shutdown_connections 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 1 --2- 172.21.15.28:0/4272441330 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc13e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.988+0000 7f23d29dd640 1 --2- 172.21.15.28:0/4272441330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f23cc0a2030 0x7f23cc06f8f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 1 -- 172.21.15.28:0/4272441330 >> 172.21.15.28:0/4272441330 conn(0x7f23cc0a6390 msgr2=0x7f23cc0a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 1 -- 172.21.15.28:0/4272441330 shutdown_connections 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 1 -- 172.21.15.28:0/4272441330 wait complete. 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 10 monclient: build_initial_monmap 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 10 monclient: monmap: 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:26.992 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 1 librados: starting msgr at 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 1 librados: starting objecter 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.989+0000 7f23d29dd640 1 Processor -- start 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 -- start start 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 librados: setting wanted keys 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 librados: calling monclient init 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient: init 2024-03-27T21:30:26.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient: _add_conns ranks=[1,3,5,8,7,4,2,6,0] 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 0x7f23cc1cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): picked mon.noname-f con 0x7f23cc06a510 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc1cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): picked mon.noname-g con 0x7f23cc06b000 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f23cc0a2030 0x7f23cc1cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): picked mon.noname-h con 0x7f23cc0a2030 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc13a6a0 con 0x7f23cc06a510 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc071590 con 0x7f23cc06b000 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23cc139550 con 0x7f23cc0a2030 2024-03-27T21:30:26.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d29dd640 10 monclient(hunting): authenticate will time out at 849.297201s 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 0x7f23cc1cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc1cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 0x7f23cc1cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:37992/0 (socket says 172.21.15.28:37992) 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 1 -- 172.21.15.28:0/912227500 learned_addr learned my addr 172.21.15.28:0/912227500 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): get_auth_request con 0x7f23cc06a510 auth_method 0 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f23cc0a2030 0x7f23cc1cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): get_auth_request con 0x7f23cc06b000 auth_method 0 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): get_auth_request con 0x7f23cc0a2030 auth_method 0 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23cb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.990+0000 7f23d0f7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 10 monclient(hunting): handle_auth_done global_id 4501 payload 824 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 -- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f23cc0a2030 msgr2=0x7f23cc1cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f23cc0a2030 0x7f23cc1cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 -- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 msgr2=0x7f23cc1cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc1cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 monclient: found mon.noname-f 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 -- 172.21.15.28:0/912227500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00094d0 con 0x7f23cc06a510 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cb7fe640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc1cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23cbfff640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 0x7f23cc1cb800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c400 tx=0x7f23bc00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 client.?.objecter ms_handle_connect 0x7f23cc06a510 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f23bc0035f0 con 0x7f23cc06a510 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:26.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: dump: 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:26.998 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23bc0037b0 con 0x7f23cc06a510 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 5 monclient: authenticate success, global_id 4501 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 10 monclient: _renew_subs 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23cc0a2510 con 0x7f23cc06a510 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f23bc003d90 con 0x7f23cc06a510 2024-03-27T21:30:26.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 10 client.4501.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23c8ff9640 10 monclient: dump: 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.000 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23ca7fc640 4 set_mon_vals no callback set 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 10 monclient: _renew_subs 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23cc13a8c0 con 0x7f23cc06a510 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.991+0000 7f23d29dd640 1 librados: init done 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f23bc003920 con 0x7f23cc06a510 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23d29dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23d29dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23d29dd640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23cc074b30 con 0x7f23cc06a510 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f23b803a250 0x7f23b803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f23bc0493a0 con 0x7f23cc06a510 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 10 client.4501.objecter ms_dispatch 0x7f23cc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 3 client.4501.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 3 client.4501.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23c8ff9640 20 client.4501.objecter dump_active .. 0 homeless 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23cb7fe640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f23b803a250 0x7f23b803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.992+0000 7f23cb7fe640 10 monclient: get_auth_request con 0x7f23b803a250 auth_method 0 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.993+0000 7f23cb7fe640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f23b803a250 0x7f23b803c710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009870 tx=0x7f23c003d040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.993+0000 7f23c8ff9640 10 client.4501.objecter ms_handle_connect 0x7f23b803a250 2024-03-27T21:30:27.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.997+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f23bc011590 con 0x7f23cc06a510 2024-03-27T21:30:27.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.997+0000 7f23c8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:26.997+0000 7f23c8ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:27.019 INFO:tasks.workunit:timeout=3h 2024-03-27T21:30:27.019 INFO:tasks.workunit:cleanup=True 2024-03-27T21:30:27.019 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:30:27.076 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-27T21:30:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.245+0000 7f23d29dd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:30:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.245+0000 7f23d29dd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.245+0000 7f23d29dd640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.245+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f23cc0a01b0 con 0x7f23cc06a510 2024-03-27T21:30:27.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.246+0000 7f23c8ff9640 1 -- 172.21.15.28:0/912227500 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3160 (secure 0 0 0) 0x7f23bc0108f0 con 0x7f23cc06a510 2024-03-27T21:30:27.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.246+0000 7f23c8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:27.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.246+0000 7f23c8ff9640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:27.235 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":17,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.247+0000 7f23d29dd640 10 librados: watch_flush enter 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.247+0000 7f23d29dd640 10 librados: watch_flush exit 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.247+0000 7f23d29dd640 20 client.4501.objecter shutdown clearing up homeless session... 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.247+0000 7f23d29dd640 10 client.4501.objecter successfully canceled tick 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f23b803a250 msgr2=0x7f23b803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f23b803a250 0x7f23b803c710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009870 tx=0x7f23c003d040 comp rx=0 tx=0).stop 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 10 monclient: shutdown 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 msgr2=0x7f23cc1cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 0x7f23cc1cb800 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c400 tx=0x7f23bc00c8c0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 shutdown_connections 2024-03-27T21:30:27.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f23b803a250 0x7f23b803c710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f23cc0a2030 0x7f23cc1cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f23cc06b000 0x7f23cc1cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 --2- 172.21.15.28:0/912227500 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23cc06a510 0x7f23cc1cb800 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 >> 172.21.15.28:0/912227500 conn(0x7f23cc0a6390 msgr2=0x7f23cc138160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 shutdown_connections 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 -- 172.21.15.28:0/912227500 wait complete. 2024-03-27T21:30:27.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.248+0000 7f23d29dd640 1 librados: shutdown 2024-03-27T21:30:27.247 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-03-27T21:30:27.247 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-03-27T21:30:27.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-03-27T21:30:27.248 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.359+0000 7f7907b8e640 10 monclient: get_monmap_and_config 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.359+0000 7f7907b8e640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.359+0000 7f7907b8e640 10 monclient: monmap: 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:27.360679+0000 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:27.360679+0000 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.360+0000 7f7907b8e640 1 Processor -- start 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.360+0000 7f7907b8e640 1 -- start start 2024-03-27T21:30:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.360+0000 7f7907b8e640 10 monclient: init 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient: _add_conns ranks=[4,0,10,9,6,1,2,5,7,3,8] 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f79000a0920 0x7f7900134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): picked mon.noname-c con 0x7f79000a0920 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7900135460 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f790006ff10 0x7f790013bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): picked mon.noname-f con 0x7f790006ff10 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79000618f0 con 0x7f7900135460 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79000716a0 con 0x7f790006ff10 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79000713c0 con 0x7f79000a0920 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7907b8e640 10 monclient(hunting): authenticate will time out at 849.667823s 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f79000a0920 0x7f7900134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7905129640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7900135460 0x7f79000a0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52988/0 (socket says 172.21.15.28:52988) 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7905129640 1 -- 172.21.15.28:0/2359069657 learned_addr learned my addr 172.21.15.28:0/2359069657 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): get_auth_request con 0x7f79000a0920 auth_method 0 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 1 --2- 172.21.15.28:0/2359069657 >> v2:172.21.15.63:3300/0 conn(0x7f790006ff10 0x7f790013bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): get_auth_request con 0x7f790006ff10 auth_method 0 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790612b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient(hunting): handle_auth_done global_id 4351 payload 274 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7904928640 1 -- 172.21.15.28:0/2359069657 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4073556901 0 0) 0x7f79000618f0 con 0x7f7900135460 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 1 -- 172.21.15.28:0/2359069657 >> v2:172.21.15.63:3300/0 conn(0x7f790006ff10 msgr2=0x7f790013bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 1 --2- 172.21.15.28:0/2359069657 >> v2:172.21.15.63:3300/0 conn(0x7f790006ff10 0x7f790013bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 1 -- 172.21.15.28:0/2359069657 >> v1:172.21.15.28:6789/0 conn(0x7f7900135460 legacy=0x7f79000a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 1 monclient: found mon.noname-c 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f790592a640 1 -- 172.21.15.28:0/2359069657 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000a1410 con 0x7f79000a0920 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.361+0000 7f7904928640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f790592a640 1 --2- 172.21.15.28:0/2359069657 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f79000a0920 0x7f7900134f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097a0 tx=0x7f78f802b7a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=6885e4ba3ac0ff39 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 1 -- 172.21.15.28:0/2359069657 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f802f050 con 0x7f79000a0920 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: dump: 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 5 monclient: authenticate success, global_id 4351 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 1 -- 172.21.15.28:0/2359069657 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8031970 con 0x7f79000a0920 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 4 set_mon_vals no callback set 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 1 -- 172.21.15.28:0/2359069657 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f8032390 con 0x7f79000a0920 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7904928640 10 monclient: dump: 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 10 monclient: shutdown 2024-03-27T21:30:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 1 -- 172.21.15.28:0/2359069657 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f79000a0920 msgr2=0x7f7900134f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.362+0000 7f7907b8e640 1 --2- 172.21.15.28:0/2359069657 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f79000a0920 0x7f7900134f20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097a0 tx=0x7f78f802b7a0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 -- 172.21.15.28:0/2359069657 shutdown_connections 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 --2- 172.21.15.28:0/2359069657 >> v2:172.21.15.63:3300/0 conn(0x7f790006ff10 0x7f790013bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 --2- 172.21.15.28:0/2359069657 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f79000a0920 0x7f7900134f20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 -- 172.21.15.28:0/2359069657 >> 172.21.15.28:0/2359069657 conn(0x7f79000a7810 msgr2=0x7f79000a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 -- 172.21.15.28:0/2359069657 shutdown_connections 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 -- 172.21.15.28:0/2359069657 wait complete. 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 10 monclient: monmap: 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 librados: starting msgr at 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 librados: starting objecter 2024-03-27T21:30:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.363+0000 7f7907b8e640 1 Processor -- start 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 -- start start 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 librados: setting wanted keys 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 librados: calling monclient init 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient: init 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient: _add_conns ranks=[7,6,0,4,1,5,3,2,8] 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f790006ff10 0x7f79001299d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): picked mon.noname-i con 0x7f790006ff10 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f79000a0920 0x7f7900129f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): picked mon.noname-d con 0x7f79000a0920 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900139f20 0x7f790013a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): picked mon.noname-a con 0x7f7900139f20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790006cab0 con 0x7f7900139f20 2024-03-27T21:30:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7900070a00 con 0x7f79000a0920 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7900070640 con 0x7f790006ff10 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7907b8e640 10 monclient(hunting): authenticate will time out at 849.671162s 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900139f20 0x7f790013a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900139f20 0x7f790013a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38550/0 (socket says 172.21.15.28:38550) 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f79000a0920 0x7f7900129f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 -- 172.21.15.28:0/1984128205 learned_addr learned my addr 172.21.15.28:0/1984128205 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): get_auth_request con 0x7f7900139f20 auth_method 0 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): get_auth_request con 0x7f79000a0920 auth_method 0 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f7905129640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790592a640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f790006ff10 0x7f79001299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790592a640 10 monclient(hunting): get_auth_request con 0x7f790006ff10 auth_method 0 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790592a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790592a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790592a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient(hunting): handle_auth_done global_id 4518 payload 824 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f790006ff10 msgr2=0x7f79001299d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f790006ff10 0x7f79001299d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f79000a0920 msgr2=0x7f7900129f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f79000a0920 0x7f7900129f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 monclient: found mon.noname-a 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.364+0000 7f790612b640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8009400 con 0x7f7900139f20 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f790612b640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900139f20 0x7f790013a380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ef90 tx=0x7f78f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 client.?.objecter ms_handle_connect 0x7f7900139f20 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f0009ca0 con 0x7f7900139f20 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: dump: 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f000f040 con 0x7f7900139f20 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 5 monclient: authenticate success, global_id 4518 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 10 monclient: _renew_subs 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790013b820 con 0x7f7900139f20 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f0014d60 con 0x7f7900139f20 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 10 monclient: dump: 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fffff640 4 set_mon_vals no callback set 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 10 client.4518.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 10 monclient: _renew_subs 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790012fbe0 con 0x7f7900139f20 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f7907b8e640 1 librados: init done 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.365+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f78f000cd30 con 0x7f7900139f20 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7907b8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7907b8e640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 0x7f790013a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7900073150 con 0x7f7900135460 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f78ec03a280 0x7f78ec03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 0x7f790013a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f78f004ad90 con 0x7f7900139f20 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 client.4518.objecter ms_dispatch 0x7f7900000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 3 client.4518.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient: get_auth_request con 0x7f7900135460 auth_method 0 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 3 client.4518.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 20 client.4518.objecter dump_active .. 0 homeless 2024-03-27T21:30:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7905129640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f78ec03a280 0x7f78ec03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7905129640 10 monclient: get_auth_request con 0x7f78ec03a280 auth_method 0 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 10 monclient(hunting): handle_auth_done global_id 4527 payload 824 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7900067350 con 0x7f7900135460 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 client.4518.objecter ms_handle_connect 0x7f7900135460 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 client.4518.objecter resend_mon_ops 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f790592a640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 0x7f790013a8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f79000a3af0 tx=0x7f78f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f8004410 con 0x7f7900135460 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 monclient: dump: 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f78fe7fc640 10 client.4518.objecter ms_handle_connect 0x7f78ec03a280 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.366+0000 7f7905129640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f78ec03a280 0x7f78ec03c740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79000a38f0 tx=0x7f78f4007e40 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f78f8003610 con 0x7f7900135460 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 msgr2=0x7f790013a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 0x7f790013a8c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f79000a3af0 tx=0x7f78f80046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 msgr2=0x7f790013a8c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.367+0000 7f78fe7fc640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900135460 0x7f790013a8c0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f79000a3af0 tx=0x7f78f80046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f7907b8e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f7907b8e640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 0x7f790013ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f7907b8e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790004e550 con 0x7f790013c2d0 2024-03-27T21:30:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 0x7f790013ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient: get_auth_request con 0x7f790013c2d0 auth_method 0 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 10 monclient(hunting): handle_auth_done global_id 4536 payload 824 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 1 -- 172.21.15.28:0/1984128205 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f790006cf50 con 0x7f790013c2d0 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f78fe7fc640 10 client.4518.objecter ms_handle_connect 0x7f790013c2d0 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f78fe7fc640 10 client.4518.objecter resend_mon_ops 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f790592a640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 0x7f790013ae00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097a0 tx=0x7f78f8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f78f802f030 con 0x7f790013c2d0 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f78fe7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f78fe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.373+0000 7f78fe7fc640 10 monclient: dump: 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 <== mon.0 v2:172.21.15.28:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9338 (secure 0 0 0) 0x7f78f803ebf0 con 0x7f790013c2d0 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 msgr2=0x7f790013ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 0x7f790013ae00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097a0 tx=0x7f78f8031000 comp rx=0 tx=0).stop 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 msgr2=0x7f790013ae00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f78fe7fc640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f790013c2d0 0x7f790013ae00 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78f80097a0 tx=0x7f78f8031000 comp rx=0 tx=0).stop 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:27.386 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 17, 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.387 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.388 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:27.389 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.390 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.391 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.392 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.393 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:27.394 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.395 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.396 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.397 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.398 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.399 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:27.400 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.401 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.402 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.403 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:27.404 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.405 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.406 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.407 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.408 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.408 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:27.408 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 10 librados: watch_flush enter 2024-03-27T21:30:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 10 librados: watch_flush exit 2024-03-27T21:30:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 20 client.4518.objecter shutdown clearing up homeless session... 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 10 client.4518.objecter successfully canceled tick 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f78ec03a280 msgr2=0x7f78ec03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f78ec03a280 0x7f78ec03c740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79000a38f0 tx=0x7f78f4007e40 comp rx=0 tx=0).stop 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 10 monclient: shutdown 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900139f20 msgr2=0x7f790013a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 --2- 172.21.15.28:0/1984128205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7900139f20 0x7f790013a380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ef90 tx=0x7f78f000c490 comp rx=0 tx=0).stop 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f790612b640 1 -- 172.21.15.28:0/1984128205 reap_dead start 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f790612b640 1 -- 172.21.15.28:0/1984128205 reap_dead start 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 shutdown_connections 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 >> 172.21.15.28:0/1984128205 conn(0x7f79000a7810 msgr2=0x7f7900133050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 shutdown_connections 2024-03-27T21:30:27.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 -- 172.21.15.28:0/1984128205 wait complete. 2024-03-27T21:30:27.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.374+0000 7f7907b8e640 1 librados: shutdown 2024-03-27T21:30:27.411 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:27.411 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-03-27T21:30:27.411 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.522+0000 7fbeff89d640 10 monclient: get_monmap_and_config 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.522+0000 7fbeff89d640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.522+0000 7fbeff89d640 10 monclient: monmap: 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:27.523601+0000 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:27.523601+0000 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:27.512 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 1 Processor -- start 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 1 -- start start 2024-03-27T21:30:27.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 10 monclient: init 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 10 monclient: _add_conns ranks=[7,1,2,8,3,9,0,4,10,6,5] 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fbef8136d00 0x7fbef81370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.523+0000 7fbeff89d640 10 monclient(hunting): picked mon.noname-i con 0x7fbef8136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbef80a3d70 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 0x7fbef81340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 10 monclient(hunting): picked mon.noname-b con 0x7fbef8137620 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef80618f0 con 0x7fbef80a3d70 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80a25b0 con 0x7fbef8137620 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80a13f0 con 0x7fbef8136d00 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbeff89d640 10 monclient(hunting): authenticate will time out at 849.830779s 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 0x7fbef81340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 0x7fbef81340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36586/0 (socket says 172.21.15.28:36586) 2024-03-27T21:30:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 -- 172.21.15.28:0/939150825 learned_addr learned my addr 172.21.15.28:0/939150825 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): get_auth_request con 0x7fbef8137620 auth_method 0 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefd639640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fbef8136d00 0x7fbef81370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient(hunting): handle_auth_done global_id 4349 payload 274 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 -- 172.21.15.28:0/939150825 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fbef8136d00 msgr2=0x7fbef81370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fbef8136d00 0x7fbef81370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 -- 172.21.15.28:0/939150825 >> v1:172.21.15.63:6789/0 conn(0x7fbef80a3d70 legacy=0x7fbef81339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 monclient: found mon.noname-b 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefde3a640 1 -- 172.21.15.28:0/939150825 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef80a1f60 con 0x7fbef8137620 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefd639640 10 monclient: get_auth_request con 0x7fbef8136d00 auth_method 0 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.524+0000 7fbefd639640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fbef8136d00 0x7fbef81370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbefde3a640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 0x7fbef81340f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009e80 tx=0x7fbef402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb85baeea3542a39 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 1 -- 172.21.15.28:0/939150825 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbef402cb90 con 0x7fbef8137620 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: dump: 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.526 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 1 -- 172.21.15.28:0/939150825 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef402cd10 con 0x7fbef8137620 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 5 monclient: authenticate success, global_id 4349 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 1 -- 172.21.15.28:0/939150825 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbef4034860 con 0x7fbef8137620 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 4 set_mon_vals no callback set 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeeffff640 10 monclient: dump: 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.528 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.529 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 10 monclient: shutdown 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 1 -- 172.21.15.28:0/939150825 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 msgr2=0x7fbef81340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 0x7fbef81340f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009e80 tx=0x7fbef402bd80 comp rx=0 tx=0).stop 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 1 -- 172.21.15.28:0/939150825 shutdown_connections 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8137620 0x7fbef81340f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 1 --2- 172.21.15.28:0/939150825 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fbef8136d00 0x7fbef81370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.525+0000 7fbeff89d640 1 -- 172.21.15.28:0/939150825 >> 172.21.15.28:0/939150825 conn(0x7fbef80a9430 msgr2=0x7fbef80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 1 -- 172.21.15.28:0/939150825 shutdown_connections 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 1 -- 172.21.15.28:0/939150825 wait complete. 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 10 monclient: monmap: 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.531 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 1 librados: starting msgr at 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 1 librados: starting objecter 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.526+0000 7fbeff89d640 1 Processor -- start 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 -- start start 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 librados: setting wanted keys 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 librados: calling monclient init 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient: init 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient: _add_conns ranks=[6,2,8,0,1,7,5,3,4] 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fbef80a3d70 0x7fbef811fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): picked mon.noname-d con 0x7fbef80a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8136d00 0x7fbef8134f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): picked mon.noname-b con 0x7fbef8136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:27.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fbef8137620 0x7fbef81354c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): picked mon.noname-e con 0x7fbef8137620 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef81229d0 con 0x7fbef8136d00 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80a11e0 con 0x7fbef80a3d70 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fbef80a1630 con 0x7fbef8137620 2024-03-27T21:30:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbeff89d640 10 monclient(hunting): authenticate will time out at 849.834192s 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fbef80a3d70 0x7fbef811fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8136d00 0x7fbef8134f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fbef80a3d70 0x7fbef811fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43496/0 (socket says 172.21.15.28:43496) 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 1 -- 172.21.15.28:0/338879470 learned_addr learned my addr 172.21.15.28:0/338879470 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): get_auth_request con 0x7fbef80a3d70 auth_method 0 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): get_auth_request con 0x7fbef8136d00 auth_method 0 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fbef8137620 0x7fbef81354c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): get_auth_request con 0x7fbef8137620 auth_method 0 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient(hunting): handle_auth_done global_id 4358 payload 824 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fbef8137620 msgr2=0x7fbef81354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fbef8137620 0x7fbef81354c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fbef80a3d70 msgr2=0x7fbef811fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fbef80a3d70 0x7fbef811fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 monclient: found mon.noname-b 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefce38640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4009b30 con 0x7fbef8136d00 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefd639640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fbef80a3d70 0x7fbef811fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.527+0000 7fbefde3a640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fbef8137620 0x7fbef81354c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbefce38640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8136d00 0x7fbef8134f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c410 tx=0x7fbee800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 client.?.objecter ms_handle_connect 0x7fbef8136d00 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbee80054a0 con 0x7fbef8136d00 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: dump: 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 5 monclient: authenticate success, global_id 4358 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee80045e0 con 0x7fbef8136d00 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 10 monclient: _renew_subs 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef809f790 con 0x7fbef8136d00 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbee8004bc0 con 0x7fbef8136d00 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeedffb640 10 monclient: dump: 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeef7fe640 4 set_mon_vals no callback set 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 10 client.4358.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 10 monclient: _renew_subs 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8122380 con 0x7fbef8136d00 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.528+0000 7fbeff89d640 1 librados: init done 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fbee8004d20 con 0x7fbef8136d00 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fbedc03a280 0x7fbedc03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeff89d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeff89d640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 0x7fbef802b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8069c80 con 0x7fbef81cb9c0 2024-03-27T21:30:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fbee8049030 con 0x7fbef8136d00 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 10 client.4358.objecter ms_dispatch 0x7fbef8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 3 client.4358.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 3 client.4358.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 20 client.4358.objecter dump_active .. 0 homeless 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 0x7fbef802b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient: get_auth_request con 0x7fbef81cb9c0 auth_method 0 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefd639640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fbedc03a280 0x7fbedc03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefd639640 10 monclient: get_auth_request con 0x7fbedc03a280 auth_method 0 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 10 monclient(hunting): handle_auth_done global_id 4367 payload 824 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbef80a3020 con 0x7fbef81cb9c0 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbefde3a640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 0x7fbef802b170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbef80a2f90 tx=0x7fbef4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 10 client.4358.objecter ms_handle_connect 0x7fbef81cb9c0 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.529+0000 7fbeedffb640 10 client.4358.objecter resend_mon_ops 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 10 client.4358.objecter ms_handle_connect 0x7fbedc03a280 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbefd639640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fbedc03a280 0x7fbedc03c740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbef000f240 tx=0x7fbef0008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbef4009510 con 0x7fbef81cb9c0 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 10 monclient: dump: 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fbef402cb70 con 0x7fbef81cb9c0 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 msgr2=0x7fbef802b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 0x7fbef802b170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbef80a2f90 tx=0x7fbef4004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 msgr2=0x7fbef802b170 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.530+0000 7fbeedffb640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cb9c0 0x7fbef802b170 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbef80a2f90 tx=0x7fbef4004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbeff89d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbeff89d640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 0x7fbef802b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbeff89d640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8073150 con 0x7fbef81cbda0 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 0x7fbef802b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient: get_auth_request con 0x7fbef81cbda0 auth_method 0 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 10 monclient(hunting): handle_auth_done global_id 4376 payload 824 2024-03-27T21:30:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.536+0000 7fbefde3a640 1 -- 172.21.15.28:0/338879470 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbef8137ad0 con 0x7fbef81cbda0 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 client.4358.objecter ms_handle_connect 0x7fbef81cbda0 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 client.4358.objecter resend_mon_ops 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbefde3a640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 0x7fbef802b6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009e80 tx=0x7fbef4009000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fbef404e070 con 0x7fbef81cbda0 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 monclient: dump: 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 <== mon.2 v2:172.21.15.28:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9338 (secure 0 0 0) 0x7fbef4052410 con 0x7fbef81cbda0 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 msgr2=0x7fbef802b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 0x7fbef802b6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009e80 tx=0x7fbef4009000 comp rx=0 tx=0).stop 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 msgr2=0x7fbef802b6b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeedffb640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef81cbda0 0x7fbef802b6b0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009e80 tx=0x7fbef4009000 comp rx=0 tx=0).stop 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:27.551 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 17, 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.552 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.553 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:27.554 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.555 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:27.556 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.557 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:27.558 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.559 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.560 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.561 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.562 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:27.563 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.564 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.565 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.566 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.567 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.568 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.569 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.570 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:27.571 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.572 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 2 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:27.573 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 10 librados: watch_flush enter 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 10 librados: watch_flush exit 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 20 client.4358.objecter shutdown clearing up homeless session... 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 10 client.4358.objecter successfully canceled tick 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fbedc03a280 msgr2=0x7fbedc03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fbedc03a280 0x7fbedc03c740 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbef000f240 tx=0x7fbef0008040 comp rx=0 tx=0).stop 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 10 monclient: shutdown 2024-03-27T21:30:27.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8136d00 msgr2=0x7fbef8134f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbefde3a640 1 -- 172.21.15.28:0/338879470 reap_dead start 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.537+0000 7fbeff89d640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8136d00 0x7fbef8134f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbee800c410 tx=0x7fbee800c8d0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.538+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 shutdown_connections 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.538+0000 7fbeff89d640 1 --2- 172.21.15.28:0/338879470 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fbef8136d00 0x7fbef8134f80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.538+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 >> 172.21.15.28:0/338879470 conn(0x7fbef80a9430 msgr2=0x7fbef80662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.538+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 shutdown_connections 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.538+0000 7fbeff89d640 1 -- 172.21.15.28:0/338879470 wait complete. 2024-03-27T21:30:27.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.538+0000 7fbeff89d640 1 librados: shutdown 2024-03-27T21:30:27.576 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:27.576 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-03-27T21:30:27.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-27T21:30:27.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.688+0000 7fd901c8b640 10 monclient: get_monmap_and_config 2024-03-27T21:30:27.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.688+0000 7fd901c8b640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.688+0000 7fd901c8b640 10 monclient: monmap: 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:27.689241+0000 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:27.689241+0000 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.678 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:27.679 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 Processor -- start 2024-03-27T21:30:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 -- start start 2024-03-27T21:30:27.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient: init 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient: _add_conns ranks=[3,7,1,5,0,8,10,6,4,9,2] 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd8fc136d00 0x7fd8fc1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): picked mon.noname-g con 0x7fd8fc136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8fc0a3d70 0x7fd8fc137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): picked mon.noname-i con 0x7fd8fc0a3d70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd8fc1339e0 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8fc0618f0 con 0x7fd8fc1339e0 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0a25b0 con 0x7fd8fc136d00 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc137b60 con 0x7fd8fc0a3d70 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd901c8b640 10 monclient(hunting): authenticate will time out at 849.996363s 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8faffd640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8fc0a3d70 0x7fd8fc137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd8fc136d00 0x7fd8fc1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fbfff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd8fc1339e0 0x7fd8fc133e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.28:38644/0 (socket says 172.21.15.28:38644) 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fbfff640 1 -- 172.21.15.28:0/1224370978 learned_addr learned my addr 172.21.15.28:0/1224370978 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 10 monclient(hunting): get_auth_request con 0x7fd8fc136d00 auth_method 0 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8faffd640 10 monclient(hunting): get_auth_request con 0x7fd8fc0a3d70 auth_method 0 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8faffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8faffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.689+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fa7fc640 1 -- 172.21.15.28:0/1224370978 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709217219 0 0) 0x7fd8fc0618f0 con 0x7fd8fc1339e0 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fa7fc640 10 monclient(hunting): _negotiate 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fa7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fa7fc640 10 monclient(hunting): my global_id is 4519 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fa7fc640 1 -- 172.21.15.28:0/1224370978 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e4003520 con 0x7fd8fc1339e0 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_done global_id 4440 payload 274 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 1 -- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8fc0a3d70 msgr2=0x7fd8fc137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:27.691 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8fc0a3d70 0x7fd8fc137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 1 -- 172.21.15.28:0/1224370978 >> v1:172.21.15.63:6789/0 conn(0x7fd8fc1339e0 legacy=0x7fd8fc133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 1 monclient: found mon.noname-g 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 1 -- 172.21.15.28:0/1224370978 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc0a13f0 con 0x7fd8fc136d00 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8faffd640 1 --2- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8fc0a3d70 0x7fd8fc137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.690+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd8fc136d00 0x7fd8fc1370e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009800 tx=0x7fd8ec02b760 comp rx=0 tx=0).ready entity=mon.3 client_cookie=f6d1f56849493905 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 1 -- 172.21.15.28:0/1224370978 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd8ec0044a0 con 0x7fd8fc136d00 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: dump: 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.692 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 1 -- 172.21.15.28:0/1224370978 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec02e050 con 0x7fd8fc136d00 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 5 monclient: authenticate success, global_id 4440 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 1 -- 172.21.15.28:0/1224370978 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd8ec003a80 con 0x7fd8fc136d00 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 4 set_mon_vals no callback set 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd8fa7fc640 10 monclient: dump: 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.694 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 10 monclient: shutdown 2024-03-27T21:30:27.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 -- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd8fc136d00 msgr2=0x7fd8fc1370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd8fc136d00 0x7fd8fc1370e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009800 tx=0x7fd8ec02b760 comp rx=0 tx=0).stop 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 -- 172.21.15.28:0/1224370978 shutdown_connections 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8fc0a3d70 0x7fd8fc137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1224370978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd8fc136d00 0x7fd8fc1370e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 -- 172.21.15.28:0/1224370978 >> 172.21.15.28:0/1224370978 conn(0x7fd8fc0a9430 msgr2=0x7fd8fc0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 -- 172.21.15.28:0/1224370978 shutdown_connections 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.691+0000 7fd901c8b640 1 -- 172.21.15.28:0/1224370978 wait complete. 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 10 monclient: monmap: 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:27.696 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 1 librados: starting msgr at 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 1 librados: starting objecter 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 1 Processor -- start 2024-03-27T21:30:27.697 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 1 -- start start 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 1 librados: setting wanted keys 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 1 librados: calling monclient init 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.692+0000 7fd901c8b640 10 monclient: init 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient: _add_conns ranks=[0,4,8,7,6,1,2,3,5] 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8fc0a3d70 0x7fd8fc1cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): picked mon.noname-a con 0x7fd8fc0a3d70 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc1339e0 0x7fd8fc132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): picked mon.noname-c con 0x7fd8fc1339e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd8fc136d00 0x7fd8fc133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): picked mon.noname-e con 0x7fd8fc136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0a11e0 con 0x7fd8fc0a3d70 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.698 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc1202d0 con 0x7fd8fc1339e0 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc11fc80 con 0x7fd8fc136d00 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd901c8b640 10 monclient(hunting): authenticate will time out at 849.999978s 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8fc0a3d70 0x7fd8fc1cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc1339e0 0x7fd8fc132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8fc0a3d70 0x7fd8fc1cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38584/0 (socket says 172.21.15.28:38584) 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): get_auth_request con 0x7fd8fc1339e0 auth_method 0 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 1 -- 172.21.15.28:0/1684284332 learned_addr learned my addr 172.21.15.28:0/1684284332 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): get_auth_request con 0x7fd8fc0a3d70 auth_method 0 2024-03-27T21:30:27.699 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd8fc136d00 0x7fd8fc133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): get_auth_request con 0x7fd8fc136d00 auth_method 0 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.700 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient(hunting): handle_auth_done global_id 4364 payload 824 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc1339e0 msgr2=0x7fd8fc132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc1339e0 0x7fd8fc132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8fc0a3d70 msgr2=0x7fd8fc1cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8fc0a3d70 0x7fd8fc1cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 monclient: found mon.noname-e 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009400 con 0x7fd8fc136d00 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd8fc0a3d70 0x7fd8fc1cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8faffd640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc1339e0 0x7fd8fc132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8fbfff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd8fc136d00 0x7fd8fc133080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400cad0 tx=0x7fd8f400cf90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8e3fff640 10 client.?.objecter ms_handle_connect 0x7fd8fc136d00 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.693+0000 7fd8e3fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd8f400ade0 con 0x7fd8fc136d00 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: dump: 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.702 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 5 monclient: authenticate success, global_id 4364 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f4007070 con 0x7fd8fc136d00 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 monclient: _renew_subs 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ec009400 con 0x7fd8fc136d00 2024-03-27T21:30:27.703 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd8f4007690 con 0x7fd8fc136d00 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 10 monclient: dump: 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.704 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8f97fa640 4 set_mon_vals no callback set 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 client.4364.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 monclient: _renew_subs 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc09e2e0 con 0x7fd8fc136d00 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 1 librados: init done 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fd8f4007220 con 0x7fd8fc136d00 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 0x7fd8fc09cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.694+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc069c80 con 0x7fd8fc09c7f0 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 0x7fd8fc09cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient: get_auth_request con 0x7fd8fc09c7f0 auth_method 0 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd8e803a280 0x7fd8e803c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fd8f4049a60 con 0x7fd8fc136d00 2024-03-27T21:30:27.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 client.4364.objecter ms_dispatch 0x7fd8fc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 3 client.4364.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 3 client.4364.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_done global_id 4369 payload 824 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8faffd640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd8e803a280 0x7fd8e803c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8fc11fdf0 con 0x7fd8fc09c7f0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8faffd640 10 monclient: get_auth_request con 0x7fd8e803a280 auth_method 0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 20 client.4364.objecter dump_active .. 0 homeless 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 client.4364.objecter ms_handle_connect 0x7fd8fc09c7f0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 client.4364.objecter resend_mon_ops 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 0x7fd8fc09cbd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec02b7a0 tx=0x7fd8ec0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd8ec003c60 con 0x7fd8fc09c7f0 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 monclient: dump: 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.708 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 client.4364.objecter ms_handle_connect 0x7fd8e803a280 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8faffd640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd8e803a280 0x7fd8e803c740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc09e6d0 tx=0x7fd8f0009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.4 v2:172.21.15.28:3302/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd8ec041070 con 0x7fd8fc09c7f0 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 msgr2=0x7fd8fc09cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 0x7fd8fc09cbd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec02b7a0 tx=0x7fd8ec0046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 msgr2=0x7fd8fc09cbd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.695+0000 7fd8e3fff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09c7f0 0x7fd8fc09cbd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd901c8b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 0x7fd8fc0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd901c8b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc073150 con 0x7fd8fc09d110 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 0x7fd8fc0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient: get_auth_request con 0x7fd8fc09d110 auth_method 0 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 10 monclient(hunting): handle_auth_done global_id 4378 payload 824 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 1 -- 172.21.15.28:0/1684284332 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd8fc0a3020 con 0x7fd8fc09d110 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8e3fff640 10 client.4364.objecter ms_handle_connect 0x7fd8fc09d110 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8fb7fe640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 0x7fd8fc0a7050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec044000 tx=0x7fd8ec030000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8e3fff640 10 client.4364.objecter resend_mon_ops 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd8ec0488f0 con 0x7fd8fc09d110 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8e3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8e3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.702+0000 7fd8e3fff640 10 monclient: dump: 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.713 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 <== mon.4 v2:172.21.15.28:3302/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9168 (secure 0 0 0) 0x7fd8ec048480 con 0x7fd8fc09d110 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 msgr2=0x7fd8fc0a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 0x7fd8fc0a7050 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec044000 tx=0x7fd8ec030000 comp rx=0 tx=0).stop 2024-03-27T21:30:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 msgr2=0x7fd8fc0a7050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8e3fff640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd8fc09d110 0x7fd8fc0a7050 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec044000 tx=0x7fd8ec030000 comp rx=0 tx=0).stop 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:27.715 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 18, 2024-03-27T21:30:27.716 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:27.717 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:27.718 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.719 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:27.720 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.721 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.722 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.723 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.724 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.725 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.726 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.727 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:27.728 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.729 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.730 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.731 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.732 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.733 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.734 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.735 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.736 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.736 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:27.736 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 10 librados: watch_flush enter 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 10 librados: watch_flush exit 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 20 client.4364.objecter shutdown clearing up homeless session... 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 10 client.4364.objecter successfully canceled tick 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd8e803a280 msgr2=0x7fd8e803c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd8e803a280 0x7fd8e803c740 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc09e6d0 tx=0x7fd8f0009190 comp rx=0 tx=0).stop 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 10 monclient: shutdown 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd8fc136d00 msgr2=0x7fd8fc133080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd8fbfff640 1 -- 172.21.15.28:0/1684284332 reap_dead start 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd8fc136d00 0x7fd8fc133080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400cad0 tx=0x7fd8f400cf90 comp rx=0 tx=0).stop 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 shutdown_connections 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 --2- 172.21.15.28:0/1684284332 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd8fc136d00 0x7fd8fc133080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 >> 172.21.15.28:0/1684284332 conn(0x7fd8fc0a9430 msgr2=0x7fd8fc0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 shutdown_connections 2024-03-27T21:30:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 -- 172.21.15.28:0/1684284332 wait complete. 2024-03-27T21:30:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.703+0000 7fd901c8b640 1 librados: shutdown 2024-03-27T21:30:27.739 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:27.739 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-03-27T21:30:27.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-03-27T21:30:27.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.850+0000 7fe3b5eae640 10 monclient: get_monmap_and_config 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.850+0000 7fe3b5eae640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.851+0000 7fe3b5eae640 10 monclient: monmap: 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:27.851790+0000 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:27.851790+0000 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.840 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:27.841 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.851+0000 7fe3b5eae640 1 Processor -- start 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.851+0000 7fe3b5eae640 1 -- start start 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.851+0000 7fe3b5eae640 10 monclient: init 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient: _add_conns ranks=[0,6,5,4,1,3,2,7,9,10,8] 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe3b0136d00 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b00a3d70 0x7fe3b013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): picked mon.noname-d con 0x7fe3b00a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:27.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe3b01377f0 0x7fe3b013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): picked mon.noname-h con 0x7fe3b01377f0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3b00618f0 con 0x7fe3b0136d00 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00a25b0 con 0x7fe3b01377f0 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00a13f0 con 0x7fe3b00a3d70 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3b5eae640 10 monclient(hunting): authenticate will time out at 850.158955s 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3af7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe3b0136d00 0x7fe3b01370e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52996/0 (socket says 172.21.15.28:52996) 2024-03-27T21:30:27.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3af7fe640 1 -- 172.21.15.28:0/1613303316 learned_addr learned my addr 172.21.15.28:0/1613303316 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b00a3d70 0x7fe3b013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): get_auth_request con 0x7fe3b00a3d70 auth_method 0 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3affff640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe3b01377f0 0x7fe3b013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3affff640 10 monclient(hunting): get_auth_request con 0x7fe3b01377f0 auth_method 0 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3affff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3affff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient(hunting): handle_auth_done global_id 4407 payload 274 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 1 -- 172.21.15.28:0/1613303316 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe3b01377f0 msgr2=0x7fe3b013e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe3b01377f0 0x7fe3b013e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3ae7fc640 1 -- 172.21.15.28:0/1613303316 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986877108 0 0) 0x7fe3b00618f0 con 0x7fe3b0136d00 2024-03-27T21:30:27.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 1 -- 172.21.15.28:0/1613303316 >> v1:172.21.15.28:6789/0 conn(0x7fe3b0136d00 legacy=0x7fe3b01370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 1 monclient: found mon.noname-d 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3aeffd640 1 -- 172.21.15.28:0/1613303316 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b00a1f60 con 0x7fe3b00a3d70 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.852+0000 7fe3ae7fc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3aeffd640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b00a3d70 0x7fe3b013c2a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40097d0 tx=0x7fe3a402b770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=db5df8a47f697e8e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 1 -- 172.21.15.28:0/1613303316 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe3a4031940 con 0x7fe3b00a3d70 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.859 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: dump: 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.860 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.861 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.862 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.862 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.862 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.862 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.862 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.862 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3b5eae640 5 monclient: authenticate success, global_id 4407 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 1 -- 172.21.15.28:0/1613303316 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a4031ac0 con 0x7fe3b00a3d70 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3b5eae640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 1 -- 172.21.15.28:0/1613303316 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe3a4031c30 con 0x7fe3b00a3d70 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3b5eae640 4 set_mon_vals no callback set 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:27.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.853+0000 7fe3ae7fc640 10 monclient: dump: 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.864 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 10 monclient: shutdown 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 -- 172.21.15.28:0/1613303316 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b00a3d70 msgr2=0x7fe3b013c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b00a3d70 0x7fe3b013c2a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40097d0 tx=0x7fe3a402b770 comp rx=0 tx=0).stop 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 -- 172.21.15.28:0/1613303316 shutdown_connections 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fe3b01377f0 0x7fe3b013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/1613303316 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b00a3d70 0x7fe3b013c2a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 -- 172.21.15.28:0/1613303316 >> 172.21.15.28:0/1613303316 conn(0x7fe3b00a9430 msgr2=0x7fe3b00a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 -- 172.21.15.28:0/1613303316 shutdown_connections 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 -- 172.21.15.28:0/1613303316 wait complete. 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 10 monclient: build_initial_monmap 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 10 monclient: monmap: 2024-03-27T21:30:27.865 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:27.866 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 librados: starting msgr at 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 librados: starting objecter 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.854+0000 7fe3b5eae640 1 Processor -- start 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 -- start start 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 librados: setting wanted keys 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 librados: calling monclient init 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient: init 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient: _add_conns ranks=[8,1,0,7,3,6,5,2,4] 2024-03-27T21:30:27.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe3b00a3d70 0x7fe3b01cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): picked mon.noname-e con 0x7fe3b00a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3b0136d00 0x7fe3b0134090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): picked mon.noname-f con 0x7fe3b0136d00 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 0x7fe3b01345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): picked mon.noname-a con 0x7fe3b01377f0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0120ef0 con 0x7fe3b01377f0 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0134b10 con 0x7fe3b0136d00 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b00a11e0 con 0x7fe3b00a3d70 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3b5eae640 10 monclient(hunting): authenticate will time out at 850.162375s 2024-03-27T21:30:27.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe3b00a3d70 0x7fe3b01cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 0x7fe3b01345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 0x7fe3b01345d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38598/0 (socket says 172.21.15.28:38598) 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe3b00a3d70 0x7fe3b01cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42478/0 (socket says 172.21.15.28:42478) 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 1 -- 172.21.15.28:0/375616701 learned_addr learned my addr 172.21.15.28:0/375616701 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): get_auth_request con 0x7fe3b01377f0 auth_method 0 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): get_auth_request con 0x7fe3b00a3d70 auth_method 0 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3aeffd640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3b0136d00 0x7fe3b0134090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.855+0000 7fe3aeffd640 10 monclient(hunting): get_auth_request con 0x7fe3b0136d00 auth_method 0 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3aeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3aeffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 10 monclient(hunting): handle_auth_done global_id 4563 payload 824 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe3b00a3d70 msgr2=0x7fe3b01cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe3b00a3d70 0x7fe3b01cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3b0136d00 msgr2=0x7fe3b0134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe3b0136d00 0x7fe3b0134090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 monclient: found mon.noname-a 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4009400 con 0x7fe3b01377f0 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3affff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 0x7fe3b01345d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8007cf0 tx=0x7fe3a800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 client.?.objecter ms_handle_connect 0x7fe3b01377f0 2024-03-27T21:30:27.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe3a80098b0 con 0x7fe3b01377f0 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: dump: 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.872 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a800edd0 con 0x7fe3b01377f0 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 5 monclient: authenticate success, global_id 4563 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 10 monclient: _renew_subs 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b00a1630 con 0x7fe3b01377f0 2024-03-27T21:30:27.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe3a8014d00 con 0x7fe3b01377f0 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe397fff640 10 monclient: dump: 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.874 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 10 client.4563.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 10 monclient: _renew_subs 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3b0120010 con 0x7fe3b01377f0 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3adffb640 4 set_mon_vals no callback set 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.856+0000 7fe3b5eae640 1 librados: init done 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3b5eae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 0x7fe3b009e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0069c80 con 0x7fe3b009dc30 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fe3a8014420 con 0x7fe3b01377f0 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 0x7fe3b009e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient: get_auth_request con 0x7fe3b009dc30 auth_method 0 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe39c03a250 0x7fe39c03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fe3a804a750 con 0x7fe3b01377f0 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 10 client.4563.objecter ms_dispatch 0x7fe3b0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 3 client.4563.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 3 client.4563.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_done global_id 4416 payload 824 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3b01211b0 con 0x7fe3b009dc30 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 20 client.4563.objecter dump_active .. 0 homeless 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 10 client.4563.objecter ms_handle_connect 0x7fe3b009dc30 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 10 client.4563.objecter resend_mon_ops 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3af7fe640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 0x7fe3b009e010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a0001970 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3aeffd640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe39c03a250 0x7fe39c03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe3a000faa0 con 0x7fe3b009dc30 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe397fff640 10 monclient: dump: 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.878 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.857+0000 7fe3aeffd640 10 monclient: get_auth_request con 0x7fe39c03a250 auth_method 0 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.6 v2:172.21.15.28:3303/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe3a000fc00 con 0x7fe3b009dc30 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 msgr2=0x7fe3b009e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 0x7fe3b009e010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a0001970 comp rx=0 tx=0).stop 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 msgr2=0x7fe3b009e010 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009dc30 0x7fe3b009e010 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a0001970 comp rx=0 tx=0).stop 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe397fff640 10 client.4563.objecter ms_handle_connect 0x7fe39c03a250 2024-03-27T21:30:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.858+0000 7fe3aeffd640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe39c03a250 0x7fe39c03c710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4036000 tx=0x7fe3a4008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3b5eae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 0x7fe3b0099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3b5eae640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe3b0073150 con 0x7fe3b009e550 2024-03-27T21:30:27.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 0x7fe3b0099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient: get_auth_request con 0x7fe3b009e550 auth_method 0 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 10 monclient(hunting): handle_auth_done global_id 4425 payload 824 2024-03-27T21:30:27.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 1 -- 172.21.15.28:0/375616701 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe3b00672e0 con 0x7fe3b009e550 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe397fff640 10 client.4563.objecter ms_handle_connect 0x7fe3b009e550 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe397fff640 10 client.4563.objecter resend_mon_ops 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe3af7fe640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 0x7fe3b0099a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a0000ed0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe3a0024070 con 0x7fe3b009e550 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe397fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe397fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.864+0000 7fe397fff640 10 monclient: dump: 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:27.882 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 <== mon.6 v2:172.21.15.28:3303/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9168 (secure 0 0 0) 0x7fe3a001fae0 con 0x7fe3b009e550 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 msgr2=0x7fe3b0099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 0x7fe3b0099a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a0000ed0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 msgr2=0x7fe3b0099a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:27.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe397fff640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe3b009e550 0x7fe3b0099a00 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0000c00 tx=0x7fe3a0000ed0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.885 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:27.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:27.885 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:27.885 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 18, 2024-03-27T21:30:27.886 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:27.887 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:27.888 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:27.889 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:27.890 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.891 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.892 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:27.894 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.895 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:27.896 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:27.898 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.902 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:27.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:27.904 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:27.905 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:27.906 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:27.906 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:27.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:27.906 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:27.906 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 10 librados: watch_flush enter 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 10 librados: watch_flush exit 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 20 client.4563.objecter shutdown clearing up homeless session... 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 10 client.4563.objecter successfully canceled tick 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe39c03a250 msgr2=0x7fe39c03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe39c03a250 0x7fe39c03c710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe3a4036000 tx=0x7fe3a4008030 comp rx=0 tx=0).stop 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 10 monclient: shutdown 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 msgr2=0x7fe3b01345d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3affff640 1 -- 172.21.15.28:0/375616701 reap_dead start 2024-03-27T21:30:27.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 0x7fe3b01345d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe3a8007cf0 tx=0x7fe3a800e4b0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 shutdown_connections 2024-03-27T21:30:27.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 --2- 172.21.15.28:0/375616701 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe3b01377f0 0x7fe3b01345d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:27.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 >> 172.21.15.28:0/375616701 conn(0x7fe3b00a9430 msgr2=0x7fe3b0134f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:27.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 shutdown_connections 2024-03-27T21:30:27.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 -- 172.21.15.28:0/375616701 wait complete. 2024-03-27T21:30:27.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:27.865+0000 7fe3b5eae640 1 librados: shutdown 2024-03-27T21:30:27.909 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:27.909 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-03-27T21:30:27.909 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-03-27T21:30:28.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.023+0000 7f1844911640 10 monclient: get_monmap_and_config 2024-03-27T21:30:28.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.023+0000 7f1844911640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.023+0000 7f1844911640 10 monclient: monmap: 2024-03-27T21:30:28.013 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.013 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.014 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:28.024673+0000 2024-03-27T21:30:28.014 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:28.024673+0000 2024-03-27T21:30:28.014 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.014 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.015 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:28.016 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:28.016 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.024+0000 7f1844911640 1 Processor -- start 2024-03-27T21:30:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.024+0000 7f1844911640 1 -- start start 2024-03-27T21:30:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.024+0000 7f1844911640 10 monclient: init 2024-03-27T21:30:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient: _add_conns ranks=[5,0,6,3,4,7,1,8,2,10,9] 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f1840136d00 0x7f18401370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): picked mon.noname-h con 0x7f1840136d00 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f18400a3d70 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1840137620 0x7f18401340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): picked mon.noname-d con 0x7f1840137620 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18400618f0 con 0x7f18400a3d70 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18400a25b0 con 0x7f1840136d00 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f18400a13f0 con 0x7f1840137620 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f1844911640 10 monclient(hunting): authenticate will time out at 850.331841s 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183dd9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f18400a3d70 0x7f18401339e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:53002/0 (socket says 172.21.15.28:53002) 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183dd9b640 1 -- 172.21.15.28:0/2867868902 learned_addr learned my addr 172.21.15.28:0/2867868902 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1840137620 0x7f18401340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): get_auth_request con 0x7f1840137620 auth_method 0 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f1840136d00 0x7f18401370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): get_auth_request con 0x7f1840136d00 auth_method 0 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient(hunting): handle_auth_done global_id 4434 payload 274 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 1 -- 172.21.15.28:0/2867868902 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f1840136d00 msgr2=0x7f18401370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f1840136d00 0x7f18401370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183d59a640 1 -- 172.21.15.28:0/2867868902 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683184562 0 0) 0x7f18400618f0 con 0x7f18400a3d70 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 1 -- 172.21.15.28:0/2867868902 >> v1:172.21.15.28:6789/0 conn(0x7f18400a3d70 legacy=0x7f18401339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 1 monclient: found mon.noname-d 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183ed9d640 1 -- 172.21.15.28:0/2867868902 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400a1f60 con 0x7f1840137620 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.025+0000 7f183d59a640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183ed9d640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1840137620 0x7f18401340f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1830009dc0 tx=0x7f183002bd50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=a10c80147329f42a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 1 -- 172.21.15.28:0/2867868902 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f183002cd70 con 0x7f1840137620 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: dump: 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.036 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.037 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 1 -- 172.21.15.28:0/2867868902 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830032340 con 0x7f1840137620 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 5 monclient: authenticate success, global_id 4434 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:28.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 1 -- 172.21.15.28:0/2867868902 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1830032920 con 0x7f1840137620 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 4 set_mon_vals no callback set 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f183d59a640 10 monclient: dump: 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.039 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.040 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 10 monclient: shutdown 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 1 -- 172.21.15.28:0/2867868902 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1840137620 msgr2=0x7f18401340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.026+0000 7f1844911640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1840137620 0x7f18401340f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1830009dc0 tx=0x7f183002bd50 comp rx=0 tx=0).stop 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 -- 172.21.15.28:0/2867868902 shutdown_connections 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f1840137620 0x7f18401340f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 --2- 172.21.15.28:0/2867868902 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f1840136d00 0x7f18401370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 -- 172.21.15.28:0/2867868902 >> 172.21.15.28:0/2867868902 conn(0x7f18400a9430 msgr2=0x7f18400a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 -- 172.21.15.28:0/2867868902 shutdown_connections 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 -- 172.21.15.28:0/2867868902 wait complete. 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 10 monclient: monmap: 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:28.042 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 librados: starting msgr at 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.027+0000 7f1844911640 1 librados: starting objecter 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 Processor -- start 2024-03-27T21:30:28.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 -- start start 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 librados: setting wanted keys 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 librados: calling monclient init 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient: init 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient: _add_conns ranks=[1,0,4,5,8,6,3,7,2] 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18400a3d70 0x7f18401cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): picked mon.noname-f con 0x7f18400a3d70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1840136d00 0x7f1840131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): picked mon.noname-a con 0x7f1840136d00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f1840137620 0x7f18401322e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): picked mon.noname-c con 0x7f1840137620 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18400a1630 con 0x7f1840136d00 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184009f660 con 0x7f18400a3d70 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f184009e140 con 0x7f1840137620 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f1844911640 10 monclient(hunting): authenticate will time out at 850.335329s 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1840136d00 0x7f1840131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f1840137620 0x7f18401322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f1840137620 0x7f18401322e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48550/0 (socket says 172.21.15.28:48550) 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 1 -- 172.21.15.28:0/901060341 learned_addr learned my addr 172.21.15.28:0/901060341 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): get_auth_request con 0x7f1840137620 auth_method 0 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): get_auth_request con 0x7f1840136d00 auth_method 0 2024-03-27T21:30:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183e59c640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18400a3d70 0x7f18401cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183e59c640 10 monclient(hunting): get_auth_request con 0x7f18400a3d70 auth_method 0 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.028+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 10 monclient(hunting): handle_auth_done global_id 4581 payload 824 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f1840137620 msgr2=0x7f18401322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f1840137620 0x7f18401322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18400a3d70 msgr2=0x7f18401cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18400a3d70 0x7f18401cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 monclient: found mon.noname-a 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009a70 con 0x7f1840136d00 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183ed9d640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f1840137620 0x7f18401322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f183dd9b640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1840136d00 0x7f1840131da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18400a5550 tx=0x7f182800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 client.?.objecter ms_handle_connect 0x7f1840136d00 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f18280047e0 con 0x7f1840136d00 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: dump: 2024-03-27T21:30:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 5 monclient: authenticate success, global_id 4581 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1828004960 con 0x7f1840136d00 2024-03-27T21:30:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 10 monclient: _renew_subs 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1840132820 con 0x7f1840136d00 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f18280133c0 con 0x7f1840136d00 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1837fff640 4 set_mon_vals no callback set 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 10 client.4581.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1836ffd640 10 monclient: dump: 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 10 monclient: _renew_subs 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184009d570 con 0x7f1840136d00 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.029+0000 7f1844911640 1 librados: init done 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f1828004b50 con 0x7f1840136d00 2024-03-27T21:30:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1844911640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1844911640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 0x7f184009bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f1840069c80 con 0x7f184009b9e0 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 0x7f184009bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient: get_auth_request con 0x7f184009b9e0 auth_method 0 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f182003a250 0x7f182003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f1828049d10 con 0x7f1840136d00 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 10 client.4581.objecter ms_dispatch 0x7f1840000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 3 client.4581.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 3 client.4581.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f1836ffd640 20 client.4581.objecter dump_active .. 0 homeless 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 10 monclient(hunting): handle_auth_done global_id 4382 payload 824 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183e59c640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18400a3020 con 0x7f184009b9e0 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183ed9d640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f182003a250 0x7f182003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.030+0000 7f183ed9d640 10 monclient: get_auth_request con 0x7f182003a250 auth_method 0 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 client.4581.objecter ms_handle_connect 0x7f184009b9e0 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 client.4581.objecter resend_mon_ops 2024-03-27T21:30:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f183e59c640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 0x7f184009bdc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18380118e0 tx=0x7f1838011da0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f183800fdc0 con 0x7f184009b9e0 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 monclient: dump: 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 client.4581.objecter ms_handle_connect 0x7f182003a250 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f183ed9d640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f182003a250 0x7f182003c710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1830009dc0 tx=0x7f1830030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.8 v2:172.21.15.28:3304/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f1838004300 con 0x7f184009b9e0 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 msgr2=0x7f184009bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 0x7f184009bdc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f18380118e0 tx=0x7f1838011da0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 msgr2=0x7f184009bdc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.031+0000 7f1836ffd640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009b9e0 0x7f184009bdc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f1844911640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f1844911640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 0x7f18400a7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f1844911640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f1840073150 con 0x7f184009c300 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 0x7f18400a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient: get_auth_request con 0x7f184009c300 auth_method 0 2024-03-27T21:30:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.037+0000 7f183e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f183e59c640 10 monclient(hunting): handle_auth_done global_id 4391 payload 824 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f183e59c640 1 -- 172.21.15.28:0/901060341 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f1840137ad0 con 0x7f184009c300 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 client.4581.objecter ms_handle_connect 0x7f184009c300 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 client.4581.objecter resend_mon_ops 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f183e59c640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 0x7f18400a7150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18380118e0 tx=0x7f18380046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f183802c070 con 0x7f184009c300 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 monclient: dump: 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 <== mon.8 v2:172.21.15.28:3304/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9168 (secure 0 0 0) 0x7f1838024040 con 0x7f184009c300 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 msgr2=0x7f18400a7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 0x7f18400a7150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18380118e0 tx=0x7f18380046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 msgr2=0x7f18400a7150 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1836ffd640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f184009c300 0x7f18400a7150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:28.065 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 18, 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.066 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.067 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.068 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.069 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:28.070 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.071 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:28.072 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.073 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.074 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.075 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.076 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.077 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.078 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.079 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:28.080 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.082 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:28.083 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.084 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.085 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.086 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:28.088 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.089 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.090 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.091 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.093 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:28.093 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.093 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.093 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.094 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:28.095 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.096 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.097 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.097 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.097 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.097 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:28.097 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:28.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 10 librados: watch_flush enter 2024-03-27T21:30:28.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 10 librados: watch_flush exit 2024-03-27T21:30:28.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 20 client.4581.objecter shutdown clearing up homeless session... 2024-03-27T21:30:28.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 10 client.4581.objecter successfully canceled tick 2024-03-27T21:30:28.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f182003a250 msgr2=0x7f182003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f182003a250 0x7f182003c710 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1830009dc0 tx=0x7f1830030000 comp rx=0 tx=0).stop 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 10 monclient: shutdown 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1840136d00 msgr2=0x7f1840131da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f1844911640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1840136d00 0x7f1840131da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18400a5550 tx=0x7f182800c870 comp rx=0 tx=0).stop 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.038+0000 7f183ed9d640 1 -- 172.21.15.28:0/901060341 reap_dead start 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.039+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 shutdown_connections 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.039+0000 7f1844911640 1 --2- 172.21.15.28:0/901060341 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1840136d00 0x7f1840131da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.039+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 >> 172.21.15.28:0/901060341 conn(0x7f18400a9430 msgr2=0x7f18401364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.039+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 shutdown_connections 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.039+0000 7f1844911640 1 -- 172.21.15.28:0/901060341 wait complete. 2024-03-27T21:30:28.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.039+0000 7f1844911640 1 librados: shutdown 2024-03-27T21:30:28.101 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:28.101 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-03-27T21:30:28.101 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-03-27T21:30:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.213+0000 7f453512e640 10 monclient: get_monmap_and_config 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.213+0000 7f453512e640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.213+0000 7f453512e640 10 monclient: monmap: 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:28.214379+0000 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:28.214379+0000 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:28.204 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 Processor -- start 2024-03-27T21:30:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 -- start start 2024-03-27T21:30:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient: init 2024-03-27T21:30:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient: _add_conns ranks=[4,5,6,9,8,1,2,3,0,7,10] 2024-03-27T21:30:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f45301370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): picked mon.noname-c con 0x7f4530136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:28.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f45300a3d70 0x7f4530137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): picked mon.noname-h con 0x7f45300a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 0x7f4530133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): picked mon.noname-d con 0x7f45301339e0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45300a25b0 con 0x7f4530136d00 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4530137b60 con 0x7f45300a3d70 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f45300a13f0 con 0x7f45301339e0 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f453512e640 10 monclient(hunting): authenticate will time out at 850.521524s 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452ed9d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f45301370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 0x7f4530133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 0x7f4530133e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43542/0 (socket says 172.21.15.28:43542) 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452ed9d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f45301370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48556/0 (socket says 172.21.15.28:48556) 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 1 -- 172.21.15.28:0/3112748396 learned_addr learned my addr 172.21.15.28:0/3112748396 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 10 monclient(hunting): get_auth_request con 0x7f45301339e0 auth_method 0 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452ed9d640 10 monclient(hunting): get_auth_request con 0x7f4530136d00 auth_method 0 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.214+0000 7f452ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f4527fff640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f45300a3d70 0x7f4530137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f4527fff640 10 monclient(hunting): get_auth_request con 0x7f45300a3d70 auth_method 0 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f4527fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f4527fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f4527fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 10 monclient(hunting): handle_auth_done global_id 4396 payload 274 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 -- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 msgr2=0x7f4530133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 0x7f4530133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 -- 172.21.15.28:0/3112748396 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f45300a3d70 msgr2=0x7f4530137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f45300a3d70 0x7f4530137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 monclient: found mon.noname-c 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 -- 172.21.15.28:0/3112748396 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300618f0 con 0x7f4530136d00 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452f59e640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 0x7f4530133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.215+0000 7f452ed9d640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f45301370e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45200097d0 tx=0x7f452002b6d0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4bc4fb73339ddc8f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 1 -- 172.21.15.28:0/3112748396 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4520030980 con 0x7f4530136d00 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: dump: 2024-03-27T21:30:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 1 -- 172.21.15.28:0/3112748396 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452002e050 con 0x7f4530136d00 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 5 monclient: authenticate success, global_id 4396 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 1 -- 172.21.15.28:0/3112748396 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f45200313a0 con 0x7f4530136d00 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 4 set_mon_vals no callback set 2024-03-27T21:30:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f452e59c640 10 monclient: dump: 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 10 monclient: shutdown 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 -- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 msgr2=0x7f45301370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f45301370e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45200097d0 tx=0x7f452002b6d0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 -- 172.21.15.28:0/3112748396 shutdown_connections 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f45301339e0 0x7f4530133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f45300a3d70 0x7f4530137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 --2- 172.21.15.28:0/3112748396 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f45301370e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 -- 172.21.15.28:0/3112748396 >> 172.21.15.28:0/3112748396 conn(0x7f45300a9430 msgr2=0x7f45300a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 -- 172.21.15.28:0/3112748396 shutdown_connections 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.216+0000 7f453512e640 1 -- 172.21.15.28:0/3112748396 wait complete. 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 10 monclient: monmap: 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 1 librados: starting msgr at 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 1 librados: starting objecter 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 1 Processor -- start 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 1 -- start start 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 1 librados: setting wanted keys 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 1 librados: calling monclient init 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.217+0000 7f453512e640 10 monclient: init 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient: _add_conns ranks=[2,8,4,0,3,6,7,1,5] 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 0x7f45301cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): picked mon.noname-b con 0x7f45300a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f45301339e0 0x7f4530132d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): picked mon.noname-e con 0x7f45301339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f4530133250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): picked mon.noname-c con 0x7f4530136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45301cc280 con 0x7f45300a3d70 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f453009f890 con 0x7f4530136d00 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f45300a1630 con 0x7f45301339e0 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f453512e640 10 monclient(hunting): authenticate will time out at 850.524941s 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 0x7f45301cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f4530133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f45301339e0 0x7f4530132d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 0x7f45301cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36616/0 (socket says 172.21.15.28:36616) 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f4530133250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48564/0 (socket says 172.21.15.28:48564) 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 -- 172.21.15.28:0/821231308 learned_addr learned my addr 172.21.15.28:0/821231308 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): get_auth_request con 0x7f45300a3d70 auth_method 0 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): get_auth_request con 0x7f45301339e0 auth_method 0 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): get_auth_request con 0x7f4530136d00 auth_method 0 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient(hunting): handle_auth_done global_id 4385 payload 824 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f45301339e0 msgr2=0x7f4530132d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f45301339e0 0x7f4530132d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 msgr2=0x7f4530133250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f4530133250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 monclient: found mon.noname-b 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528009b30 con 0x7f45300a3d70 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452f59e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f4530136d00 0x7f4530133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f4527fff640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f45301339e0 0x7f4530132d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f452ed9d640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 0x7f45301cb5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45200096f0 tx=0x7f45200046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f45277fe640 10 client.?.objecter ms_handle_connect 0x7f45300a3d70 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.218+0000 7f45277fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4520003ea0 con 0x7f45300a3d70 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: dump: 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 5 monclient: authenticate success, global_id 4385 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4520006e10 con 0x7f45300a3d70 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 monclient: _renew_subs 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4520009400 con 0x7f45300a3d70 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4520030df0 con 0x7f45300a3d70 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 client.4385.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f452dd9b640 4 set_mon_vals no callback set 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 10 monclient: dump: 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 monclient: _renew_subs 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453011fe50 con 0x7f45300a3d70 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 1 librados: init done 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 0x7f453009cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530069c80 con 0x7f453009c8e0 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.219+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f4520030510 con 0x7f45300a3d70 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f451003a240 0x7f451003c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 0x7f453009cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient: get_auth_request con 0x7f453009c8e0 auth_method 0 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f452006be90 con 0x7f45300a3d70 2024-03-27T21:30:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 client.4385.objecter ms_dispatch 0x7f4530000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 3 client.4385.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 3 client.4385.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f452f59e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f451003a240 0x7f451003c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 20 client.4385.objecter dump_active .. 0 homeless 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f452f59e640 10 monclient: get_auth_request con 0x7f451003a240 auth_method 0 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 10 monclient(hunting): handle_auth_done global_id 4546 payload 824 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f45300a3020 con 0x7f453009c8e0 2024-03-27T21:30:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 client.4385.objecter ms_handle_connect 0x7f453009c8e0 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 client.4385.objecter resend_mon_ops 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f4527fff640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 0x7f453009cd00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4518006fd0 tx=0x7f451800e1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 client.4385.objecter ms_handle_connect 0x7f451003a240 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f452f59e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f451003a240 0x7f451003c700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f453009ea80 tx=0x7f4528016040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f451800ed10 con 0x7f453009c8e0 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.220+0000 7f45277fe640 10 monclient: dump: 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.238 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.1 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f451800ee70 con 0x7f453009c8e0 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 msgr2=0x7f453009cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 0x7f453009cd00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4518006fd0 tx=0x7f451800e1d0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 msgr2=0x7f453009cd00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.221+0000 7f45277fe640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009c8e0 0x7f453009cd00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f453512e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:28.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f453512e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 0x7f45300a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f453512e640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4530073150 con 0x7f453009d240 2024-03-27T21:30:28.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 0x7f45300a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient: get_auth_request con 0x7f453009d240 auth_method 0 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.227+0000 7f4527fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f4527fff640 10 monclient(hunting): handle_auth_done global_id 4555 payload 824 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f4527fff640 1 -- 172.21.15.28:0/821231308 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f45300a2240 con 0x7f453009d240 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f4527fff640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 0x7f45300a7050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4518006fd0 tx=0x7f45180046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 client.4385.objecter ms_handle_connect 0x7f453009d240 2024-03-27T21:30:28.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 client.4385.objecter resend_mon_ops 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f451802b070 con 0x7f453009d240 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 monclient: dump: 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.243 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 <== mon.1 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9168 (secure 0 0 0) 0x7f4518023040 con 0x7f453009d240 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 msgr2=0x7f45300a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 0x7f45300a7050 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4518006fd0 tx=0x7f45180046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 msgr2=0x7f45300a7050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.228+0000 7f45277fe640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f453009d240 0x7f45300a7050 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:28.245 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 18, 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:28.246 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.247 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:28.248 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.249 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.250 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.251 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:28.252 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:28.253 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.254 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:28.255 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.256 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.257 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.258 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.259 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.260 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:28.261 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.262 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:28.263 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.264 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.265 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.266 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:30:28.267 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.268 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.268 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.268 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:28.268 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 10 librados: watch_flush enter 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 10 librados: watch_flush exit 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 20 client.4385.objecter shutdown clearing up homeless session... 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 10 client.4385.objecter successfully canceled tick 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f451003a240 msgr2=0x7f451003c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f451003a240 0x7f451003c700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f453009ea80 tx=0x7f4528016040 comp rx=0 tx=0).stop 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 10 monclient: shutdown 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 msgr2=0x7f45301cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 0x7f45301cb5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f45200096f0 tx=0x7f45200046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f452f59e640 1 -- 172.21.15.28:0/821231308 reap_dead start 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 shutdown_connections 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 --2- 172.21.15.28:0/821231308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f45300a3d70 0x7f45301cb5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 >> 172.21.15.28:0/821231308 conn(0x7f45300a9430 msgr2=0x7f45301365f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 shutdown_connections 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 -- 172.21.15.28:0/821231308 wait complete. 2024-03-27T21:30:28.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.229+0000 7f453512e640 1 librados: shutdown 2024-03-27T21:30:28.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:28.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-03-27T21:30:28.272 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.386+0000 7f6b51327640 10 monclient: get_monmap_and_config 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.386+0000 7f6b51327640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.386+0000 7f6b51327640 10 monclient: monmap: 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:28.386905+0000 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:28.386905+0000 2024-03-27T21:30:28.385 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.386+0000 7f6b51327640 1 Processor -- start 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.386+0000 7f6b51327640 1 -- start start 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.386+0000 7f6b51327640 10 monclient: init 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient: _add_conns ranks=[10,7,3,0,6,1,8,5,2,4,9] 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 0x7f6b4c09c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): picked mon.noname-f con 0x7f6b4c09c4c0 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 0x7f6b4c0a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): picked mon.noname-i con 0x7f6b4c0a1940 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:28.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c13bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): picked mon.noname-g con 0x7f6b4c0a22c0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c1359a0 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c134f00 con 0x7f6b4c0a22c0 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c09fcd0 con 0x7f6b4c0a1940 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b51327640 10 monclient(hunting): authenticate will time out at 850.693909s 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 0x7f6b4c09c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 0x7f6b4c0a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c13bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 0x7f6b4c0a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3303/0 says I am v2:172.21.15.28:36044/0 (socket says 172.21.15.28:36044) 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c13bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.28:55128/0 (socket says 172.21.15.28:55128) 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 0x7f6b4c09c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:38040/0 (socket says 172.21.15.28:38040) 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 -- 172.21.15.28:0/3624168231 learned_addr learned my addr 172.21.15.28:0/3624168231 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): get_auth_request con 0x7f6b4c0a1940 auth_method 0 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): get_auth_request con 0x7f6b4c09c4c0 auth_method 0 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): get_auth_request con 0x7f6b4c0a22c0 auth_method 0 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_done global_id 4462 payload 274 2024-03-27T21:30:28.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 -- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c0a22c0 msgr2=0x7f6b4c13bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c13bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 -- 172.21.15.28:0/3624168231 >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 msgr2=0x7f6b4c09c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/3624168231 >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 0x7f6b4c09c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 monclient: found mon.noname-i 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4a7fc640 1 -- 172.21.15.28:0/3624168231 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0618f0 con 0x7f6b4c0a1940 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.387+0000 7f6b4affd640 1 --2- 172.21.15.28:0/3624168231 >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 0x7f6b4c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 0x7f6b4c0a1d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b400098a0 tx=0x7f6b4002b7b0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=5021ab7d647e2392 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 1 -- 172.21.15.28:0/3624168231 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b40031980 con 0x7f6b4c0a1940 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:30:28.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: dump: 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.392 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 1 -- 172.21.15.28:0/3624168231 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4002f050 con 0x7f6b4c0a1940 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b51327640 5 monclient: authenticate success, global_id 4462 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b51327640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 1 -- 172.21.15.28:0/3624168231 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b400323a0 con 0x7f6b4c0a1940 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b51327640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b51327640 4 set_mon_vals no callback set 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:28.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.388+0000 7f6b49ffb640 10 monclient: dump: 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.394 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 10 monclient: shutdown 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 -- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 msgr2=0x7f6b4c0a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 --2- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 0x7f6b4c0a1d80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6b400098a0 tx=0x7f6b4002b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 -- 172.21.15.28:0/3624168231 shutdown_connections 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 --2- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c13bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 --2- 172.21.15.28:0/3624168231 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f6b4c0a1940 0x7f6b4c0a1d80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 --2- 172.21.15.28:0/3624168231 >> v2:172.21.15.63:3300/0 conn(0x7f6b4c09c4c0 0x7f6b4c09c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 -- 172.21.15.28:0/3624168231 >> 172.21.15.28:0/3624168231 conn(0x7f6b4c0a65f0 msgr2=0x7f6b4c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.395 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 -- 172.21.15.28:0/3624168231 shutdown_connections 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.389+0000 7f6b51327640 1 -- 172.21.15.28:0/3624168231 wait complete. 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 10 monclient: monmap: 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.396 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 1 librados: starting msgr at 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 1 librados: starting objecter 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 1 Processor -- start 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 1 -- start start 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 1 librados: setting wanted keys 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 1 librados: calling monclient init 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.390+0000 7f6b51327640 10 monclient: init 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient: _add_conns ranks=[0,4,2,7,1,5,6,8,3] 2024-03-27T21:30:28.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4c09c4c0 0x7f6b4c1cff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): picked mon.noname-a con 0x7f6b4c09c4c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f6b4c0a1940 0x7f6b4c1d0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): picked mon.noname-c con 0x7f6b4c0a1940 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c1d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): picked mon.noname-b con 0x7f6b4c0a22c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c06ad60 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c09edc0 con 0x7f6b4c0a22c0 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c11e790 con 0x7f6b4c0a1940 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient(hunting): authenticate will time out at 850.697821s 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4c09c4c0 0x7f6b4c1cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4c09c4c0 0x7f6b4c1cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38616/0 (socket says 172.21.15.28:38616) 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f6b4c0a1940 0x7f6b4c1d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c1d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 -- 172.21.15.28:0/604052507 learned_addr learned my addr 172.21.15.28:0/604052507 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): get_auth_request con 0x7f6b4c09c4c0 auth_method 0 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): get_auth_request con 0x7f6b4c0a1940 auth_method 0 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): get_auth_request con 0x7f6b4c0a22c0 auth_method 0 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient(hunting): handle_auth_done global_id 4590 payload 824 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f6b4c0a1940 msgr2=0x7f6b4c1d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f6b4c0a1940 0x7f6b4c1d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f6b4c0a22c0 msgr2=0x7f6b4c1d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c1d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 monclient: found mon.noname-a 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c009a70 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4b7fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f6b4c0a22c0 0x7f6b4c1d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f6b4c0a1940 0x7f6b4c1d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b4affd640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4c09c4c0 0x7f6b4c1cff20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00efc0 tx=0x7f6b3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 client.?.objecter ms_handle_connect 0x7f6b4c09c4c0 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b3c00ced0 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 monclient: dump: 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.401 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.402 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00f040 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 5 monclient: authenticate success, global_id 4590 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient: _renew_subs 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b400094d0 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.391+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b3c014d60 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b337fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b497fa640 4 set_mon_vals no callback set 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b337fe640 10 monclient: dump: 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.403 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 10 client.4590.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 10 monclient: _renew_subs 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c11ed40 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 1 librados: init done 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f6b3c014480 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 0x7f6b4c06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c069d30 con 0x7f6b4c11ef30 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b337fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6b3803a250 0x7f6b3803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.392+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f6b3c04aa90 con 0x7f6b4c09c4c0 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 client.4590.objecter ms_dispatch 0x7f6b4c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 3 client.4590.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 3 client.4590.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:28.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 20 client.4590.objecter dump_active .. 0 homeless 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 0x7f6b4c06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient: get_auth_request con 0x7f6b4c11ef30 auth_method 0 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4b7fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6b3803a250 0x7f6b3803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4b7fe640 10 monclient: get_auth_request con 0x7f6b3803a250 auth_method 0 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_done global_id 4458 payload 824 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b4c099a00 con 0x7f6b4c11ef30 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 client.4590.objecter ms_handle_connect 0x7f6b3803a250 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4b7fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6b3803a250 0x7f6b3803c710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c09ea70 tx=0x7f6b44009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 client.4590.objecter ms_handle_connect 0x7f6b4c11ef30 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 client.4590.objecter resend_mon_ops 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 0x7f6b4c06e3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b40035000 tx=0x7f6b400046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b400044b0 con 0x7f6b4c11ef30 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.393+0000 7f6b337fe640 10 monclient: dump: 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.407 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.3 v2:172.21.15.63:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f6b40031720 con 0x7f6b4c11ef30 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 msgr2=0x7f6b4c06e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 0x7f6b4c06e3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b40035000 tx=0x7f6b400046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 msgr2=0x7f6b4c06e3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.394+0000 7f6b337fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c11ef30 0x7f6b4c06e3b0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b40035000 tx=0x7f6b400046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b51327640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:28.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b51327640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 0x7f6b4c06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b51327640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c073150 con 0x7f6b4c06e8f0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 0x7f6b4c06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient: get_auth_request con 0x7f6b4c06e8f0 auth_method 0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.400+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b4a7fc640 10 monclient(hunting): handle_auth_done global_id 4467 payload 824 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b4a7fc640 1 -- 172.21.15.28:0/604052507 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6b4c0a2770 con 0x7f6b4c06e8f0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b4a7fc640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 0x7f6b4c06ed00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b400097c0 tx=0x7f6b40009240 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 client.4590.objecter ms_handle_connect 0x7f6b4c06e8f0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 client.4590.objecter resend_mon_ops 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6b4003dca0 con 0x7f6b4c06e8f0 2024-03-27T21:30:28.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 monclient: dump: 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.412 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 <== mon.3 v2:172.21.15.63:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9508 (secure 0 0 0) 0x7f6b4003de00 con 0x7f6b4c06e8f0 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 msgr2=0x7f6b4c06ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 0x7f6b4c06ed00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b400097c0 tx=0x7f6b40009240 comp rx=0 tx=0).stop 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 msgr2=0x7f6b4c06ed00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.401+0000 7f6b337fe640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6b4c06e8f0 0x7f6b4c06ed00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:28.413 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:28.414 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 18, 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.415 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.416 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.417 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:28.418 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:28.419 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.420 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.421 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.422 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:28.423 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.424 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.425 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:28.426 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.427 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.428 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:28.429 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.430 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.431 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:28.432 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.433 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": [ 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:28.434 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:28.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 10 librados: watch_flush enter 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 10 librados: watch_flush exit 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 20 client.4590.objecter shutdown clearing up homeless session... 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 10 client.4590.objecter successfully canceled tick 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6b3803a250 msgr2=0x7f6b3803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6b3803a250 0x7f6b3803c710 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c09ea70 tx=0x7f6b44009190 comp rx=0 tx=0).stop 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 10 monclient: shutdown 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4c09c4c0 msgr2=0x7f6b4c1cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 --2- 172.21.15.28:0/604052507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b4c09c4c0 0x7f6b4c1cff20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00efc0 tx=0x7f6b3c00c490 comp rx=0 tx=0).stop 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b4b7fe640 1 -- 172.21.15.28:0/604052507 reap_dead start 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b4b7fe640 1 -- 172.21.15.28:0/604052507 reap_dead start 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 shutdown_connections 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 >> 172.21.15.28:0/604052507 conn(0x7f6b4c0a65f0 msgr2=0x7f6b4c0a4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 shutdown_connections 2024-03-27T21:30:28.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 -- 172.21.15.28:0/604052507 wait complete. 2024-03-27T21:30:28.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.402+0000 7f6b51327640 1 librados: shutdown 2024-03-27T21:30:28.438 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:28.438 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-03-27T21:30:28.438 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.551+0000 7fa65b599640 10 monclient: get_monmap_and_config 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.551+0000 7fa65b599640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.551+0000 7fa65b599640 10 monclient: monmap: 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:28.552202+0000 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:28.552202+0000 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.540 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:28.541 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.551+0000 7fa65b599640 1 Processor -- start 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 1 -- start start 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient: init 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient: _add_conns ranks=[2,6,0,7,10,3,1,5,8,9,4] 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa65409fed0 0x7fa6540a1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): picked mon.noname-b con 0x7fa65409fed0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa65409f410 0x7fa6540a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): picked mon.noname-d con 0x7fa65409f410 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa6540a23c0 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:28.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6540618f0 con 0x7fa6540a23c0 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65409e420 con 0x7fa65409fed0 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa654071b10 con 0x7fa65409f410 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa65b599640 10 monclient(hunting): authenticate will time out at 850.859451s 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa65409f410 0x7fa6540a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa65409fed0 0x7fa6540a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659b36640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa6540a23c0 0x7fa65413db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:53008/0 (socket says 172.21.15.28:53008) 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659b36640 1 -- 172.21.15.28:0/3658879308 learned_addr learned my addr 172.21.15.28:0/3658879308 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): get_auth_request con 0x7fa65409f410 auth_method 0 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): get_auth_request con 0x7fa65409fed0 auth_method 0 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.552+0000 7fa659335640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 10 monclient(hunting): handle_auth_done global_id 4452 payload 274 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa64bfff640 1 -- 172.21.15.28:0/3658879308 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832495667 0 0) 0x7fa6540618f0 con 0x7fa6540a23c0 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 1 -- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa65409fed0 msgr2=0x7fa6540a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 1 --2- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa65409fed0 0x7fa6540a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 1 -- 172.21.15.28:0/3658879308 >> v1:172.21.15.28:6789/0 conn(0x7fa6540a23c0 legacy=0x7fa65413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 1 monclient: found mon.noname-d 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 1 -- 172.21.15.28:0/3658879308 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65409fa80 con 0x7fa65409f410 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa659335640 1 --2- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa65409fed0 0x7fa6540a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa64bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa658b34640 1 --2- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa65409f410 0x7fa6540a1e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097d0 tx=0x7fa64402b790 comp rx=0 tx=0).ready entity=mon.6 client_cookie=47964cbf1ab93c3d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.553+0000 7fa64bfff640 1 -- 172.21.15.28:0/3658879308 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa644031960 con 0x7fa65409f410 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: dump: 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.554 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 1 -- 172.21.15.28:0/3658879308 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644031ae0 con 0x7fa65409f410 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 5 monclient: authenticate success, global_id 4452 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 1 -- 172.21.15.28:0/3658879308 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa644031c50 con 0x7fa65409f410 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 4 set_mon_vals no callback set 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa64bfff640 10 monclient: dump: 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.556 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 10 monclient: shutdown 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 -- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa65409f410 msgr2=0x7fa6540a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 --2- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa65409f410 0x7fa6540a1e80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6440097d0 tx=0x7fa64402b790 comp rx=0 tx=0).stop 2024-03-27T21:30:28.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 -- 172.21.15.28:0/3658879308 shutdown_connections 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 --2- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa65409f410 0x7fa6540a1e80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 --2- 172.21.15.28:0/3658879308 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa65409fed0 0x7fa6540a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 -- 172.21.15.28:0/3658879308 >> 172.21.15.28:0/3658879308 conn(0x7fa6540a6670 msgr2=0x7fa6540a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 -- 172.21.15.28:0/3658879308 shutdown_connections 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.554+0000 7fa65b599640 1 -- 172.21.15.28:0/3658879308 wait complete. 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 10 monclient: monmap: 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:28.558 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 1 librados: starting msgr at 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 1 librados: starting objecter 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 1 Processor -- start 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 1 -- start start 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 1 librados: setting wanted keys 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 1 librados: calling monclient init 2024-03-27T21:30:28.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 10 monclient: init 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.555+0000 7fa65b599640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient: _add_conns ranks=[3,7,2,4,0,8,6,1,5] 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa65409f410 0x7fa6541bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): picked mon.noname-g con 0x7fa65409f410 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa65409fed0 0x7fa6541be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): picked mon.noname-i con 0x7fa65409fed0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6540a23c0 0x7fa6541cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): picked mon.noname-b con 0x7fa6540a23c0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6541be7a0 con 0x7fa6540a23c0 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65409d4a0 con 0x7fa65409f410 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa654071770 con 0x7fa65409fed0 2024-03-27T21:30:28.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient(hunting): authenticate will time out at 850.862807s 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6540a23c0 0x7fa6541cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6540a23c0 0x7fa6541cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36642/0 (socket says 172.21.15.28:36642) 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 -- 172.21.15.28:0/2276333502 learned_addr learned my addr 172.21.15.28:0/2276333502 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): get_auth_request con 0x7fa6540a23c0 auth_method 0 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa658b34640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa65409fed0 0x7fa6541be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659335640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa65409f410 0x7fa6541bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa658b34640 10 monclient(hunting): get_auth_request con 0x7fa65409fed0 auth_method 0 2024-03-27T21:30:28.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa658b34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa658b34640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa658b34640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659335640 10 monclient(hunting): get_auth_request con 0x7fa65409f410 auth_method 0 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659335640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659335640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659335640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient(hunting): handle_auth_done global_id 4412 payload 824 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa65409fed0 msgr2=0x7fa6541be260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa65409fed0 0x7fa6541be260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa65409f410 msgr2=0x7fa6541bdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa65409f410 0x7fa6541bdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 monclient: found mon.noname-b 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa650009400 con 0x7fa6540a23c0 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa659b36640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6540a23c0 0x7fa6541cb220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c700 tx=0x7fa64c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 client.?.objecter ms_handle_connect 0x7fa6540a23c0 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa64c00ce10 con 0x7fa6540a23c0 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: dump: 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.563 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c004d70 con 0x7fa6540a23c0 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 5 monclient: authenticate success, global_id 4412 2024-03-27T21:30:28.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient: _renew_subs 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644009400 con 0x7fa6540a23c0 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa64c0070d0 con 0x7fa6540a23c0 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa649ffb640 10 monclient: dump: 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.565 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.556+0000 7fa64b7fe640 4 set_mon_vals no callback set 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 10 client.4412.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 10 monclient: _renew_subs 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6541ab120 con 0x7fa6540a23c0 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 1 librados: init done 2024-03-27T21:30:28.566 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa64c007230 con 0x7fa6540a23c0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63803a250 0x7fa63803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 0x7fa6541cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa654069d30 con 0x7fa6541cb760 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa64c0492a0 con 0x7fa6540a23c0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 10 client.4412.objecter ms_dispatch 0x7fa654000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 3 client.4412.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 3 client.4412.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa649ffb640 20 client.4412.objecter dump_active .. 0 homeless 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa659335640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63803a250 0x7fa63803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa659335640 10 monclient: get_auth_request con 0x7fa63803a250 auth_method 0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa658b34640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 0x7fa6541cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa658b34640 10 monclient: get_auth_request con 0x7fa6541cb760 auth_method 0 2024-03-27T21:30:28.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa658b34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa658b34640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.557+0000 7fa658b34640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa658b34640 10 monclient(hunting): handle_auth_done global_id 4388 payload 824 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa658b34640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa65409e140 con 0x7fa6541cb760 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 10 client.4412.objecter ms_handle_connect 0x7fa63803a250 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa659335640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63803a250 0x7fa63803c710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa650009c60 tx=0x7fa650008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 10 client.4412.objecter ms_handle_connect 0x7fa6541cb760 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 10 client.4412.objecter resend_mon_ops 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa658b34640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 0x7fa6541cbb40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa6540a3970 tx=0x7fa6440046c0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa644031c50 con 0x7fa6541cb760 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 10 monclient: dump: 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.569 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.558+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.5 v2:172.21.15.63:3302/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fa644004250 con 0x7fa6541cb760 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.559+0000 7fa649ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.559+0000 7fa649ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.559+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 msgr2=0x7fa6541cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.559+0000 7fa649ffb640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 0x7fa6541cbb40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa6540a3970 tx=0x7fa6440046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.559+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 msgr2=0x7fa6541cbb40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.559+0000 7fa649ffb640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa6541cb760 0x7fa6541cbb40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa65b599640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa65b599640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 0x7fa654070710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa65b599640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540a02b0 con 0x7fa654070300 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 0x7fa654070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient: get_auth_request con 0x7fa654070300 auth_method 0 2024-03-27T21:30:28.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 10 monclient(hunting): handle_auth_done global_id 4397 payload 824 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.565+0000 7fa658b34640 1 -- 172.21.15.28:0/2276333502 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fa654067360 con 0x7fa654070300 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa658b34640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 0x7fa654070710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa64402b7d0 tx=0x7fa644031000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 client.4412.objecter ms_handle_connect 0x7fa654070300 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 client.4412.objecter resend_mon_ops 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa644034dd0 con 0x7fa654070300 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 monclient: dump: 2024-03-27T21:30:28.573 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.574 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 <== mon.5 v2:172.21.15.63:3302/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9338 (secure 0 0 0) 0x7fa644034960 con 0x7fa654070300 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 msgr2=0x7fa654070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 0x7fa654070710 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa64402b7d0 tx=0x7fa644031000 comp rx=0 tx=0).stop 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 msgr2=0x7fa654070710 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa649ffb640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa654070300 0x7fa654070710 secure :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa64402b7d0 tx=0x7fa644031000 comp rx=0 tx=0).stop 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:28.575 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.576 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 18, 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.577 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.578 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:28.579 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.580 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.581 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.582 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.583 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:28.584 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.585 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.586 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.587 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.588 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.589 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.590 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.591 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.592 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.593 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.594 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.595 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:28.596 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:28.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa65b599640 10 librados: watch_flush enter 2024-03-27T21:30:28.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa65b599640 10 librados: watch_flush exit 2024-03-27T21:30:28.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa65b599640 20 client.4412.objecter shutdown clearing up homeless session... 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa65b599640 10 client.4412.objecter successfully canceled tick 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63803a250 msgr2=0x7fa63803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.566+0000 7fa65b599640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63803a250 0x7fa63803c710 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa650009c60 tx=0x7fa650008040 comp rx=0 tx=0).stop 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 10 monclient: shutdown 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6540a23c0 msgr2=0x7fa6541cb220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 --2- 172.21.15.28:0/2276333502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6540a23c0 0x7fa6541cb220 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00c700 tx=0x7fa64c00cbc0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa659b36640 1 -- 172.21.15.28:0/2276333502 reap_dead start 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa659b36640 1 -- 172.21.15.28:0/2276333502 reap_dead start 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 shutdown_connections 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 >> 172.21.15.28:0/2276333502 conn(0x7fa6540a6670 msgr2=0x7fa6540662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 shutdown_connections 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 -- 172.21.15.28:0/2276333502 wait complete. 2024-03-27T21:30:28.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.567+0000 7fa65b599640 1 librados: shutdown 2024-03-27T21:30:28.600 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:28.600 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-03-27T21:30:28.600 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.712+0000 7fd8759cb640 10 monclient: get_monmap_and_config 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.712+0000 7fd8759cb640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.712+0000 7fd8759cb640 10 monclient: monmap: 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:28.713305+0000 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:28.713305+0000 2024-03-27T21:30:28.701 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:28.702 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 Processor -- start 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 -- start start 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient: init 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient: _add_conns ranks=[10,7,4,8,3,5,1,6,2,9,0] 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8700a0920 0x7fd870134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): picked mon.noname-f con 0x7fd8700a0920 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135460 0x7fd8700a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): picked mon.noname-i con 0x7fd870135460 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:28.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 0x7fd8700a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): picked mon.noname-c con 0x7fd87006ff10 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8700716a0 con 0x7fd8700a0920 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700713c0 con 0x7fd87006ff10 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700a46c0 con 0x7fd870135460 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd8759cb640 10 monclient(hunting): authenticate will time out at 851.020317s 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 0x7fd8700a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 0x7fd8700a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:48590/0 (socket says 172.21.15.28:48590) 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 1 -- 172.21.15.28:0/270721188 learned_addr learned my addr 172.21.15.28:0/270721188 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): get_auth_request con 0x7fd87006ff10 auth_method 0 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86effd640 1 --2- 172.21.15.28:0/270721188 >> v2:172.21.15.63:3300/0 conn(0x7fd8700a0920 0x7fd870134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86e7fc640 1 --2- 172.21.15.28:0/270721188 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135460 0x7fd8700a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86effd640 10 monclient(hunting): get_auth_request con 0x7fd8700a0920 auth_method 0 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.719 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.713+0000 7fd86e7fc640 10 monclient(hunting): get_auth_request con 0x7fd870135460 auth_method 0 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86e7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_done global_id 4423 payload 274 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 -- 172.21.15.28:0/270721188 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135460 msgr2=0x7fd8700a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 --2- 172.21.15.28:0/270721188 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135460 0x7fd8700a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 -- 172.21.15.28:0/270721188 >> v2:172.21.15.63:3300/0 conn(0x7fd8700a0920 msgr2=0x7fd870134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 --2- 172.21.15.28:0/270721188 >> v2:172.21.15.63:3300/0 conn(0x7fd8700a0920 0x7fd870134f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 monclient: found mon.noname-c 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.720 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 -- 172.21.15.28:0/270721188 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700618f0 con 0x7fd87006ff10 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86f7fe640 1 --2- 172.21.15.28:0/270721188 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 0x7fd8700a2a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd868009870 tx=0x7fd86802b7c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=54870416061fcda9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 1 -- 172.21.15.28:0/270721188 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd868031990 con 0x7fd87006ff10 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: dump: 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.721 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 1 -- 172.21.15.28:0/270721188 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd868031b10 con 0x7fd87006ff10 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd8759cb640 5 monclient: authenticate success, global_id 4423 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd8759cb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd8759cb640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 1 -- 172.21.15.28:0/270721188 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd868031cc0 con 0x7fd87006ff10 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd8759cb640 4 set_mon_vals no callback set 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.714+0000 7fd86dffb640 10 monclient: dump: 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.723 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 10 monclient: shutdown 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 -- 172.21.15.28:0/270721188 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 msgr2=0x7fd8700a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 --2- 172.21.15.28:0/270721188 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 0x7fd8700a2a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd868009870 tx=0x7fd86802b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.724 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 -- 172.21.15.28:0/270721188 shutdown_connections 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 --2- 172.21.15.28:0/270721188 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd87006ff10 0x7fd8700a2a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 --2- 172.21.15.28:0/270721188 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135460 0x7fd8700a0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 --2- 172.21.15.28:0/270721188 >> v2:172.21.15.63:3300/0 conn(0x7fd8700a0920 0x7fd870134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 -- 172.21.15.28:0/270721188 >> 172.21.15.28:0/270721188 conn(0x7fd8700a7810 msgr2=0x7fd8700a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 -- 172.21.15.28:0/270721188 shutdown_connections 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.715+0000 7fd8759cb640 1 -- 172.21.15.28:0/270721188 wait complete. 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 10 monclient: monmap: 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:28.725 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 1 librados: starting msgr at 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 1 librados: starting objecter 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 1 Processor -- start 2024-03-27T21:30:28.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 1 -- start start 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 1 librados: setting wanted keys 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 1 librados: calling monclient init 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.716+0000 7fd8759cb640 10 monclient: init 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient: _add_conns ranks=[3,7,1,6,5,4,2,0,8] 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd87006ff10 0x7fd8701c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): picked mon.noname-g con 0x7fd87006ff10 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8700a0920 0x7fd8701c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): picked mon.noname-i con 0x7fd8700a0920 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd87009c200 0x7fd87009c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): picked mon.noname-f con 0x7fd87009c200 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87012e9d0 con 0x7fd87009c200 2024-03-27T21:30:28.727 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87011f3b0 con 0x7fd87006ff10 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd87011fc50 con 0x7fd8700a0920 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd8759cb640 10 monclient(hunting): authenticate will time out at 851.023914s 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd87006ff10 0x7fd8701c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd87006ff10 0x7fd8701c98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.28:55162/0 (socket says 172.21.15.28:55162) 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd87009c200 0x7fd87009c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8700a0920 0x7fd8701c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 1 -- 172.21.15.28:0/1515555568 learned_addr learned my addr 172.21.15.28:0/1515555568 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): get_auth_request con 0x7fd87006ff10 auth_method 0 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.728 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): get_auth_request con 0x7fd87009c200 auth_method 0 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): get_auth_request con 0x7fd8700a0920 auth_method 0 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.729 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient(hunting): handle_auth_done global_id 4582 payload 824 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8700a0920 msgr2=0x7fd8701c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8700a0920 0x7fd8701c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd87006ff10 msgr2=0x7fd8701c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd87006ff10 0x7fd8701c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 monclient: found mon.noname-f 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:28.730 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680094d0 con 0x7fd87009c200 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86effd640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fd87006ff10 0x7fd8701c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86e7fc640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd8700a0920 0x7fd8701c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd86f7fe640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd87009c200 0x7fd87009c620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd868033000 tx=0x7fd8680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd857fff640 10 client.?.objecter ms_handle_connect 0x7fd87009c200 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.717+0000 7fd857fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd868004470 con 0x7fd87009c200 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: dump: 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.731 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86803ca90 con 0x7fd87009c200 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 5 monclient: authenticate success, global_id 4582 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 monclient: _renew_subs 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd870070a00 con 0x7fd87009c200 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd86803cc00 con 0x7fd87009c200 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:28.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd86d7fa640 4 set_mon_vals no callback set 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 client.4582.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd857fff640 10 monclient: dump: 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.734 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 monclient: _renew_subs 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd87011d880 con 0x7fd87009c200 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 1 librados: init done 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 0x7fd87009cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.718+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd87011e510 con 0x7fd870135280 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 0x7fd87009cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fd868044070 con 0x7fd87009c200 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient: get_auth_request con 0x7fd870135280 auth_method 0 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd85c03a280 0x7fd85c03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fd86806f590 con 0x7fd87009c200 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 10 client.4582.objecter ms_dispatch 0x7fd870000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:28.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 3 client.4582.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 3 client.4582.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 20 client.4582.objecter dump_active .. 0 homeless 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 10 monclient(hunting): handle_auth_done global_id 4498 payload 824 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8700a1450 con 0x7fd870135280 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86e7fc640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd85c03a280 0x7fd85c03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86e7fc640 10 monclient: get_auth_request con 0x7fd85c03a280 auth_method 0 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 10 client.4582.objecter ms_handle_connect 0x7fd870135280 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 10 client.4582.objecter resend_mon_ops 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd86effd640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 0x7fd87009cb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd860007590 tx=0x7fd860007a50 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd860014a00 con 0x7fd870135280 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.719+0000 7fd857fff640 10 monclient: dump: 2024-03-27T21:30:28.737 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.738 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 10 client.4582.objecter ms_handle_connect 0x7fd85c03a280 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd86e7fc640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd85c03a280 0x7fd85c03c740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd87006f540 tx=0x7fd864008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.7 v2:172.21.15.63:3303/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd860014590 con 0x7fd870135280 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 msgr2=0x7fd87009cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 0x7fd87009cb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd860007590 tx=0x7fd860007a50 comp rx=0 tx=0).stop 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 msgr2=0x7fd87009cb60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.720+0000 7fd857fff640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd870135280 0x7fd87009cb60 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd860007590 tx=0x7fd860007a50 comp rx=0 tx=0).stop 2024-03-27T21:30:28.739 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd8759cb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd8759cb640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 0x7fd87012f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd8759cb640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd870073150 con 0x7fd87009d0a0 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 0x7fd87012f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient: get_auth_request con 0x7fd87009d0a0 auth_method 0 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.726+0000 7fd86effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd86effd640 10 monclient(hunting): handle_auth_done global_id 4507 payload 824 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd86effd640 1 -- 172.21.15.28:0/1515555568 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd870067350 con 0x7fd87009d0a0 2024-03-27T21:30:28.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 client.4582.objecter ms_handle_connect 0x7fd87009d0a0 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd86effd640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 0x7fd87012f890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd860019000 tx=0x7fd860004a40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 client.4582.objecter resend_mon_ops 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd860024070 con 0x7fd87009d0a0 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 monclient: dump: 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.741 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 <== mon.7 v2:172.21.15.63:3303/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9170 (secure 0 0 0) 0x7fd860015420 con 0x7fd87009d0a0 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 msgr2=0x7fd87012f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 0x7fd87012f890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd860019000 tx=0x7fd860004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:28.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 msgr2=0x7fd87012f890 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.727+0000 7fd857fff640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd87009d0a0 0x7fd87012f890 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd860019000 tx=0x7fd860004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "leader", 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 14, 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:30:28.743 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 19, 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.744 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.745 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:28.746 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:28.747 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:28.748 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.749 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.750 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.751 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:28.752 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.753 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:28.754 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.755 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:28.756 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.757 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:28.758 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.759 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.760 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.761 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:28.762 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:28.763 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 2 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:28.764 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:28.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 10 librados: watch_flush enter 2024-03-27T21:30:28.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 10 librados: watch_flush exit 2024-03-27T21:30:28.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 20 client.4582.objecter shutdown clearing up homeless session... 2024-03-27T21:30:28.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 10 client.4582.objecter successfully canceled tick 2024-03-27T21:30:28.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd85c03a280 msgr2=0x7fd85c03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.766 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd85c03a280 0x7fd85c03c740 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd87006f540 tx=0x7fd864008040 comp rx=0 tx=0).stop 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 10 monclient: shutdown 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd87009c200 msgr2=0x7fd87009c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd87009c200 0x7fd87009c620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd868033000 tx=0x7fd8680046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd86f7fe640 1 -- 172.21.15.28:0/1515555568 reap_dead start 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 shutdown_connections 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 --2- 172.21.15.28:0/1515555568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd87009c200 0x7fd87009c620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 >> 172.21.15.28:0/1515555568 conn(0x7fd8700a7810 msgr2=0x7fd870132210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 shutdown_connections 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 -- 172.21.15.28:0/1515555568 wait complete. 2024-03-27T21:30:28.767 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.728+0000 7fd8759cb640 1 librados: shutdown 2024-03-27T21:30:28.767 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:30:28.768 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a', 'c'] 2024-03-27T21:30:28.768 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-03-27T21:30:28.768 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-03-27T21:30:28.768 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2024-03-27T21:30:28.768 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2024-03-27T21:30:28.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.881+0000 7ffa681c5640 10 monclient: get_monmap_and_config 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.881+0000 7ffa681c5640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.881+0000 7ffa681c5640 10 monclient: monmap: 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:28.882553+0000 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:28.882553+0000 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.871 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 Processor -- start 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 -- start start 2024-03-27T21:30:28.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient: init 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient: _add_conns ranks=[6,3,2,5,8,10,1,7,9,4,0] 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 0x7ffa601370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): picked mon.noname-d con 0x7ffa60136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ffa600a3d70 0x7ffa60137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): picked mon.noname-g con 0x7ffa600a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): picked mon.noname-b con 0x7ffa601339e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600a25b0 con 0x7ffa601339e0 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60137b60 con 0x7ffa600a3d70 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600a13f0 con 0x7ffa60136d00 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.882+0000 7ffa681c5640 10 monclient(hunting): authenticate will time out at 851.189688s 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 0x7ffa601370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 0x7ffa601370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43564/0 (socket says 172.21.15.28:43564) 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 -- 172.21.15.28:0/1311881956 learned_addr learned my addr 172.21.15.28:0/1311881956 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): get_auth_request con 0x7ffa60136d00 auth_method 0 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): get_auth_request con 0x7ffa601339e0 auth_method 0 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65760640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ffa600a3d70 0x7ffa60137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65760640 10 monclient(hunting): get_auth_request con 0x7ffa600a3d70 auth_method 0 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65760640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65760640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65760640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient(hunting): handle_auth_done global_id 4461 payload 274 2024-03-27T21:30:28.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 -- 172.21.15.28:0/1311881956 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ffa600a3d70 msgr2=0x7ffa60137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ffa600a3d70 0x7ffa60137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 -- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 msgr2=0x7ffa60133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 monclient: found mon.noname-d 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa65f61640 1 -- 172.21.15.28:0/1311881956 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600618f0 con 0x7ffa60136d00 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.883+0000 7ffa66762640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa65f61640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 0x7ffa601370e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098a0 tx=0x7ffa5c02b7a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=a61baba6acd88934 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 1 -- 172.21.15.28:0/1311881956 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffa5c02f050 con 0x7ffa60136d00 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:28.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: dump: 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.886 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 1 -- 172.21.15.28:0/1311881956 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c031970 con 0x7ffa60136d00 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 5 monclient: authenticate success, global_id 4461 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 1 -- 172.21.15.28:0/1311881956 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffa5c032390 con 0x7ffa60136d00 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa64f5f640 10 monclient: dump: 2024-03-27T21:30:28.887 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 4 set_mon_vals no callback set 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 10 monclient: shutdown 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 -- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 msgr2=0x7ffa601370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 0x7ffa601370e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098a0 tx=0x7ffa5c02b7a0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 -- 172.21.15.28:0/1311881956 shutdown_connections 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ffa600a3d70 0x7ffa60137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 --2- 172.21.15.28:0/1311881956 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ffa60136d00 0x7ffa601370e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.884+0000 7ffa681c5640 1 -- 172.21.15.28:0/1311881956 >> 172.21.15.28:0/1311881956 conn(0x7ffa600a9430 msgr2=0x7ffa600a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 -- 172.21.15.28:0/1311881956 shutdown_connections 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 -- 172.21.15.28:0/1311881956 wait complete. 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 10 monclient: build_initial_monmap 2024-03-27T21:30:28.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 10 monclient: monmap: 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:28.890 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 librados: starting msgr at 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 librados: starting objecter 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 Processor -- start 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 -- start start 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 librados: setting wanted keys 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 1 librados: calling monclient init 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.885+0000 7ffa681c5640 10 monclient: init 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient: _add_conns ranks=[8,2,0,3,1,6,4,7,5] 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ffa600a3d70 0x7ffa601cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): picked mon.noname-e con 0x7ffa600a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): picked mon.noname-b con 0x7ffa601339e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:28.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa60136d00 0x7ffa6009c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): picked mon.noname-a con 0x7ffa60136d00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa601cba10 con 0x7ffa60136d00 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600a11e0 con 0x7ffa601339e0 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6011fdd0 con 0x7ffa600a3d70 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa681c5640 10 monclient(hunting): authenticate will time out at 851.193182s 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ffa600a3d70 0x7ffa601cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60132cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36654/0 (socket says 172.21.15.28:36654) 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 -- 172.21.15.28:0/3197983648 learned_addr learned my addr 172.21.15.28:0/3197983648 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:28.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): get_auth_request con 0x7ffa601339e0 auth_method 0 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): get_auth_request con 0x7ffa600a3d70 auth_method 0 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa60136d00 0x7ffa6009c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): get_auth_request con 0x7ffa60136d00 auth_method 0 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient(hunting): handle_auth_done global_id 4430 payload 824 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ffa600a3d70 msgr2=0x7ffa601cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ffa600a3d70 0x7ffa601cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa60136d00 msgr2=0x7ffa6009c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa60136d00 0x7ffa6009c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient: _finish_hunting 0 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 monclient: found mon.noname-b 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:28.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65760640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58009a70 con 0x7ffa601339e0 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa65f61640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ffa600a3d70 0x7ffa601cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.886+0000 7ffa66762640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa60136d00 0x7ffa6009c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa65760640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60132cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000d7d0 tx=0x7ffa5000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 client.?.objecter ms_handle_connect 0x7ffa601339e0 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffa50018070 con 0x7ffa601339e0 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: dump: 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.895 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:28.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000bb30 con 0x7ffa601339e0 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 5 monclient: authenticate success, global_id 4430 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 10 monclient: _renew_subs 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c0094d0 con 0x7ffa601339e0 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffa5000bca0 con 0x7ffa601339e0 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa57fff640 4 set_mon_vals no callback set 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 10 client.4430.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 10 monclient: dump: 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.897 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 10 monclient: _renew_subs 2024-03-27T21:30:28.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa60120390 con 0x7ffa601339e0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa681c5640 1 librados: init done 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.887+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7ffa5000b6c0 con 0x7ffa601339e0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa681c5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa681c5640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 0x7ffa6009cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60069c80 con 0x7ffa601331f0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ffa4403a250 0x7ffa4403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 0x7ffa6009cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7ffa50049ec0 con 0x7ffa601339e0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 client.4430.objecter ms_dispatch 0x7ffa60000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 3 client.4430.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 3 client.4430.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:28.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient: get_auth_request con 0x7ffa601331f0 auth_method 0 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 20 client.4430.objecter dump_active .. 0 homeless 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa66762640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ffa4403a250 0x7ffa4403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa66762640 10 monclient: get_auth_request con 0x7ffa4403a250 auth_method 0 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 10 monclient(hunting): handle_auth_done global_id 4617 payload 824 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa600a3020 con 0x7ffa601331f0 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 client.4430.objecter ms_handle_connect 0x7ffa601331f0 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 client.4430.objecter resend_mon_ops 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa65f61640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 0x7ffa6009cee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009870 tx=0x7ffa5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffa5c003c90 con 0x7ffa601331f0 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 monclient: dump: 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.901 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa567fc640 10 client.4430.objecter ms_handle_connect 0x7ffa4403a250 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.888+0000 7ffa66762640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ffa4403a250 0x7ffa4403c710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa6009eac0 tx=0x7ffa5800b040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.0 v2:172.21.15.28:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ffa5c003df0 con 0x7ffa601331f0 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 msgr2=0x7ffa6009cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 0x7ffa6009cee0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009870 tx=0x7ffa5c0046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 msgr2=0x7ffa6009cee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.889+0000 7ffa567fc640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa601331f0 0x7ffa6009cee0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009870 tx=0x7ffa5c0046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:28.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa681c5640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-03-27T21:30:28.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa681c5640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 0x7ffa600a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa681c5640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa60073150 con 0x7ffa6009d420 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 0x7ffa600a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient: get_auth_request con 0x7ffa6009d420 auth_method 0 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 10 monclient(hunting): handle_auth_done global_id 4626 payload 824 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 1 -- 172.21.15.28:0/3197983648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) v1 -- 0x7ffa600a2240 con 0x7ffa6009d420 2024-03-27T21:30:28.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa567fc640 10 client.4430.objecter ms_handle_connect 0x7ffa6009d420 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa567fc640 10 client.4430.objecter resend_mon_ops 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa65f61640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 0x7ffa600a7050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098a0 tx=0x7ffa5c031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ffa5c02f050 con 0x7ffa6009d420 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.896+0000 7ffa567fc640 10 monclient: dump: 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:28.906 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 <== mon.0 v2:172.21.15.28:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+83 (secure 0 0 0) 0x7ffa5c0488d0 con 0x7ffa6009d420 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 msgr2=0x7ffa600a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 0x7ffa600a7050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098a0 tx=0x7ffa5c031000 comp rx=0 tx=0).stop 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 msgr2=0x7ffa600a7050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:28.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa567fc640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffa6009d420 0x7ffa600a7050 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098a0 tx=0x7ffa5c031000 comp rx=0 tx=0).stop 2024-03-27T21:30:28.909 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:28.909 INFO:teuthology.orchestra.run.smithi028.stdout: "ret": 0, 2024-03-27T21:30:28.910 INFO:teuthology.orchestra.run.smithi028.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-03-27T21:30:28.910 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 10 librados: watch_flush enter 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 10 librados: watch_flush exit 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 20 client.4430.objecter shutdown clearing up homeless session... 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 10 client.4430.objecter successfully canceled tick 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ffa4403a250 msgr2=0x7ffa4403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ffa4403a250 0x7ffa4403c710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ffa6009eac0 tx=0x7ffa5800b040 comp rx=0 tx=0).stop 2024-03-27T21:30:28.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 10 monclient: shutdown 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 msgr2=0x7ffa60132cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 --2- 172.21.15.28:0/3197983648 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ffa601339e0 0x7ffa60132cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000d7d0 tx=0x7ffa5000dc90 comp rx=0 tx=0).stop 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa66762640 1 -- 172.21.15.28:0/3197983648 reap_dead start 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa66762640 1 -- 172.21.15.28:0/3197983648 reap_dead start 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 shutdown_connections 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 >> 172.21.15.28:0/3197983648 conn(0x7ffa600a9430 msgr2=0x7ffa600662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 shutdown_connections 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 -- 172.21.15.28:0/3197983648 wait complete. 2024-03-27T21:30:28.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:28.897+0000 7ffa681c5640 1 librados: shutdown 2024-03-27T21:30:28.913 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-27T21:30:28.914 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-27T21:30:28.914 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:30:28.924 INFO:tasks.ceph.mon.a:Stopped 2024-03-27T21:30:28.924 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-03-27T21:30:28.924 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c store 2024-03-27T21:30:28.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c sync_force --yes-i-really-mean-it 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.078+0000 7f22e1c10640 10 monclient: get_monmap_and_config 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.078+0000 7f22e1c10640 10 monclient: build_initial_monmap 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.078+0000 7f22e1c10640 10 monclient: monmap: 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:29.079121+0000 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:29.079121+0000 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.067 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:29.068 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 Processor -- start 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 -- start start 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient: init 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient: _add_conns ranks=[2,5,3,1,10,6,0,8,4,9,7] 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 0x7f22dc1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): picked mon.noname-b con 0x7f22dc136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc0a3d70 0x7f22dc137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): picked mon.noname-h con 0x7f22dc0a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f22dc1339e0 0x7f22dc133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): picked mon.noname-g con 0x7f22dc1339e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0a25b0 con 0x7f22dc136d00 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc137b60 con 0x7f22dc1339e0 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0a13f0 con 0x7f22dc0a3d70 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22e1c10640 10 monclient(hunting): authenticate will time out at 851.386261s 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 0x7f22dc1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 0x7f22dc1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36660/0 (socket says 172.21.15.28:36660) 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 -- 172.21.15.28:0/3230105356 learned_addr learned my addr 172.21.15.28:0/3230105356 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): get_auth_request con 0x7f22dc136d00 auth_method 0 2024-03-27T21:30:29.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22dbfff640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f22dc1339e0 0x7f22dc133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22daffd640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc0a3d70 0x7f22dc137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22daffd640 10 monclient(hunting): get_auth_request con 0x7f22dc0a3d70 auth_method 0 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22daffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22daffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22dbfff640 10 monclient(hunting): get_auth_request con 0x7f22dc1339e0 auth_method 0 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22dbfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient(hunting): handle_auth_done global_id 4439 payload 274 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 -- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc0a3d70 msgr2=0x7f22dc137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc0a3d70 0x7f22dc137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 -- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f22dc1339e0 msgr2=0x7f22dc133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f22dc1339e0 0x7f22dc133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 monclient: found mon.noname-b 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.079+0000 7f22db7fe640 1 -- 172.21.15.28:0/3230105356 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc0618f0 con 0x7f22dc136d00 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22db7fe640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 0x7f22dc1370e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098a0 tx=0x7f22cc02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=447be31d3108ca3a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 1 -- 172.21.15.28:0/3230105356 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22cc02f050 con 0x7f22dc136d00 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: dump: 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.083 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22e1c10640 5 monclient: authenticate success, global_id 4439 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 1 -- 172.21.15.28:0/3230105356 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc031970 con 0x7f22dc136d00 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22e1c10640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22e1c10640 4 set_mon_vals no callback set 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 1 -- 172.21.15.28:0/3230105356 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22cc032390 con 0x7f22dc136d00 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.080+0000 7f22da7fc640 10 monclient: dump: 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.084 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 10 monclient: shutdown 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 -- 172.21.15.28:0/3230105356 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 msgr2=0x7f22dc1370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 0x7f22dc1370e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098a0 tx=0x7f22cc02b7a0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 -- 172.21.15.28:0/3230105356 shutdown_connections 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f22dc1339e0 0x7f22dc133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc0a3d70 0x7f22dc137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 --2- 172.21.15.28:0/3230105356 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f22dc136d00 0x7f22dc1370e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 -- 172.21.15.28:0/3230105356 >> 172.21.15.28:0/3230105356 conn(0x7f22dc0a9430 msgr2=0x7f22dc0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 -- 172.21.15.28:0/3230105356 shutdown_connections 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 1 -- 172.21.15.28:0/3230105356 wait complete. 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 10 monclient: build_initial_monmap 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.081+0000 7f22e1c10640 10 monclient: monmap: 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:29.086 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 librados: starting msgr at 2024-03-27T21:30:29.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 librados: starting objecter 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 Processor -- start 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 -- start start 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 librados: setting wanted keys 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 librados: calling monclient init 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient: init 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient: _add_conns ranks=[1,5,6,4,8,0,2,3,7] 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc0a3d70 0x7f22dc1cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): picked mon.noname-f con 0x7f22dc0a3d70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc1339e0 0x7f22dc132a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): picked mon.noname-h con 0x7f22dc1339e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f22dc136d00 0x7f22dc132f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): picked mon.noname-d con 0x7f22dc136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc1cc420 con 0x7f22dc0a3d70 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc11f8a0 con 0x7f22dc1339e0 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0a1630 con 0x7f22dc136d00 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.082+0000 7f22e1c10640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 10 monclient(hunting): authenticate will time out at 851.389725s 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f22dc136d00 0x7f22dc132f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc1339e0 0x7f22dc132a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc0a3d70 0x7f22dc1cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f22dc136d00 0x7f22dc132f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43572/0 (socket says 172.21.15.28:43572) 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 -- 172.21.15.28:0/2099093415 learned_addr learned my addr 172.21.15.28:0/2099093415 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): get_auth_request con 0x7f22dc136d00 auth_method 0 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): get_auth_request con 0x7f22dc0a3d70 auth_method 0 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): get_auth_request con 0x7f22dc1339e0 auth_method 0 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient(hunting): handle_auth_done global_id 4470 payload 824 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc1339e0 msgr2=0x7f22dc132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f22dc1339e0 0x7f22dc132a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc0a3d70 msgr2=0x7f22dc1cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22dc0a3d70 0x7f22dc1cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 monclient: found mon.noname-d 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:29.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0094d0 con 0x7f22dc136d00 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22dbfff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f22dc136d00 0x7f22dc132f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22d4007d90 tx=0x7f22d400e4b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 client.?.objecter ms_handle_connect 0x7f22dc136d00 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22d400edd0 con 0x7f22dc136d00 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: dump: 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.092 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: _finish_auth 0 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 5 monclient: authenticate success, global_id 4470 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 10 monclient: _renew_subs 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4014890 con 0x7f22dc136d00 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:29.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc0a11e0 con 0x7f22dc136d00 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22d4014e70 con 0x7f22dc136d00 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 10 client.4470.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22d9ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22c3fff640 10 monclient: dump: 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.094 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 10 monclient: _renew_subs 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc1200e0 con 0x7f22dc136d00 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.083+0000 7f22e1c10640 1 librados: init done 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22e1c10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:29.095 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22e1c10640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 0x7f22dc09cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc069c80 con 0x7f22dc09c7d0 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f22d4014a00 con 0x7f22dc136d00 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 0x7f22dc09cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient: get_auth_request con 0x7f22dc09c7d0 auth_method 0 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22c3fff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f22c803a250 0x7f22c803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f22d404a800 con 0x7f22dc136d00 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22c3fff640 10 client.4470.objecter ms_dispatch 0x7f22dc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:29.096 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22c3fff640 3 client.4470.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.084+0000 7f22c3fff640 3 client.4470.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22db7fe640 10 monclient(hunting): handle_auth_done global_id 4432 payload 824 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22db7fe640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22dc0a3020 con 0x7f22dc09c7d0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 20 client.4470.objecter dump_active .. 0 homeless 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22daffd640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f22c803a250 0x7f22c803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22daffd640 10 monclient: get_auth_request con 0x7f22c803a250 auth_method 0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 client.4470.objecter ms_handle_connect 0x7f22dc09c7d0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22db7fe640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 0x7f22dc09cbb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009870 tx=0x7f22cc0046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 client.4470.objecter resend_mon_ops 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22cc004350 con 0x7f22dc09c7d0 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 monclient: dump: 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.097 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.098 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 client.4470.objecter ms_handle_connect 0x7f22c803a250 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22daffd640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f22c803a250 0x7f22c803c710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006fd0 tx=0x7f22d0008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.4 v2:172.21.15.28:3302/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f22cc0044b0 con 0x7f22dc09c7d0 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 msgr2=0x7f22dc09cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 0x7f22dc09cbb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009870 tx=0x7f22cc0046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 msgr2=0x7f22dc09cbb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:29.099 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.085+0000 7f22c3fff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09c7d0 0x7f22dc09cbb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22e1c10640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22e1c10640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 0x7f22dc0a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22e1c10640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc073150 con 0x7f22dc09d0f0 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 0x7f22dc0a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 10 monclient: get_auth_request con 0x7f22dc09d0f0 auth_method 0 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.092+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22db7fe640 10 monclient(hunting): handle_auth_done global_id 4441 payload 824 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22db7fe640 1 -- 172.21.15.28:0/2099093415 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) v1 -- 0x7f22dc0a2240 con 0x7f22dc09d0f0 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 client.4470.objecter ms_handle_connect 0x7f22dc09d0f0 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 client.4470.objecter resend_mon_ops 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22db7fe640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 0x7f22dc0a7290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f22cc000c00 tx=0x7f22cc031000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f22cc02f050 con 0x7f22dc09d0f0 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 monclient: dump: 2024-03-27T21:30:29.102 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.103 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 <== mon.4 v2:172.21.15.28:3302/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+83 (secure 0 0 0) 0x7f22cc048760 con 0x7f22dc09d0f0 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 msgr2=0x7f22dc0a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 0x7f22dc0a7290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f22cc000c00 tx=0x7f22cc031000 comp rx=0 tx=0).stop 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 msgr2=0x7f22dc0a7290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22c3fff640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f22dc09d0f0 0x7f22dc0a7290 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stdout: "ret": 0, 2024-03-27T21:30:29.104 INFO:teuthology.orchestra.run.smithi028.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-03-27T21:30:29.105 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22e1c10640 10 librados: watch_flush enter 2024-03-27T21:30:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22e1c10640 10 librados: watch_flush exit 2024-03-27T21:30:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22e1c10640 20 client.4470.objecter shutdown clearing up homeless session... 2024-03-27T21:30:29.106 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.093+0000 7f22e1c10640 10 client.4470.objecter successfully canceled tick 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f22c803a250 msgr2=0x7f22c803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f22c803a250 0x7f22c803c710 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006fd0 tx=0x7f22d0008040 comp rx=0 tx=0).stop 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 10 monclient: shutdown 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f22dc136d00 msgr2=0x7f22dc132f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 --2- 172.21.15.28:0/2099093415 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f22dc136d00 0x7f22dc132f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f22d4007d90 tx=0x7f22d400e4b0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22dbfff640 1 -- 172.21.15.28:0/2099093415 reap_dead start 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22dbfff640 1 -- 172.21.15.28:0/2099093415 reap_dead start 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 shutdown_connections 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 >> 172.21.15.28:0/2099093415 conn(0x7f22dc0a9430 msgr2=0x7f22dc135740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 shutdown_connections 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 -- 172.21.15.28:0/2099093415 wait complete. 2024-03-27T21:30:29.107 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.094+0000 7f22e1c10640 1 librados: shutdown 2024-03-27T21:30:29.108 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-27T21:30:29.108 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-27T21:30:29.108 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:30:29.118 INFO:tasks.ceph.mon.c:Stopped 2024-03-27T21:30:29.118 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-03-27T21:30:29.118 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.269+0000 7f59d56ea640 10 monclient: get_monmap_and_config 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.269+0000 7f59d56ea640 10 monclient: build_initial_monmap 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.269+0000 7f59d56ea640 10 monclient: monmap: 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:29.270059+0000 2024-03-27T21:30:29.258 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:29.270059+0000 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:29.259 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.269+0000 7f59d56ea640 1 Processor -- start 2024-03-27T21:30:29.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.269+0000 7f59d56ea640 1 -- start start 2024-03-27T21:30:29.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.269+0000 7f59d56ea640 10 monclient: init 2024-03-27T21:30:29.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:29.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient: _add_conns ranks=[5,1,6,3,4,0,10,9,7,2,8] 2024-03-27T21:30:29.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d0133ea0 0x7f59d0134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): picked mon.noname-h con 0x7f59d0133ea0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f59d00a3400 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 0x7f59d013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): picked mon.noname-d con 0x7f59d00a53e0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d00618f0 con 0x7f59d00a3400 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00a0b30 con 0x7f59d0133ea0 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00a2a20 con 0x7f59d00a53e0 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59d56ea640 10 monclient(hunting): authenticate will time out at 851.577051s 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 0x7f59d013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 0x7f59d013f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:43582/0 (socket says 172.21.15.28:43582) 2024-03-27T21:30:29.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3124966026 learned_addr learned my addr 172.21.15.28:0/3124966026 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): get_auth_request con 0x7f59d00a53e0 auth_method 0 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59ceffd640 1 --2- 172.21.15.28:0/3124966026 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d0133ea0 0x7f59d0134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_done global_id 4479 payload 274 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3124966026 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d0133ea0 msgr2=0x7f59d0134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 --2- 172.21.15.28:0/3124966026 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d0133ea0 0x7f59d0134280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3124966026 >> v1:172.21.15.63:6789/0 conn(0x7f59d00a3400 legacy=0x7f59d00a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:29.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 monclient: found mon.noname-d 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.270+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3124966026 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d00a2180 con 0x7f59d00a53e0 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cf7fe640 1 --2- 172.21.15.28:0/3124966026 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 0x7f59d013f0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59c80098a0 tx=0x7f59c802b7b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=f1280951b25b2f8f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 1 -- 172.21.15.28:0/3124966026 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59c8031980 con 0x7f59d00a53e0 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: dump: 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.272 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:29.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59d56ea640 5 monclient: authenticate success, global_id 4479 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59d56ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 1 -- 172.21.15.28:0/3124966026 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c802f050 con 0x7f59d00a53e0 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59d56ea640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59d56ea640 4 set_mon_vals no callback set 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 1 -- 172.21.15.28:0/3124966026 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59c80323a0 con 0x7f59d00a53e0 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.271+0000 7f59cdffb640 10 monclient: dump: 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.274 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 10 monclient: shutdown 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 -- 172.21.15.28:0/3124966026 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 msgr2=0x7f59d013f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3124966026 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 0x7f59d013f0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59c80098a0 tx=0x7f59c802b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 -- 172.21.15.28:0/3124966026 shutdown_connections 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3124966026 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f59d00a53e0 0x7f59d013f0b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3124966026 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d0133ea0 0x7f59d0134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 -- 172.21.15.28:0/3124966026 >> 172.21.15.28:0/3124966026 conn(0x7f59d00a98f0 msgr2=0x7f59d00a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 -- 172.21.15.28:0/3124966026 shutdown_connections 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 -- 172.21.15.28:0/3124966026 wait complete. 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 10 monclient: build_initial_monmap 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 10 monclient: monmap: 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:29.276 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 librados: starting msgr at 2024-03-27T21:30:29.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.272+0000 7f59d56ea640 1 librados: starting objecter 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 Processor -- start 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 -- start start 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 librados: setting wanted keys 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 librados: calling monclient init 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient: init 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient: _add_conns ranks=[5,4,2,3,8,1,0,6,7] 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d00a3400 0x7f59d01cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): picked mon.noname-h con 0x7f59d00a3400 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f59d00a53e0 0x7f59d0132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): picked mon.noname-c con 0x7f59d00a53e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 0x7f59d01332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): picked mon.noname-b con 0x7f59d0133ea0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d011fec0 con 0x7f59d0133ea0 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00a1400 con 0x7f59d00a53e0 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59d0133820 con 0x7f59d00a3400 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59d56ea640 10 monclient(hunting): authenticate will time out at 851.580427s 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59ce7fc640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f59d00a53e0 msgr2=0x7f59d0132da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59ce7fc640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f59d00a53e0 0x7f59d0132da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 0x7f59d01332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 0x7f59d01332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:36670/0 (socket says 172.21.15.28:36670) 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3414891462 learned_addr learned my addr 172.21.15.28:0/3414891462 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): get_auth_request con 0x7f59d0133ea0 auth_method 0 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.273+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59ceffd640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d00a3400 0x7f59d01cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 10 monclient(hunting): handle_auth_done global_id 4448 payload 824 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d00a3400 msgr2=0x7f59d01cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d00a3400 0x7f59d01cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f59d00a53e0 msgr2=0x7f59d0132da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:29.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f59d00a53e0 0x7f59d0132da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 monclient: found mon.noname-b 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 -- 172.21.15.28:0/3414891462 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80094d0 con 0x7f59d0133ea0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59ceffd640 10 monclient: get_auth_request con 0x7f59d00a3400 auth_method 0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59ceffd640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d00a3400 0x7f59d01cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cf7fe640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 0x7f59d01332e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097c0 tx=0x7f59c80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 client.?.objecter ms_handle_connect 0x7f59d0133ea0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59c8031980 con 0x7f59d0133ea0 2024-03-27T21:30:29.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: dump: 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.282 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8031ae0 con 0x7f59d0133ea0 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 5 monclient: authenticate success, global_id 4448 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 10 monclient: _renew_subs 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00a1830 con 0x7f59d0133ea0 2024-03-27T21:30:29.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f59c8031c50 con 0x7f59d0133ea0 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 10 client.4448.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59b77fe640 10 monclient: dump: 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:29.284 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 10 monclient: _renew_subs 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59cd7fa640 4 set_mon_vals no callback set 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d009e550 con 0x7f59d0133ea0 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.274+0000 7f59d56ea640 1 librados: init done 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f59c803a040 con 0x7f59d0133ea0 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59d56ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:29.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59d56ea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59d56ea640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d0067320 con 0x7f59d0133ea0 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a250 0x7f59bc03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f59c806bd10 con 0x7f59d0133ea0 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 10 client.4448.objecter ms_dispatch 0x7f59d0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 3 client.4448.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 3 client.4448.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:29.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59b77fe640 20 client.4448.objecter dump_active .. 0 homeless 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59ceffd640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a250 0x7f59bc03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.275+0000 7f59ceffd640 10 monclient: get_auth_request con 0x7f59bc03a250 auth_method 0 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.276+0000 7f59b77fe640 10 client.4448.objecter ms_handle_connect 0x7f59bc03a250 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.276+0000 7f59ceffd640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a250 0x7f59bc03c710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59c0007eb0 tx=0x7f59c0007400 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.280+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f59c8032d30 con 0x7f59d0133ea0 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.280+0000 7f59b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:29.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.280+0000 7f59b77fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59d56ea640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59d56ea640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59d56ea640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f59d0135fb0 con 0x7f59d0133ea0 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59b77fe640 1 -- 172.21.15.28:0/3414891462 <== mon.2 v2:172.21.15.28:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3160 (secure 0 0 0) 0x7f59c8038020 con 0x7f59d0133ea0 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:29.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.528+0000 7f59b77fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:29.518 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:30:29.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 10 librados: watch_flush enter 2024-03-27T21:30:29.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 10 librados: watch_flush exit 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 20 client.4448.objecter shutdown clearing up homeless session... 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 10 client.4448.objecter successfully canceled tick 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a250 msgr2=0x7f59bc03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a250 0x7f59bc03c710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f59c0007eb0 tx=0x7f59c0007400 comp rx=0 tx=0).stop 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 10 monclient: shutdown 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 msgr2=0x7f59d01332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 0x7f59d01332e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59c80097c0 tx=0x7f59c80046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 shutdown_connections 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f59bc03a250 0x7f59bc03c710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f59d0133ea0 0x7f59d01332e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f59d00a53e0 0x7f59d0132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 --2- 172.21.15.28:0/3414891462 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f59d00a3400 0x7f59d01cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:29.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 >> 172.21.15.28:0/3414891462 conn(0x7f59d00a98f0 msgr2=0x7f59d01bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:29.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 shutdown_connections 2024-03-27T21:30:29.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 -- 172.21.15.28:0/3414891462 wait complete. 2024-03-27T21:30:29.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:29.530+0000 7f59d56ea640 1 librados: shutdown 2024-03-27T21:30:32.531 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.653+0000 7f87bac2f640 10 monclient: get_monmap_and_config 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.653+0000 7f87bac2f640 10 monclient: build_initial_monmap 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.653+0000 7f87bac2f640 10 monclient: monmap: 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:32.654728+0000 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:32.654728+0000 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:32.655 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.654+0000 7f87bac2f640 1 Processor -- start 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.654+0000 7f87bac2f640 1 -- start start 2024-03-27T21:30:32.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.654+0000 7f87bac2f640 10 monclient: init 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient: _add_conns ranks=[4,6,5,2,10,8,7,1,0,3,9] 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b4133ea0 0x7f87b4134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): picked mon.noname-c con 0x7f87b4133ea0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 0x7f87b40a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): picked mon.noname-d con 0x7f87b40a3400 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a5210 0x7f87b40a5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): picked mon.noname-h con 0x7f87b40a5210 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40a0b30 con 0x7f87b4133ea0 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40a2a20 con 0x7f87b40a5210 2024-03-27T21:30:32.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40a2180 con 0x7f87b40a3400 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87bac2f640 10 monclient(hunting): authenticate will time out at 854.961932s 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b89cb640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b4133ea0 msgr2=0x7f87b4134280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b89cb640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b4133ea0 0x7f87b4134280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 0x7f87b40a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 0x7f87b40a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:40056/0 (socket says 172.21.15.28:40056) 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 -- 172.21.15.28:0/676336932 learned_addr learned my addr 172.21.15.28:0/676336932 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): get_auth_request con 0x7f87b40a3400 auth_method 0 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:32.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a5210 0x7f87b40a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): get_auth_request con 0x7f87b40a5210 auth_method 0 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b91cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:32.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient(hunting): handle_auth_done global_id 4488 payload 274 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 -- 172.21.15.28:0/676336932 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a5210 msgr2=0x7f87b40a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a5210 0x7f87b40a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 -- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b4133ea0 msgr2=0x7f87b4134280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b4133ea0 0x7f87b4134280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 monclient: found mon.noname-d 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.655+0000 7f87b3fff640 1 -- 172.21.15.28:0/676336932 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b40618f0 con 0x7f87b40a3400 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b3fff640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 0x7f87b40a4cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87a80098a0 tx=0x7f87a802b7c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1d7898d13b0fc0f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 1 -- 172.21.15.28:0/676336932 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f87a8031990 con 0x7f87b40a3400 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:32.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: dump: 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:32.661 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 1 -- 172.21.15.28:0/676336932 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8031b10 con 0x7f87b40a3400 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87bac2f640 5 monclient: authenticate success, global_id 4488 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87bac2f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87bac2f640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 1 -- 172.21.15.28:0/676336932 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f87a8031cc0 con 0x7f87b40a3400 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87bac2f640 4 set_mon_vals no callback set 2024-03-27T21:30:32.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.656+0000 7f87b37fe640 10 monclient: dump: 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:32.663 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 10 monclient: shutdown 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 -- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 msgr2=0x7f87b40a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 0x7f87b40a4cd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f87a80098a0 tx=0x7f87a802b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 -- 172.21.15.28:0/676336932 shutdown_connections 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a5210 0x7f87b40a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f87b40a3400 0x7f87b40a4cd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 --2- 172.21.15.28:0/676336932 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b4133ea0 0x7f87b4134280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 -- 172.21.15.28:0/676336932 >> 172.21.15.28:0/676336932 conn(0x7f87b40a98f0 msgr2=0x7f87b40a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 -- 172.21.15.28:0/676336932 shutdown_connections 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 1 -- 172.21.15.28:0/676336932 wait complete. 2024-03-27T21:30:32.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 10 monclient: build_initial_monmap 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.657+0000 7f87bac2f640 10 monclient: monmap: 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:32.665 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 librados: starting msgr at 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 librados: starting objecter 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 Processor -- start 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 -- start start 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 librados: setting wanted keys 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 librados: calling monclient init 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient: init 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient: _add_conns ranks=[5,4,0,7,6,1,3,2,8] 2024-03-27T21:30:32.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 0x7f87b4132c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): picked mon.noname-h con 0x7f87b40a3400 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b40a5210 0x7f87b4133180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): picked mon.noname-c con 0x7f87b40a5210 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87b4133ea0 0x7f87b409c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): picked mon.noname-a con 0x7f87b4133ea0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b41cc230 con 0x7f87b4133ea0 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b40a1400 con 0x7f87b40a5210 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87b409e350 con 0x7f87b40a3400 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87bac2f640 10 monclient(hunting): authenticate will time out at 854.965671s 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87b3fff640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b40a5210 msgr2=0x7f87b4133180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:32.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87b3fff640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b40a5210 0x7f87b4133180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.658+0000 7f87b91cc640 1 -- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87b4133ea0 msgr2=0x7f87b409c870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b91cc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87b4133ea0 0x7f87b409c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 0x7f87b4132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 0x7f87b4132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.28:35120/0 (socket says 172.21.15.28:35120) 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 -- 172.21.15.28:0/1370596369 learned_addr learned my addr 172.21.15.28:0/1370596369 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): get_auth_request con 0x7f87b40a3400 auth_method 0 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient(hunting): handle_auth_done global_id 4433 payload 824 2024-03-27T21:30:32.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 -- 172.21.15.28:0/1370596369 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b40a5210 msgr2=0x7f87b4133180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b40a5210 0x7f87b4133180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 -- 172.21.15.28:0/1370596369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87b4133ea0 msgr2=0x7f87b409c870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87b4133ea0 0x7f87b409c870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient: _finish_hunting 0 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 monclient: found mon.noname-h 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 -- 172.21.15.28:0/1370596369 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80094d0 con 0x7f87b40a3400 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b89cb640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 0x7f87b4132c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b550 tx=0x7f87a400ba10 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 client.?.objecter ms_handle_connect 0x7f87b40a3400 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f87a4003bc0 con 0x7f87b40a3400 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:32.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: dump: 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:32.670 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: _finish_auth 0 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: _check_auth_tickets 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a4003d80 con 0x7f87b40a3400 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f87a4010480 con 0x7f87b40a3400 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 5 monclient: authenticate success, global_id 4433 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b2ffd640 4 set_mon_vals no callback set 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87b17fa640 10 monclient: dump: 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:32.671 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:32.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 10 monclient: _renew_subs 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b4120040 con 0x7f87b40a3400 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 10 monclient: _renew_subs 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b409f140 con 0x7f87b40a3400 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.659+0000 7f87bac2f640 1 librados: init done 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f87a4005070 con 0x7f87b40a3400 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87bac2f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87bac2f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87bac2f640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b40a18a0 con 0x7f87b40a3400 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87b17fa640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f87a003a250 0x7f87a003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:32.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f87a4049c80 con 0x7f87b40a3400 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87b17fa640 10 client.4433.objecter ms_dispatch 0x7f87b4000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87b17fa640 3 client.4433.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.660+0000 7f87b17fa640 3 client.4433.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.661+0000 7f87b17fa640 20 client.4433.objecter dump_active .. 0 homeless 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.661+0000 7f87b3fff640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f87a003a250 0x7f87a003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.661+0000 7f87b3fff640 10 monclient: get_auth_request con 0x7f87a003a250 auth_method 0 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.661+0000 7f87b17fa640 10 client.4433.objecter ms_handle_connect 0x7f87a003a250 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.661+0000 7f87b3fff640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f87a003a250 0x7f87a003c710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87a8035000 tx=0x7f87a8030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.665+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f87b40a18a0 con 0x7f87b40a3400 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.665+0000 7f87b17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:32.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.665+0000 7f87b17fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87bac2f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87bac2f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87bac2f640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f87b40a18a0 con 0x7f87b40a3400 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87b17fa640 1 -- 172.21.15.28:0/1370596369 <== mon.5 v2:172.21.15.63:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3160 (secure 0 0 0) 0x7f87b40a18a0 con 0x7f87b40a3400 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87b17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.913+0000 7f87b17fa640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:32.902 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":23,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:30:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 10 librados: watch_flush enter 2024-03-27T21:30:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 10 librados: watch_flush exit 2024-03-27T21:30:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 20 client.4433.objecter shutdown clearing up homeless session... 2024-03-27T21:30:32.904 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 10 client.4433.objecter successfully canceled tick 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f87a003a250 msgr2=0x7f87a003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f87a003a250 0x7f87a003c710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87a8035000 tx=0x7f87a8030000 comp rx=0 tx=0).stop 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 10 monclient: shutdown 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 msgr2=0x7f87b4132c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 0x7f87b4132c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b550 tx=0x7f87a400ba10 comp rx=0 tx=0).stop 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 shutdown_connections 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f87a003a250 0x7f87a003c710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f87b4133ea0 0x7f87b409c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f87b40a5210 0x7f87b4133180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 --2- 172.21.15.28:0/1370596369 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f87b40a3400 0x7f87b4132c40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 >> 172.21.15.28:0/1370596369 conn(0x7f87b40a98f0 msgr2=0x7f87b40a75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 shutdown_connections 2024-03-27T21:30:32.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 -- 172.21.15.28:0/1370596369 wait complete. 2024-03-27T21:30:32.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:32.915+0000 7f87bac2f640 1 librados: shutdown 2024-03-27T21:30:35.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:30:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.038+0000 7f6e6c927640 10 monclient: get_monmap_and_config 2024-03-27T21:30:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.038+0000 7f6e6c927640 10 monclient: build_initial_monmap 2024-03-27T21:30:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.038+0000 7f6e6c927640 10 monclient: monmap: 2024-03-27T21:30:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:36.040 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:36.039428+0000 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:36.039428+0000 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:36.041 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 Processor -- start 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 -- start start 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient: init 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient: _add_conns ranks=[6,8,10,4,3,5,0,2,1,9,7] 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 0x7f6e68134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): picked mon.noname-d con 0x7f6e68133ea0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 0x7f6e680a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): picked mon.noname-e con 0x7f6e680a3400 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6e680a5210 0x7f6e680a5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): picked mon.noname-f con 0x7f6e680a5210 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:36.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680a0b30 con 0x7f6e680a5210 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680a2a20 con 0x7f6e68133ea0 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680a2180 con 0x7f6e680a3400 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.039+0000 7f6e6c927640 10 monclient(hunting): authenticate will time out at 858.346676s 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 0x7f6e680a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 0x7f6e68134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 0x7f6e68134280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:40060/0 (socket says 172.21.15.28:40060) 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 0x7f6e680a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:55446/0 (socket says 172.21.15.28:55446) 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 -- 172.21.15.28:0/2448609184 learned_addr learned my addr 172.21.15.28:0/2448609184 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): get_auth_request con 0x7f6e68133ea0 auth_method 0 2024-03-27T21:30:36.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): get_auth_request con 0x7f6e680a3400 auth_method 0 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 1 --2- 172.21.15.28:0/2448609184 >> v2:172.21.15.63:3300/0 conn(0x7f6e680a5210 0x7f6e680a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): get_auth_request con 0x7f6e680a5210 auth_method 0 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:36.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient(hunting): handle_auth_done global_id 4497 payload 274 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 -- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 msgr2=0x7f6e680a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 --2- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 0x7f6e680a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 -- 172.21.15.28:0/2448609184 >> v2:172.21.15.63:3300/0 conn(0x7f6e680a5210 msgr2=0x7f6e680a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 --2- 172.21.15.28:0/2448609184 >> v2:172.21.15.63:3300/0 conn(0x7f6e680a5210 0x7f6e680a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 monclient: found mon.noname-d 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:36.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e6659c640 1 -- 172.21.15.28:0/2448609184 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680618f0 con 0x7f6e68133ea0 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.040+0000 7f6e5ffff640 1 --2- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 0x7f6e680a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6659c640 1 --2- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 0x7f6e68134280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009870 tx=0x7f6e5802b7c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fdfd6a5518ae53e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 1 -- 172.21.15.28:0/2448609184 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6e58031990 con 0x7f6e68133ea0 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: dump: 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.046 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: _finish_auth 0 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:36.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 5 monclient: authenticate success, global_id 4497 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 1 -- 172.21.15.28:0/2448609184 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e58031b10 con 0x7f6e68133ea0 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 4 set_mon_vals no callback set 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 1 -- 172.21.15.28:0/2448609184 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6e58031cc0 con 0x7f6e68133ea0 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e65d9b640 10 monclient: dump: 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:36.048 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 10 monclient: shutdown 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 1 -- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 msgr2=0x7f6e68134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.041+0000 7f6e6c927640 1 --2- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 0x7f6e68134280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009870 tx=0x7f6e5802b7c0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 -- 172.21.15.28:0/2448609184 shutdown_connections 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 --2- 172.21.15.28:0/2448609184 >> v2:172.21.15.63:3300/0 conn(0x7f6e680a5210 0x7f6e680a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 --2- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f6e680a3400 0x7f6e680a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 --2- 172.21.15.28:0/2448609184 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f6e68133ea0 0x7f6e68134280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 -- 172.21.15.28:0/2448609184 >> 172.21.15.28:0/2448609184 conn(0x7f6e680a98f0 msgr2=0x7f6e680a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 -- 172.21.15.28:0/2448609184 shutdown_connections 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 1 -- 172.21.15.28:0/2448609184 wait complete. 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 10 monclient: build_initial_monmap 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.042+0000 7f6e6c927640 10 monclient: monmap: 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:36.050 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 librados: starting msgr at 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 librados: starting objecter 2024-03-27T21:30:36.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 Processor -- start 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 -- start start 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 librados: setting wanted keys 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 librados: calling monclient init 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient: init 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient: _add_conns ranks=[3,0,5,2,4,7,6,8,1] 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 0x7f6e68132700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): picked mon.noname-g con 0x7f6e680a3400 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e680a5210 0x7f6e68132c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): picked mon.noname-a con 0x7f6e680a5210 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f6e68133ea0 0x7f6e6809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): picked mon.noname-h con 0x7f6e68133ea0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:36.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68133570 con 0x7f6e680a5210 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6809ef70 con 0x7f6e680a3400 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680a1830 con 0x7f6e68133ea0 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6c927640 10 monclient(hunting): authenticate will time out at 858.350368s 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e5ffff640 1 -- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e680a5210 msgr2=0x7f6e68132c40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e5ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e680a5210 0x7f6e68132c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 0x7f6e68132700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 0x7f6e68132700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.28:58818/0 (socket says 172.21.15.28:58818) 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f6e68133ea0 0x7f6e6809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 1 -- 172.21.15.28:0/3720247610 learned_addr learned my addr 172.21.15.28:0/3720247610 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:36.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): get_auth_request con 0x7f6e680a3400 auth_method 0 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): get_auth_request con 0x7f6e68133ea0 auth_method 0 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e6659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:36.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.043+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 10 monclient(hunting): handle_auth_done global_id 4442 payload 824 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 -- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 msgr2=0x7f6e68132700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 0x7f6e68132700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 -- 172.21.15.28:0/3720247610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e680a5210 msgr2=0x7f6e68132c40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e680a5210 0x7f6e68132c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 monclient: found mon.noname-h 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 -- 172.21.15.28:0/3720247610 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e50009400 con 0x7f6e68133ea0 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6659c640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 0x7f6e68132700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e66d9d640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f6e68133ea0 0x7f6e6809ca20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000efc0 tx=0x7f6e6000c490 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 client.?.objecter ms_handle_connect 0x7f6e68133ea0 2024-03-27T21:30:36.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6e60009c00 con 0x7f6e68133ea0 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: dump: 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:36.056 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: _finish_auth 0 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6000f040 con 0x7f6e68133ea0 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 5 monclient: authenticate success, global_id 4442 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f6e60014d60 con 0x7f6e68133ea0 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 10 monclient: _renew_subs 2024-03-27T21:30:36.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580094d0 con 0x7f6e68133ea0 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6559a640 4 set_mon_vals no callback set 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e5effd640 10 monclient: dump: 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:36.058 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 10 client.4442.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 10 monclient: _renew_subs 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6811fe00 con 0x7f6e68133ea0 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.044+0000 7f6e6c927640 1 librados: init done 2024-03-27T21:30:36.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f6e6000cd30 con 0x7f6e68133ea0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e6c927640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e6c927640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e6c927640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680a1460 con 0x7f6e68133ea0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6e4803a180 0x7f6e4803c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f6e6004ad50 con 0x7f6e68133ea0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 10 client.4442.objecter ms_dispatch 0x7f6e68000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 3 client.4442.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 3 client.4442.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e5effd640 20 client.4442.objecter dump_active .. 0 homeless 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e6659c640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6e4803a180 0x7f6e4803c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.045+0000 7f6e6659c640 10 monclient: get_auth_request con 0x7f6e4803a180 auth_method 0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.046+0000 7f6e5effd640 10 client.4442.objecter ms_handle_connect 0x7f6e4803a180 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.046+0000 7f6e6659c640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6e4803a180 0x7f6e4803c640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e58000c00 tx=0x7f6e58030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:36.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.050+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f6e60007920 con 0x7f6e68133ea0 2024-03-27T21:30:36.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.050+0000 7f6e5effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:36.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.050+0000 7f6e5effd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.300+0000 7f6e6c927640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:30:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.300+0000 7f6e6c927640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.300+0000 7f6e6c927640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:36.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.300+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f6e68067320 con 0x7f6e68133ea0 2024-03-27T21:30:36.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.301+0000 7f6e5effd640 1 -- 172.21.15.28:0/3720247610 <== mon.5 v2:172.21.15.63:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3160 (secure 0 0 0) 0x7f6e60018070 con 0x7f6e68133ea0 2024-03-27T21:30:36.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.301+0000 7f6e5effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:36.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.301+0000 7f6e5effd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:36.290 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"i","quorum_age":26,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 10 librados: watch_flush enter 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 10 librados: watch_flush exit 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 20 client.4442.objecter shutdown clearing up homeless session... 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 10 client.4442.objecter successfully canceled tick 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6e4803a180 msgr2=0x7f6e4803c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6e4803a180 0x7f6e4803c640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e58000c00 tx=0x7f6e58030000 comp rx=0 tx=0).stop 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 10 monclient: shutdown 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f6e68133ea0 msgr2=0x7f6e6809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f6e68133ea0 0x7f6e6809ca20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6e6000efc0 tx=0x7f6e6000c490 comp rx=0 tx=0).stop 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 shutdown_connections 2024-03-27T21:30:36.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f6e4803a180 0x7f6e4803c640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f6e68133ea0 0x7f6e6809ca20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6e680a5210 0x7f6e68132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 --2- 172.21.15.28:0/3720247610 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f6e680a3400 0x7f6e68132700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 >> 172.21.15.28:0/3720247610 conn(0x7f6e680a98f0 msgr2=0x7f6e68135330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 shutdown_connections 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 -- 172.21.15.28:0/3720247610 wait complete. 2024-03-27T21:30:36.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:36.302+0000 7f6e6c927640 1 librados: shutdown 2024-03-27T21:30:39.303 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.426+0000 7f8829727640 10 monclient: get_monmap_and_config 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.426+0000 7f8829727640 10 monclient: build_initial_monmap 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.426+0000 7f8829727640 10 monclient: monmap: 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:39.427281+0000 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:39.427281+0000 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:39.415 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:39.416 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:39.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 1 Processor -- start 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 1 -- start start 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient: init 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient: _add_conns ranks=[0,1,4,7,9,3,2,6,5,8,10] 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f882409bc50 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f882409c700 addr v1:172.21.15.63:6789/0 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 0x7f882413cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient(hunting): picked mon.noname-c con 0x7f882413a820 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88240618f0 con 0x7f882409bc50 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882409fb70 con 0x7f882409c700 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f882409e330 con 0x7f882413a820 2024-03-27T21:30:39.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8829727640 10 monclient(hunting): authenticate will time out at 861.734518s 2024-03-27T21:30:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f8822ffd640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7f882409bc50 legacy=0x7f882409d510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f88237fe640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 msgr2=0x7f882413cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.427+0000 7f88237fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 0x7f882413cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.428+0000 7f881bfff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f882409c700 0x7f882409dc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.28:50092/0 (socket says 172.21.15.28:50092) 2024-03-27T21:30:39.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.428+0000 7f881bfff640 1 -- 172.21.15.28:0/2932580901 learned_addr learned my addr 172.21.15.28:0/2932580901 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:30:39.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.628+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 msgr2=0x7f882413cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:39.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.628+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> v1:172.21.15.28:6789/0 conn(0x7f882409bc50 legacy=0x7f882409d510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:39.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:39.628+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 0x7f882413cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:40.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:40.029+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> v1:172.21.15.28:6789/0 conn(0x7f882409bc50 legacy=0x7f882409d510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:40.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:40.029+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 msgr2=0x7f882413cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:40.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:40.029+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 0x7f882413cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:40.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:40.830+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> v1:172.21.15.28:6789/0 conn(0x7f882409bc50 legacy=0x7f882409d510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:40.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:40.830+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 msgr2=0x7f882413cc10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:40.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:40.830+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 0x7f882413cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): tick 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): _check_auth_tickets 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 monclient(hunting): continuing hunt 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): _reopen_session rank -1 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 msgr2=0x7f882413cc10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f882413a820 0x7f882413cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 -- 172.21.15.28:0/2932580901 >> v1:172.21.15.63:6789/0 conn(0x7f882409c700 legacy=0x7f882409dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 -- 172.21.15.28:0/2932580901 >> v1:172.21.15.28:6789/0 conn(0x7f882409bc50 legacy=0x7f882409d510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient: _add_conns ranks=[7,9,3,5,6,10,8,2] 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:42.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): picked mon.noname-i con 0x7f8804005a20 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 --2- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 0x7f880400a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): picked mon.noname-a con 0x7f88040084a0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): picked mon.noname-g con 0x7f880400afe0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 -- 172.21.15.28:0/2932580901 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f882409e330 con 0x7f88040084a0 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 -- 172.21.15.28:0/2932580901 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880400dba0 con 0x7f880400afe0 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 1 -- 172.21.15.28:0/2932580901 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f880400dd30 con 0x7f8804005a20 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88217fa640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f881bfff640 1 -- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 msgr2=0x7f880400a930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f881bfff640 1 --2- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 0x7f880400a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:42.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 10 monclient(hunting): get_auth_request con 0x7f8804005a20 auth_method 0 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 10 monclient(hunting): get_auth_request con 0x7f880400afe0 auth_method 0 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 msgr2=0x7f8804007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 msgr2=0x7f8804007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:42.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 msgr2=0x7f880400d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T21:30:42.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 msgr2=0x7f880400d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:42.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:42.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:42.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.428+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f881bfff640 1 -- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 msgr2=0x7f880400a930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f881bfff640 1 --2- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 0x7f880400a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 10 monclient(hunting): get_auth_request con 0x7f8804005a20 auth_method 0 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 10 monclient(hunting): get_auth_request con 0x7f880400afe0 auth_method 0 2024-03-27T21:30:42.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 msgr2=0x7f8804007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 msgr2=0x7f880400d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 msgr2=0x7f8804007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 msgr2=0x7f880400d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:42.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:42.629+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:30:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f881bfff640 1 -- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 msgr2=0x7f880400a930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f881bfff640 1 --2- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 0x7f880400a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:30:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): get_auth_request con 0x7f8804005a20 auth_method 0 2024-03-27T21:30:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): get_auth_request con 0x7f880400afe0 auth_method 0 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient(hunting): handle_auth_done global_id 4516 payload 274 2024-03-27T21:30:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 msgr2=0x7f880400d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 msgr2=0x7f880400a930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> v2:172.21.15.28:3300/0 conn(0x7f88040084a0 0x7f880400a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 monclient: found mon.noname-i 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f8822ffd640 1 -- 172.21.15.28:0/2932580901 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882409c030 con 0x7f8804005a20 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f880400afe0 0x7f880400d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.030+0000 7f88237fe640 1 -- 172.21.15.28:0/2932580901 reap_dead start 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8814003980 tx=0x7f881402c840 comp rx=0 tx=0).ready entity=mon.7 client_cookie=1c784514461dd448 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 1 -- 172.21.15.28:0/2932580901 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f881402f070 con 0x7f8804005a20 2024-03-27T21:30:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: dump: 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 1 -- 172.21.15.28:0/2932580901 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814035870 con 0x7f8804005a20 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f8829727640 5 monclient: authenticate success, global_id 4516 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f8829727640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f8829727640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 1 -- 172.21.15.28:0/2932580901 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8814035e50 con 0x7f8804005a20 2024-03-27T21:30:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f8829727640 4 set_mon_vals no callback set 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.031+0000 7f88227fc640 10 monclient: dump: 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 10 monclient: shutdown 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 -- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 msgr2=0x7f8804007e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8814003980 tx=0x7f881402c840 comp rx=0 tx=0).stop 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 -- 172.21.15.28:0/2932580901 shutdown_connections 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 --2- 172.21.15.28:0/2932580901 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f8804005a20 0x7f8804007e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 -- 172.21.15.28:0/2932580901 >> 172.21.15.28:0/2932580901 conn(0x7f88240a3140 msgr2=0x7f88240a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 -- 172.21.15.28:0/2932580901 shutdown_connections 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.032+0000 7f8829727640 1 -- 172.21.15.28:0/2932580901 wait complete. 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 10 monclient: monmap: 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 1 librados: starting msgr at 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 1 librados: starting objecter 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 1 Processor -- start 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 1 -- start start 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 1 librados: setting wanted keys 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 1 librados: calling monclient init 2024-03-27T21:30:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.033+0000 7f8829727640 10 monclient: init 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient: _add_conns ranks=[1,3,8,7,6,5,0,2,4] 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8804005a20 0x7f882412d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): picked mon.noname-f con 0x7f8804005a20 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f882412dec0 0x7f882412e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): picked mon.noname-g con 0x7f882412dec0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f882412c760 0x7f882412cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): picked mon.noname-e con 0x7f882412c760 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882412e840 con 0x7f8804005a20 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824130020 con 0x7f882412dec0 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f8824070ef0 con 0x7f882412c760 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8829727640 10 monclient(hunting): authenticate will time out at 865.341103s 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f882412c760 0x7f882412cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8804005a20 0x7f882412d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f882412dec0 0x7f882412e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f882412c760 0x7f882412cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:41426/0 (socket says 172.21.15.28:41426) 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): get_auth_request con 0x7f8804005a20 auth_method 0 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 1 -- 172.21.15.28:0/2783761317 learned_addr learned my addr 172.21.15.28:0/2783761317 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): get_auth_request con 0x7f882412dec0 auth_method 0 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): get_auth_request con 0x7f882412c760 auth_method 0 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f881bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f88237fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient(hunting): handle_auth_done global_id 4609 payload 824 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 -- 172.21.15.28:0/2783761317 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f882412c760 msgr2=0x7f882412cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f882412c760 0x7f882412cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 -- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f882412dec0 msgr2=0x7f882412e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f882412dec0 0x7f882412e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 monclient: found mon.noname-f 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.034+0000 7f8822ffd640 1 -- 172.21.15.28:0/2783761317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814009a90 con 0x7f8804005a20 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881bfff640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f882412dec0 0x7f882412e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8822ffd640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8804005a20 0x7f882412d980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8814035000 tx=0x7f8814005ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 client.?.objecter ms_handle_connect 0x7f8804005a20 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f881403eab0 con 0x7f8804005a20 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: dump: 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881403ec10 con 0x7f8804005a20 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 5 monclient: authenticate success, global_id 4609 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 10 monclient: _renew_subs 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8824071300 con 0x7f8804005a20 2024-03-27T21:30:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f881403ed80 con 0x7f8804005a20 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f881b7fe640 10 monclient: dump: 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8821ffb640 4 set_mon_vals no callback set 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 10 client.4609.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 10 monclient: _renew_subs 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882412fd40 con 0x7f8804005a20 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.035+0000 7f8829727640 1 librados: init done 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f881403e640 con 0x7f8804005a20 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f880403d7d0 0x7f880403fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f881406cba0 con 0x7f8804005a20 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 10 client.4609.objecter ms_dispatch 0x7f8824000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 3 client.4609.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 3 client.4609.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881b7fe640 20 client.4609.objecter dump_active .. 0 homeless 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f8829727640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f8829727640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f8829727640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8824067320 con 0x7f8804005a20 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881bfff640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f880403d7d0 0x7f880403fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.036+0000 7f881bfff640 10 monclient: get_auth_request con 0x7f880403d7d0 auth_method 0 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.037+0000 7f881bfff640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f880403d7d0 0x7f880403fc90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f880c000f60 tx=0x7f880c009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.037+0000 7f881b7fe640 10 client.4609.objecter ms_handle_connect 0x7f880403d7d0 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.041+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f8814045080 con 0x7f8804005a20 2024-03-27T21:30:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.041+0000 7f881b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.041+0000 7f881b7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:43.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.297+0000 7f8829727640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:30:43.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.297+0000 7f8829727640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:43.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.297+0000 7f8829727640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:43.286 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.297+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8824074b50 con 0x7f8804005a20 2024-03-27T21:30:43.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.298+0000 7f881b7fe640 1 -- 172.21.15.28:0/2783761317 <== mon.1 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3147 (secure 0 0 0) 0x7f881403e8f0 con 0x7f8804005a20 2024-03-27T21:30:43.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.298+0000 7f881b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:30:43.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.298+0000 7f881b7fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:43.287 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":18,"quorum":[1,2,3,5,6,7,8],"quorum_names":["f","b","g","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:30:43.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 10 librados: watch_flush enter 2024-03-27T21:30:43.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 10 librados: watch_flush exit 2024-03-27T21:30:43.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 20 client.4609.objecter shutdown clearing up homeless session... 2024-03-27T21:30:43.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 10 client.4609.objecter successfully canceled tick 2024-03-27T21:30:43.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f880403d7d0 msgr2=0x7f880403fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f880403d7d0 0x7f880403fc90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f880c000f60 tx=0x7f880c009040 comp rx=0 tx=0).stop 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 10 monclient: shutdown 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8804005a20 msgr2=0x7f882412d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8804005a20 0x7f882412d980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8814035000 tx=0x7f8814005ca0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 shutdown_connections 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f880403d7d0 0x7f880403fc90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f882412c760 0x7f882412cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f882412dec0 0x7f882412e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 --2- 172.21.15.28:0/2783761317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8804005a20 0x7f882412d980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 >> 172.21.15.28:0/2783761317 conn(0x7f88240a3140 msgr2=0x7f8824066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 shutdown_connections 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 -- 172.21.15.28:0/2783761317 wait complete. 2024-03-27T21:30:43.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.300+0000 7f8829727640 1 librados: shutdown 2024-03-27T21:30:43.300 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-03-27T21:30:43.300 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-03-27T21:30:43.300 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-27T21:30:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.412+0000 7fdc55082640 10 monclient: get_monmap_and_config 2024-03-27T21:30:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.412+0000 7fdc55082640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.412+0000 7fdc55082640 10 monclient: monmap: 2024-03-27T21:30:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.401 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:43.413239+0000 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:43.413239+0000 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 Processor -- start 2024-03-27T21:30:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 -- start start 2024-03-27T21:30:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient: init 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient: _add_conns ranks=[2,0,4,10,7,9,6,3,5,1,8] 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 0x7fdc501370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): picked mon.noname-b con 0x7fdc50136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdc500a3d70 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50137620 0x7fdc501340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): picked mon.noname-c con 0x7fdc50137620 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc500618f0 con 0x7fdc500a3d70 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a25b0 con 0x7fdc50136d00 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a13f0 con 0x7fdc50137620 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc55082640 10 monclient(hunting): authenticate will time out at 865.720240s 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4e59c640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7fdc500a3d70 legacy=0x7fdc501339e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4f59e640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50137620 msgr2=0x7fdc501340f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4f59e640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50137620 0x7fdc501340f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 0x7fdc501370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 0x7fdc501370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:39184/0 (socket says 172.21.15.28:39184) 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/2000945170 learned_addr learned my addr 172.21.15.28:0/2000945170 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): get_auth_request con 0x7fdc50136d00 auth_method 0 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_done global_id 4457 payload 274 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50137620 msgr2=0x7fdc501340f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 --2- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50137620 0x7fdc501340f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/2000945170 >> v1:172.21.15.28:6789/0 conn(0x7fdc500a3d70 legacy=0x7fdc501339e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 monclient: found mon.noname-b 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.413+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/2000945170 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc500a1f60 con 0x7fdc50136d00 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4ed9d640 1 --2- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 0x7fdc501370e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc480098a0 tx=0x7fdc4802b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d144666280f37c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 1 -- 172.21.15.28:0/2000945170 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc480319b0 con 0x7fdc50136d00 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:43.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: dump: 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.416 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 1 -- 172.21.15.28:0/2000945170 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48031b30 con 0x7fdc50136d00 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc55082640 5 monclient: authenticate success, global_id 4457 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc55082640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc55082640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 1 -- 172.21.15.28:0/2000945170 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc48031ce0 con 0x7fdc50136d00 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.417 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc55082640 4 set_mon_vals no callback set 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.414+0000 7fdc4dd9b640 10 monclient: dump: 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.418 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 10 monclient: shutdown 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 -- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 msgr2=0x7fdc501370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 --2- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 0x7fdc501370e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdc480098a0 tx=0x7fdc4802b7e0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 -- 172.21.15.28:0/2000945170 shutdown_connections 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 --2- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50137620 0x7fdc501340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 --2- 172.21.15.28:0/2000945170 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50136d00 0x7fdc501370e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 -- 172.21.15.28:0/2000945170 >> 172.21.15.28:0/2000945170 conn(0x7fdc500a9430 msgr2=0x7fdc500a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 -- 172.21.15.28:0/2000945170 shutdown_connections 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.415+0000 7fdc55082640 1 -- 172.21.15.28:0/2000945170 wait complete. 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient: monmap: 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.420 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 librados: starting msgr at 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 librados: starting objecter 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 Processor -- start 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 -- start start 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 librados: setting wanted keys 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 librados: calling monclient init 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient: init 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient: _add_conns ranks=[2,4,5,1,7,3,6,8,0] 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc500a3d70 0x7fdc501351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient(hunting): picked mon.noname-b con 0x7fdc500a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50136d00 0x7fdc501cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 10 monclient(hunting): picked mon.noname-c con 0x7fdc50136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.416+0000 7fdc55082640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdc50137620 0x7fdc501cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient(hunting): picked mon.noname-h con 0x7fdc50137620 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50121200 con 0x7fdc500a3d70 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50122c40 con 0x7fdc50136d00 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a1630 con 0x7fdc50137620 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient(hunting): authenticate will time out at 865.723739s 2024-03-27T21:30:43.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4e59c640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50136d00 msgr2=0x7fdc501cb6f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4e59c640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50136d00 0x7fdc501cb6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc500a3d70 0x7fdc501351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc500a3d70 0x7fdc501351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:39192/0 (socket says 172.21.15.28:39192) 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/3303615189 learned_addr learned my addr 172.21.15.28:0/3303615189 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): get_auth_request con 0x7fdc500a3d70 auth_method 0 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4f59e640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdc50137620 0x7fdc501cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4f59e640 10 monclient(hunting): get_auth_request con 0x7fdc50137620 auth_method 0 2024-03-27T21:30:43.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient(hunting): handle_auth_done global_id 4466 payload 824 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdc50137620 msgr2=0x7fdc501cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdc50137620 0x7fdc501cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50136d00 msgr2=0x7fdc501cb6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdc50136d00 0x7fdc501cb6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 monclient: found mon.noname-b 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480094d0 con 0x7fdc500a3d70 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4f59e640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdc50137620 0x7fdc501cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4ed9d640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc500a3d70 0x7fdc501351d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc480097c0 tx=0x7fdc480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 client.?.objecter ms_handle_connect 0x7fdc500a3d70 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc48003a80 con 0x7fdc500a3d70 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: dump: 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.425 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48003be0 con 0x7fdc500a3d70 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 5 monclient: authenticate success, global_id 4466 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient: _renew_subs 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc500a11e0 con 0x7fdc500a3d70 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc48003d50 con 0x7fdc500a3d70 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc4cd99640 4 set_mon_vals no callback set 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc477fe640 10 monclient: dump: 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.427 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 client.4466.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient: _renew_subs 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc501225f0 con 0x7fdc500a3d70 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.417+0000 7fdc55082640 1 librados: init done 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fdc4803a040 con 0x7fdc500a3d70 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc55082640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc55082640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 0x7fdc501cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc50122780 con 0x7fdc501215d0 2024-03-27T21:30:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdc3003a250 0x7fdc3003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 0x7fdc501cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient: get_auth_request con 0x7fdc501215d0 auth_method 0 2024-03-27T21:30:43.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fdc4806bf10 con 0x7fdc500a3d70 2024-03-27T21:30:43.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 10 client.4466.objecter ms_dispatch 0x7fdc50000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 3 client.4466.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 3 client.4466.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc477fe640 20 client.4466.objecter dump_active .. 0 homeless 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4f59e640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdc3003a250 0x7fdc3003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4f59e640 10 monclient: get_auth_request con 0x7fdc3003a250 auth_method 0 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_done global_id 4475 payload 824 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.418+0000 7fdc4e59c640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc500a3020 con 0x7fdc501215d0 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 client.4466.objecter ms_handle_connect 0x7fdc501215d0 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 client.4466.objecter resend_mon_ops 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc4e59c640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 0x7fdc501cc170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc500a5550 tx=0x7fdc3800b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc38005070 con 0x7fdc501215d0 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 monclient: dump: 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.432 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.433 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 client.4466.objecter ms_handle_connect 0x7fdc3003a250 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc4f59e640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdc3003a250 0x7fdc3003c710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc40003cb0 tx=0x7fdc40009570 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fdc38003b70 con 0x7fdc501215d0 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:43.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 msgr2=0x7fdc501cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 0x7fdc501cc170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc500a5550 tx=0x7fdc3800b810 comp rx=0 tx=0).stop 2024-03-27T21:30:43.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 msgr2=0x7fdc501cc170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:43.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.419+0000 7fdc477fe640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc501215d0 0x7fdc501cc170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc55082640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:43.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc55082640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 0x7fdc50099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc55082640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc500a07e0 con 0x7fdc50135710 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 0x7fdc50099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient: get_auth_request con 0x7fdc50135710 auth_method 0 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.425+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc4e59c640 10 monclient(hunting): handle_auth_done global_id 4484 payload 824 2024-03-27T21:30:43.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc4e59c640 1 -- 172.21.15.28:0/3303615189 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdc50137ad0 con 0x7fdc50135710 2024-03-27T21:30:43.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 client.4466.objecter ms_handle_connect 0x7fdc50135710 2024-03-27T21:30:43.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc4e59c640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 0x7fdc50099a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc38013000 tx=0x7fdc380037f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 client.4466.objecter resend_mon_ops 2024-03-27T21:30:43.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdc380057d0 con 0x7fdc50135710 2024-03-27T21:30:43.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:43.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 monclient: dump: 2024-03-27T21:30:43.442 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.442 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.442 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.442 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.442 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.442 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.443 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 <== mon.2 v2:172.21.15.28:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9315 (secure 0 0 0) 0x7fdc380129a0 con 0x7fdc50135710 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 msgr2=0x7fdc50099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 0x7fdc50099a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc38013000 tx=0x7fdc380037f0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 msgr2=0x7fdc50099a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:43.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc477fe640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc50135710 0x7fdc50099a00 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdc38013000 tx=0x7fdc380037f0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:43.445 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 0, 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:43.446 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:43.447 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.448 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:43.449 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.450 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:43.451 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.452 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.453 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.454 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.455 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:43.455 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:43.455 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.455 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.455 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.455 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:43.456 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.457 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.458 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.459 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.460 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.461 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.462 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.463 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.464 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.465 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.466 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.467 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.468 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.469 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.470 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.471 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 2 2024-03-27T21:30:43.472 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.472 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.472 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.472 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:43.472 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 10 librados: watch_flush enter 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 10 librados: watch_flush exit 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 20 client.4466.objecter shutdown clearing up homeless session... 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 10 client.4466.objecter successfully canceled tick 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdc3003a250 msgr2=0x7fdc3003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdc3003a250 0x7fdc3003c710 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdc40003cb0 tx=0x7fdc40009570 comp rx=0 tx=0).stop 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 10 monclient: shutdown 2024-03-27T21:30:43.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc500a3d70 msgr2=0x7fdc501351d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 --2- 172.21.15.28:0/3303615189 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdc500a3d70 0x7fdc501351d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdc480097c0 tx=0x7fdc480046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc4f59e640 1 -- 172.21.15.28:0/3303615189 reap_dead start 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc4f59e640 1 -- 172.21.15.28:0/3303615189 reap_dead start 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 shutdown_connections 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 >> 172.21.15.28:0/3303615189 conn(0x7fdc500a9430 msgr2=0x7fdc500662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.426+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 shutdown_connections 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.427+0000 7fdc55082640 1 -- 172.21.15.28:0/3303615189 wait complete. 2024-03-27T21:30:43.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.427+0000 7fdc55082640 1 librados: shutdown 2024-03-27T21:30:43.475 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:43.476 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-03-27T21:30:43.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.598+0000 7f2de67c4640 10 monclient: get_monmap_and_config 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.598+0000 7f2de67c4640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.598+0000 7f2de67c4640 10 monclient: monmap: 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:43.599426+0000 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:43.599426+0000 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.602 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 Processor -- start 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 -- start start 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient: init 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient: _add_conns ranks=[0,5,9,7,1,10,3,6,2,4,8] 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2de0136d00 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 0x7f2de013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): picked mon.noname-h con 0x7f2de00a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2de01377f0 0x7f2de013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): picked mon.noname-a con 0x7f2de01377f0 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de00618f0 con 0x7f2de0136d00 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de00a25b0 con 0x7f2de01377f0 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00a13f0 con 0x7f2de00a3d70 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.605 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2ddffff640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7f2de0136d00 legacy=0x7f2de01370e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de67c4640 10 monclient(hunting): authenticate will time out at 865.906575s 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de4d61640 1 -- >> v2:172.21.15.28:3300/0 conn(0x7f2de01377f0 msgr2=0x7f2de013e7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.599+0000 7f2de4d61640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2de01377f0 0x7f2de013e7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 0x7f2de013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 0x7f2de013c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.28:52786/0 (socket says 172.21.15.28:52786) 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 -- 172.21.15.28:0/2377987412 learned_addr learned my addr 172.21.15.28:0/2377987412 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): get_auth_request con 0x7f2de00a3d70 auth_method 0 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient(hunting): handle_auth_done global_id 4460 payload 274 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 -- 172.21.15.28:0/2377987412 >> v2:172.21.15.28:3300/0 conn(0x7f2de01377f0 msgr2=0x7f2de013e7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 --2- 172.21.15.28:0/2377987412 >> v2:172.21.15.28:3300/0 conn(0x7f2de01377f0 0x7f2de013e7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 -- 172.21.15.28:0/2377987412 >> v1:172.21.15.28:6789/0 conn(0x7f2de0136d00 legacy=0x7f2de01370e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 monclient: found mon.noname-h 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.600+0000 7f2ddf7fe640 1 -- 172.21.15.28:0/2377987412 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de00a1f60 con 0x7f2de00a3d70 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddf7fe640 1 --2- 172.21.15.28:0/2377987412 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 0x7f2de013c2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009870 tx=0x7f2dd002b7f0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=a0292b41dd0bb6e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 1 -- 172.21.15.28:0/2377987412 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2dd00319c0 con 0x7f2de00a3d70 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: dump: 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.608 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.609 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 5 monclient: authenticate success, global_id 4460 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 1 -- 172.21.15.28:0/2377987412 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd0031b40 con 0x7f2de00a3d70 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 4 set_mon_vals no callback set 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 1 -- 172.21.15.28:0/2377987412 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2dd0031cf0 con 0x7f2de00a3d70 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2ddeffd640 10 monclient: dump: 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.611 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 10 monclient: shutdown 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 -- 172.21.15.28:0/2377987412 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 msgr2=0x7f2de013c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 --2- 172.21.15.28:0/2377987412 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 0x7f2de013c2a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009870 tx=0x7f2dd002b7f0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 -- 172.21.15.28:0/2377987412 shutdown_connections 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 --2- 172.21.15.28:0/2377987412 >> v2:172.21.15.28:3300/0 conn(0x7f2de01377f0 0x7f2de013e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 --2- 172.21.15.28:0/2377987412 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2de00a3d70 0x7f2de013c2a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 -- 172.21.15.28:0/2377987412 >> 172.21.15.28:0/2377987412 conn(0x7f2de00a9430 msgr2=0x7f2de00a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 -- 172.21.15.28:0/2377987412 shutdown_connections 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.601+0000 7f2de67c4640 1 -- 172.21.15.28:0/2377987412 wait complete. 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 10 monclient: monmap: 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:43.613 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 1 librados: starting msgr at 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 1 librados: starting objecter 2024-03-27T21:30:43.614 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 1 Processor -- start 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 1 -- start start 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 1 librados: setting wanted keys 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 1 librados: calling monclient init 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.602+0000 7f2de67c4640 10 monclient: init 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient: _add_conns ranks=[4,0,2,1,3,8,5,6,7] 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2de00a3d70 0x7f2de0135340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): picked mon.noname-c con 0x7f2de00a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2de0136d00 0x7f2de0135880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): picked mon.noname-a con 0x7f2de0136d00 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:43.615 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2de01377f0 0x7f2de011f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): picked mon.noname-b con 0x7f2de01377f0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de01cc460 con 0x7f2de0136d00 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00a11e0 con 0x7f2de01377f0 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2de01212d0 con 0x7f2de00a3d70 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2ddffff640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2de00a3d70 msgr2=0x7f2de0135340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de67c4640 10 monclient(hunting): authenticate will time out at 865.910101s 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2ddffff640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2de00a3d70 0x7f2de0135340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2ddf7fe640 1 -- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2de0136d00 msgr2=0x7f2de0135880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2ddf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2de0136d00 0x7f2de0135880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2de01377f0 0x7f2de011f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2de01377f0 0x7f2de011f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:39210/0 (socket says 172.21.15.28:39210) 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 -- 172.21.15.28:0/662143690 learned_addr learned my addr 172.21.15.28:0/662143690 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): get_auth_request con 0x7f2de01377f0 auth_method 0 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient(hunting): handle_auth_done global_id 4493 payload 824 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2de00a3d70 msgr2=0x7f2de0135340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2de00a3d70 0x7f2de0135340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2de0136d00 msgr2=0x7f2de0135880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:43.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2de0136d00 0x7f2de0135880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 monclient: found mon.noname-b 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00094d0 con 0x7f2de01377f0 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2de4d61640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2de01377f0 0x7f2de011f8a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800be60 tx=0x7f2dd800bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2ddcff9640 10 client.?.objecter ms_handle_connect 0x7f2de01377f0 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.603+0000 7f2ddcff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2dd800cca0 con 0x7f2de01377f0 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:43.618 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: dump: 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.619 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800ce20 con 0x7f2de01377f0 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 5 monclient: authenticate success, global_id 4493 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 monclient: _renew_subs 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de00a1630 con 0x7f2de01377f0 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2dd8015cc0 con 0x7f2de01377f0 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 client.4493.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2dde7fc640 4 set_mon_vals no callback set 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 10 monclient: dump: 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.621 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 monclient: _renew_subs 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de0122ad0 con 0x7f2de01377f0 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 1 librados: init done 2024-03-27T21:30:43.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f2dd8012020 con 0x7f2de01377f0 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 0x7f2de011fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.604+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f2de00a50d0 con 0x7f2de01cb9e0 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 0x7f2de011fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2dcc03a250 0x7f2dcc03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient: get_auth_request con 0x7f2de01cb9e0 auth_method 0 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f2dd804a160 con 0x7f2de01377f0 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 client.4493.objecter ms_dispatch 0x7f2de0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:43.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 3 client.4493.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 3 client.4493.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 20 client.4493.objecter dump_active .. 0 homeless 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddf7fe640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2dcc03a250 0x7f2dcc03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddf7fe640 10 monclient: get_auth_request con 0x7f2dcc03a250 auth_method 0 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 10 monclient(hunting): handle_auth_done global_id 4506 payload 824 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2de00a3020 con 0x7f2de01cb9e0 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 client.4493.objecter ms_handle_connect 0x7f2de01cb9e0 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 client.4493.objecter resend_mon_ops 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddffff640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 0x7f2de011fde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4003980 tx=0x7f2dd400b830 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 client.4493.objecter ms_handle_connect 0x7f2dcc03a250 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddf7fe640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2dcc03a250 0x7f2dcc03c710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0035000 tx=0x7f2dd0008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2dd4003bc0 con 0x7f2de01cb9e0 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 monclient: dump: 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.625 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.6 v2:172.21.15.28:3303/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f2dd4003d20 con 0x7f2de01cb9e0 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.626 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:43.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 msgr2=0x7f2de011fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 0x7f2de011fde0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4003980 tx=0x7f2dd400b830 comp rx=0 tx=0).stop 2024-03-27T21:30:43.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.605+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 msgr2=0x7f2de011fde0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:43.627 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.606+0000 7f2ddcff9640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de01cb9e0 0x7f2de011fde0 secure :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4003980 tx=0x7f2dd400b830 comp rx=0 tx=0).stop 2024-03-27T21:30:43.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2de67c4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:43.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2de67c4640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 0x7f2de009aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2de67c4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f2de0069c80 con 0x7f2de0120320 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 0x7f2de009aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient: get_auth_request con 0x7f2de0120320 auth_method 0 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 10 monclient(hunting): handle_auth_done global_id 4515 payload 824 2024-03-27T21:30:43.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 1 -- 172.21.15.28:0/662143690 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f2de0120730 con 0x7f2de0120320 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddcff9640 10 client.4493.objecter ms_handle_connect 0x7f2de0120320 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddcff9640 10 client.4493.objecter resend_mon_ops 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddffff640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 0x7f2de009aa10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4013000 tx=0x7f2dd40037f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2dd4011a80 con 0x7f2de0120320 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddcff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddcff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.612+0000 7f2ddcff9640 10 monclient: dump: 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.632 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.633 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.634 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 <== mon.6 v2:172.21.15.28:3303/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9145 (secure 0 0 0) 0x7f2dd4011be0 con 0x7f2de0120320 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 msgr2=0x7f2de009aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 0x7f2de009aa10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4013000 tx=0x7f2dd40037f0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 msgr2=0x7f2de009aa10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:43.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2ddcff9640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f2de0120320 0x7f2de009aa10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:43.636 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 0, 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.637 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.638 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:43.639 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.640 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:43.641 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.642 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.643 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.644 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.645 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.646 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:43.647 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:43.648 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.648 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.648 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.649 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.649 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.650 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:43.651 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.652 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.653 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.654 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.655 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.656 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.657 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.658 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.659 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.660 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.661 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.662 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.662 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:43.662 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 10 librados: watch_flush enter 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 10 librados: watch_flush exit 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 20 client.4493.objecter shutdown clearing up homeless session... 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 10 client.4493.objecter successfully canceled tick 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2dcc03a250 msgr2=0x7f2dcc03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2dcc03a250 0x7f2dcc03c710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0035000 tx=0x7f2dd0008030 comp rx=0 tx=0).stop 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 10 monclient: shutdown 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2de01377f0 msgr2=0x7f2de011f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 --2- 172.21.15.28:0/662143690 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2de01377f0 0x7f2de011f8a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800be60 tx=0x7f2dd800bf50 comp rx=0 tx=0).stop 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de4d61640 1 -- 172.21.15.28:0/662143690 reap_dead start 2024-03-27T21:30:43.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de4d61640 1 -- 172.21.15.28:0/662143690 reap_dead start 2024-03-27T21:30:43.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 shutdown_connections 2024-03-27T21:30:43.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 >> 172.21.15.28:0/662143690 conn(0x7f2de00a9430 msgr2=0x7f2de01bed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 shutdown_connections 2024-03-27T21:30:43.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 -- 172.21.15.28:0/662143690 wait complete. 2024-03-27T21:30:43.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.613+0000 7f2de67c4640 1 librados: shutdown 2024-03-27T21:30:43.665 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:43.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon e 2024-03-27T21:30:43.665 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-03-27T21:30:43.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.783+0000 7f5c7c7ab640 10 monclient: get_monmap_and_config 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.783+0000 7f5c7c7ab640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.783+0000 7f5c7c7ab640 10 monclient: monmap: 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:43.784256+0000 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:43.784256+0000 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:43.794 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:43.795 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 Processor -- start 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 -- start start 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient: init 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient: _add_conns ranks=[3,4,10,8,7,1,6,2,5,9,0] 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 0x7f5c741370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): picked mon.noname-g con 0x7f5c74136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c74137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): picked mon.noname-c con 0x7f5c740a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:43.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5c741339e0 0x7f5c74133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): picked mon.noname-f con 0x7f5c741339e0 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c740a25b0 con 0x7f5c741339e0 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74137b60 con 0x7f5c74136d00 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c740a13f0 con 0x7f5c740a3d70 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7c7ab640 10 monclient(hunting): authenticate will time out at 866.091380s 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c79d46640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 msgr2=0x7f5c74137620 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:43.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c79d46640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c74137620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7ad48640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5c741339e0 0x7f5c74133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7a547640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 0x7f5c741370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.784+0000 7f5c7ad48640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5c741339e0 0x7f5c74133e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:44882/0 (socket says 172.21.15.28:44882) 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 0x7f5c741370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3301/0 says I am v2:172.21.15.28:41002/0 (socket says 172.21.15.28:41002) 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 -- 172.21.15.28:0/2358284817 learned_addr learned my addr 172.21.15.28:0/2358284817 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): get_auth_request con 0x7f5c741339e0 auth_method 0 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): get_auth_request con 0x7f5c74136d00 auth_method 0 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.799 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_done global_id 4618 payload 274 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 -- 172.21.15.28:0/2358284817 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 msgr2=0x7f5c74137620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c74137620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 -- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 msgr2=0x7f5c741370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 0x7f5c741370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 monclient: found mon.noname-f 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7ad48640 1 -- 172.21.15.28:0/2358284817 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c740618f0 con 0x7f5c741339e0 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.785+0000 7f5c7a547640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 0x7f5c741370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7ad48640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c741339e0 0x7f5c74133e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009e50 tx=0x7f5c6402bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=473a14a84f5d4038 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 1 -- 172.21.15.28:0/2358284817 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c6402cbd0 con 0x7f5c741339e0 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: dump: 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.802 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.803 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 1 -- 172.21.15.28:0/2358284817 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6402cd50 con 0x7f5c741339e0 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 5 monclient: authenticate success, global_id 4618 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 1 -- 172.21.15.28:0/2358284817 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c64034860 con 0x7f5c741339e0 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.804 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 4 set_mon_vals no callback set 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c79545640 10 monclient: dump: 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.805 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.806 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.807 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.807 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.807 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 10 monclient: shutdown 2024-03-27T21:30:43.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.807 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c741339e0 msgr2=0x7f5c74133e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c741339e0 0x7f5c74133e90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009e50 tx=0x7f5c6402bdc0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/2358284817 shutdown_connections 2024-03-27T21:30:43.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5c741339e0 0x7f5c74133e90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c74137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/2358284817 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f5c74136d00 0x7f5c741370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.808 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/2358284817 >> 172.21.15.28:0/2358284817 conn(0x7f5c740a9430 msgr2=0x7f5c740a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/2358284817 shutdown_connections 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.786+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/2358284817 wait complete. 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 10 monclient: monmap: 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:43.809 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.810 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 1 librados: starting msgr at 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 1 librados: starting objecter 2024-03-27T21:30:43.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 1 Processor -- start 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 1 -- start start 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 1 librados: setting wanted keys 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 1 librados: calling monclient init 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.787+0000 7f5c7c7ab640 10 monclient: init 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient: _add_conns ranks=[4,7,2,3,5,8,0,1,6] 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c741cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): picked mon.noname-c con 0x7f5c740a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5c741339e0 0x7f5c74132ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): picked mon.noname-i con 0x7f5c741339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c74136d00 0x7f5c7409c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): picked mon.noname-b con 0x7f5c74136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74120520 con 0x7f5c74136d00 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c741cb900 con 0x7f5c740a3d70 2024-03-27T21:30:43.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7411fc10 con 0x7f5c741339e0 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7c7ab640 10 monclient(hunting): authenticate will time out at 866.094907s 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7a547640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 msgr2=0x7f5c741cb3c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7a547640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c741cb3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c74136d00 0x7f5c7409c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c74136d00 0x7f5c7409c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:39214/0 (socket says 172.21.15.28:39214) 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 -- 172.21.15.28:0/1524979695 learned_addr learned my addr 172.21.15.28:0/1524979695 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): get_auth_request con 0x7f5c74136d00 auth_method 0 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5c741339e0 0x7f5c74132ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): get_auth_request con 0x7f5c741339e0 auth_method 0 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c79d46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient(hunting): handle_auth_done global_id 4502 payload 824 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5c741339e0 msgr2=0x7f5c74132ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5c741339e0 0x7f5c74132ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 msgr2=0x7f5c741cb3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:43.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f5c740a3d70 0x7f5c741cb3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 monclient: found mon.noname-b 2024-03-27T21:30:43.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6c009400 con 0x7f5c74136d00 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c7ad48640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c74136d00 0x7f5c7409c780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c64036040 tx=0x7f5c64004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 10 client.?.objecter ms_handle_connect 0x7f5c74136d00 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c6402cbe0 con 0x7f5c74136d00 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:43.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 10 monclient: dump: 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.819 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.820 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.788+0000 7f5c72ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c640046c0 con 0x7f5c74136d00 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 5 monclient: authenticate success, global_id 4502 2024-03-27T21:30:43.821 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 monclient: _renew_subs 2024-03-27T21:30:43.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c64009b30 con 0x7f5c74136d00 2024-03-27T21:30:43.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c64004830 con 0x7f5c74136d00 2024-03-27T21:30:43.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.822 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 10 monclient: dump: 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.823 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c78d44640 4 set_mon_vals no callback set 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 client.4502.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 monclient: _renew_subs 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c741201d0 con 0x7f5c74136d00 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 1 librados: init done 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 0x7f5c7409ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74120360 con 0x7f5c7409ee40 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.789+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f5c64004250 con 0x7f5c74136d00 2024-03-27T21:30:43.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 0x7f5c7409ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient: get_auth_request con 0x7f5c7409ee40 auth_method 0 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c6003a280 0x7f5c6003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f5c6406c360 con 0x7f5c74136d00 2024-03-27T21:30:43.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 client.4502.objecter ms_dispatch 0x7f5c74000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:43.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 3 client.4502.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:43.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 3 client.4502.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:43.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 10 monclient(hunting): handle_auth_done global_id 4436 payload 824 2024-03-27T21:30:43.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 20 client.4502.objecter dump_active .. 0 homeless 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c740a3020 con 0x7f5c7409ee40 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c79d46640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c6003a280 0x7f5c6003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c79d46640 10 monclient: get_auth_request con 0x7f5c6003a280 auth_method 0 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 client.4502.objecter ms_handle_connect 0x7f5c7409ee40 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 client.4502.objecter resend_mon_ops 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c7a547640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 0x7f5c7409ccc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0093d0 tx=0x7f5c6c00ec90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c6c0044a0 con 0x7f5c7409ee40 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:43.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 monclient: dump: 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.829 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 client.4502.objecter ms_handle_connect 0x7f5c6003a280 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c79d46640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c6003a280 0x7f5c6003c740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c7409dee0 tx=0x7f5c680090e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.8 v2:172.21.15.28:3304/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5c6c004030 con 0x7f5c7409ee40 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:43.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 msgr2=0x7f5c7409ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 0x7f5c7409ccc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0093d0 tx=0x7f5c6c00ec90 comp rx=0 tx=0).stop 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 msgr2=0x7f5c7409ccc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.790+0000 7f5c72ffd640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409ee40 0x7f5c7409ccc0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0093d0 tx=0x7f5c6c00ec90 comp rx=0 tx=0).stop 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7c7ab640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 0x7f5c740a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7c7ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f5c74069c80 con 0x7f5c7409d200 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 0x7f5c740a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient: get_auth_request con 0x7f5c7409d200 auth_method 0 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 10 monclient(hunting): handle_auth_done global_id 4445 payload 824 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 1 -- 172.21.15.28:0/1524979695 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5c740a2240 con 0x7f5c7409d200 2024-03-27T21:30:43.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c72ffd640 10 client.4502.objecter ms_handle_connect 0x7f5c7409d200 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c72ffd640 10 client.4502.objecter resend_mon_ops 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c7a547640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 0x7f5c740a7250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c018000 tx=0x7f5c6c004730 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c6c005e00 con 0x7f5c7409d200 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c72ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c72ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.797+0000 7f5c72ffd640 10 monclient: dump: 2024-03-27T21:30:43.833 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.834 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 <== mon.8 v2:172.21.15.28:3304/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9315 (secure 0 0 0) 0x7f5c6c003bf0 con 0x7f5c7409d200 2024-03-27T21:30:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 msgr2=0x7f5c740a7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 0x7f5c740a7250 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c018000 tx=0x7f5c6c004730 comp rx=0 tx=0).stop 2024-03-27T21:30:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 msgr2=0x7f5c740a7250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:43.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c72ffd640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5c7409d200 0x7f5c740a7250 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c018000 tx=0x7f5c6c004730 comp rx=0 tx=0).stop 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:43.837 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 0, 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:43.838 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.839 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.840 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:43.841 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:43.842 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:43.843 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:43.844 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.845 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:43.846 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.846 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.846 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.846 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.846 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.847 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:43.848 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.849 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:43.850 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.851 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.853 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.853 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:43.853 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.853 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.853 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.853 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.854 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:43.854 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:43.854 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.854 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.854 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.854 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.855 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.855 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:43.855 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:43.855 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.855 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.855 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.856 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.857 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:43.858 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:43.859 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.860 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.861 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.862 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.863 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:43.864 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.865 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.866 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.867 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:43.868 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.869 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:43.870 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:43.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 10 librados: watch_flush enter 2024-03-27T21:30:43.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 10 librados: watch_flush exit 2024-03-27T21:30:43.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 20 client.4502.objecter shutdown clearing up homeless session... 2024-03-27T21:30:43.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 10 client.4502.objecter successfully canceled tick 2024-03-27T21:30:43.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c6003a280 msgr2=0x7f5c6003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5c6003a280 0x7f5c6003c740 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5c7409dee0 tx=0x7f5c680090e0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 10 monclient: shutdown 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c74136d00 msgr2=0x7f5c7409c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 --2- 172.21.15.28:0/1524979695 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5c74136d00 0x7f5c7409c780 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c64036040 tx=0x7f5c64004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7ad48640 1 -- 172.21.15.28:0/1524979695 reap_dead start 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7ad48640 1 -- 172.21.15.28:0/1524979695 reap_dead start 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 shutdown_connections 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 >> 172.21.15.28:0/1524979695 conn(0x7f5c740a9430 msgr2=0x7f5c74066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 shutdown_connections 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 -- 172.21.15.28:0/1524979695 wait complete. 2024-03-27T21:30:43.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.798+0000 7f5c7c7ab640 1 librados: shutdown 2024-03-27T21:30:43.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:43.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-03-27T21:30:43.874 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.987+0000 7fde3b367640 10 monclient: get_monmap_and_config 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.987+0000 7fde3b367640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.987+0000 7fde3b367640 10 monclient: monmap: 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:43.987985+0000 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:43.987985+0000 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:43.976 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.987+0000 7fde3b367640 1 Processor -- start 2024-03-27T21:30:43.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.987+0000 7fde3b367640 1 -- start start 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.987+0000 7fde3b367640 10 monclient: init 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient: _add_conns ranks=[10,8,0,5,1,7,3,9,4,6,2] 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde3409f410 0x7fde34069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): picked mon.noname-f con 0x7fde3409f410 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 0x7fde340984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): picked mon.noname-e con 0x7fde3409f7f0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fde340989f0 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde340618f0 con 0x7fde340989f0 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3409db80 con 0x7fde3409f410 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fde3409e830 con 0x7fde3409f7f0 2024-03-27T21:30:43.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde3b367640 10 monclient(hunting): authenticate will time out at 866.295115s 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39904640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7fde340989f0 legacy=0x7fde340a0fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 0x7fde340984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 0x7fde340984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:41436/0 (socket says 172.21.15.28:41436) 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 -- 172.21.15.28:0/813652960 learned_addr learned my addr 172.21.15.28:0/813652960 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): get_auth_request con 0x7fde3409f7f0 auth_method 0 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 1 --2- 172.21.15.28:0/813652960 >> v2:172.21.15.63:3300/0 conn(0x7fde3409f410 0x7fde34069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): get_auth_request con 0x7fde3409f410 auth_method 0 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde39103640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient(hunting): handle_auth_done global_id 4454 payload 274 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 -- 172.21.15.28:0/813652960 >> v2:172.21.15.63:3300/0 conn(0x7fde3409f410 msgr2=0x7fde34069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 --2- 172.21.15.28:0/813652960 >> v2:172.21.15.63:3300/0 conn(0x7fde3409f410 0x7fde34069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 -- 172.21.15.28:0/813652960 >> v1:172.21.15.28:6789/0 conn(0x7fde340989f0 legacy=0x7fde340a0fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient: _finish_hunting 0 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 monclient: found mon.noname-e 2024-03-27T21:30:43.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.988+0000 7fde38902640 1 -- 172.21.15.28:0/813652960 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3409eb10 con 0x7fde3409f7f0 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde38902640 1 --2- 172.21.15.28:0/813652960 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 0x7fde340984b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde24009870 tx=0x7fde2402b7e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f5809bfd47039dbd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 1 -- 172.21.15.28:0/813652960 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fde240319b0 con 0x7fde3409f7f0 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: dump: 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.991 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: _finish_auth 0 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: _check_auth_tickets 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 1 -- 172.21.15.28:0/813652960 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde24031b30 con 0x7fde3409f7f0 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde3b367640 5 monclient: authenticate success, global_id 4454 2024-03-27T21:30:43.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde3b367640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde3b367640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 1 -- 172.21.15.28:0/813652960 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fde24031ce0 con 0x7fde3409f7f0 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde3b367640 4 set_mon_vals no callback set 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.989+0000 7fde2bfff640 10 monclient: dump: 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:43.993 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 10 monclient: shutdown 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 -- 172.21.15.28:0/813652960 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 msgr2=0x7fde340984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 --2- 172.21.15.28:0/813652960 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 0x7fde340984b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde24009870 tx=0x7fde2402b7e0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 -- 172.21.15.28:0/813652960 shutdown_connections 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 --2- 172.21.15.28:0/813652960 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fde3409f7f0 0x7fde340984b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 --2- 172.21.15.28:0/813652960 >> v2:172.21.15.63:3300/0 conn(0x7fde3409f410 0x7fde34069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 -- 172.21.15.28:0/813652960 >> 172.21.15.28:0/813652960 conn(0x7fde340a20d0 msgr2=0x7fde340a24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 -- 172.21.15.28:0/813652960 shutdown_connections 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 1 -- 172.21.15.28:0/813652960 wait complete. 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.990+0000 7fde3b367640 10 monclient: build_initial_monmap 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient: monmap: 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:43.995 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 librados: starting msgr at 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 librados: starting objecter 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 Processor -- start 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 -- start start 2024-03-27T21:30:43.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 librados: setting wanted keys 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 librados: calling monclient init 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient: init 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient: _add_conns ranks=[0,1,5,3,2,7,8,6,4] 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde340989f0 0x7fde341cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): picked mon.noname-a con 0x7fde340989f0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 0x7fde340716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): picked mon.noname-f con 0x7fde3409f410 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fde3409f7f0 0x7fde34071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde39103640 1 -- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde340989f0 msgr2=0x7fde341cba20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): picked mon.noname-h con 0x7fde3409f7f0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde341cbf60 con 0x7fde340989f0 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde34072140 con 0x7fde3409f410 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde3406e8e0 con 0x7fde3409f7f0 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde3b367640 10 monclient(hunting): authenticate will time out at 866.298640s 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.991+0000 7fde39103640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde340989f0 0x7fde341cba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fde3409f7f0 0x7fde34071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 0x7fde340716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 0x7fde340716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:44906/0 (socket says 172.21.15.28:44906) 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fde3409f7f0 0x7fde34071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.28:52802/0 (socket says 172.21.15.28:52802) 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 -- 172.21.15.28:0/944225511 learned_addr learned my addr 172.21.15.28:0/944225511 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): get_auth_request con 0x7fde3409f410 auth_method 0 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): get_auth_request con 0x7fde3409f7f0 auth_method 0 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient(hunting): handle_auth_done global_id 4636 payload 824 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fde3409f7f0 msgr2=0x7fde34071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fde3409f7f0 0x7fde34071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde340989f0 msgr2=0x7fde341cba20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:43.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fde340989f0 0x7fde341cba20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 monclient: found mon.noname-f 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240094d0 con 0x7fde3409f410 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde39904640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fde3409f7f0 0x7fde34071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde38902640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 0x7fde340716c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde240097c0 tx=0x7fde240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde29ffb640 10 client.?.objecter ms_handle_connect 0x7fde3409f410 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.992+0000 7fde29ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fde24004350 con 0x7fde3409f410 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: dump: 2024-03-27T21:30:44.000 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.001 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde240044b0 con 0x7fde3409f410 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 5 monclient: authenticate success, global_id 4636 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 10 monclient: _renew_subs 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3406ebc0 con 0x7fde3409f410 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fde24033430 con 0x7fde3409f410 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde29ffb640 10 monclient: dump: 2024-03-27T21:30:44.002 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.003 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde2b7fe640 4 set_mon_vals no callback set 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 10 client.4636.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 10 monclient: _renew_subs 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 10 monclient: _send_mon_message to mon.f at v2:172.21.15.63:3300/0 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3406f180 con 0x7fde3409f410 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.993+0000 7fde3b367640 1 librados: init done 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fde2403a040 con 0x7fde3409f410 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fde1803a250 0x7fde1803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde3b367640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde3b367640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 0x7fde340997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fde2406bc30 con 0x7fde3409f410 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 10 client.4636.objecter ms_dispatch 0x7fde34000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 3 client.4636.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 3 client.4636.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:44.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3406f310 con 0x7fde3409b050 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde29ffb640 20 client.4636.objecter dump_active .. 0 homeless 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39103640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fde1803a250 0x7fde1803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 0x7fde340997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39103640 10 monclient: get_auth_request con 0x7fde1803a250 auth_method 0 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient: get_auth_request con 0x7fde3409b050 auth_method 0 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.994+0000 7fde39904640 10 monclient(hunting): handle_auth_done global_id 4645 payload 824 2024-03-27T21:30:44.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.995+0000 7fde39904640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde3412d6c0 con 0x7fde3409b050 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.995+0000 7fde29ffb640 10 client.4636.objecter ms_handle_connect 0x7fde1803a250 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.995+0000 7fde39103640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fde1803a250 0x7fde1803c710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde300094c0 tx=0x7fde30009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.995+0000 7fde39904640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 0x7fde340997a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde2c003d00 tx=0x7fde2c006720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.995+0000 7fde29ffb640 10 client.4636.objecter ms_handle_connect 0x7fde3409b050 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.995+0000 7fde29ffb640 10 client.4636.objecter resend_mon_ops 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fde2c010040 con 0x7fde3409b050 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 10 monclient: dump: 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.006 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fde2c013590 con 0x7fde3409b050 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.997+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 msgr2=0x7fde340997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.998+0000 7fde29ffb640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 0x7fde340997a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde2c003d00 tx=0x7fde2c006720 comp rx=0 tx=0).stop 2024-03-27T21:30:44.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.998+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 msgr2=0x7fde340997a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:43.998+0000 7fde29ffb640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409b050 0x7fde340997a0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde2c003d00 tx=0x7fde2c006720 comp rx=0 tx=0).stop 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde3b367640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde3b367640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 0x7fde3409a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde3b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3406b5d0 con 0x7fde34099ce0 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 0x7fde3409a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient: get_auth_request con 0x7fde34099ce0 auth_method 0 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 10 monclient(hunting): handle_auth_done global_id 4654 payload 824 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.004+0000 7fde39904640 1 -- 172.21.15.28:0/944225511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fde340a2ef0 con 0x7fde34099ce0 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 client.4636.objecter ms_handle_connect 0x7fde34099ce0 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde39904640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 0x7fde3409a0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde2c003d00 tx=0x7fde2c003be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 client.4636.objecter resend_mon_ops 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fde2c023070 con 0x7fde34099ce0 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 monclient: dump: 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.011 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 <== mon.1 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9147 (secure 0 0 0) 0x7fde2c01e9d0 con 0x7fde34099ce0 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 msgr2=0x7fde3409a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 0x7fde3409a0f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde2c003d00 tx=0x7fde2c003be0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 msgr2=0x7fde3409a0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde29ffb640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde34099ce0 0x7fde3409a0f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "leader", 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:44.013 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 1, 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.014 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.015 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:44.016 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.017 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.018 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.019 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:44.020 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.021 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.022 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.023 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:44.024 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.025 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.026 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.027 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.028 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.029 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.030 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.031 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.032 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 4 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:44.033 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:44.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 10 librados: watch_flush enter 2024-03-27T21:30:44.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 10 librados: watch_flush exit 2024-03-27T21:30:44.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 20 client.4636.objecter shutdown clearing up homeless session... 2024-03-27T21:30:44.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 10 client.4636.objecter successfully canceled tick 2024-03-27T21:30:44.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fde1803a250 msgr2=0x7fde1803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fde1803a250 0x7fde1803c710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fde300094c0 tx=0x7fde30009190 comp rx=0 tx=0).stop 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 10 monclient: shutdown 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 msgr2=0x7fde340716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 0x7fde340716c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde240097c0 tx=0x7fde240046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde39904640 1 -- 172.21.15.28:0/944225511 reap_dead start 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 shutdown_connections 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 --2- 172.21.15.28:0/944225511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde3409f410 0x7fde340716c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 >> 172.21.15.28:0/944225511 conn(0x7fde340a20d0 msgr2=0x7fde340662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 shutdown_connections 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.005+0000 7fde3b367640 1 -- 172.21.15.28:0/944225511 wait complete. 2024-03-27T21:30:44.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.006+0000 7fde3b367640 1 librados: shutdown 2024-03-27T21:30:44.037 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:44.037 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-03-27T21:30:44.037 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-03-27T21:30:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.149+0000 7ff1b3a69640 10 monclient: get_monmap_and_config 2024-03-27T21:30:44.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.149+0000 7ff1b3a69640 10 monclient: build_initial_monmap 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.149+0000 7ff1b3a69640 10 monclient: monmap: 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:44.150521+0000 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:44.150521+0000 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:44.139 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 Processor -- start 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 -- start start 2024-03-27T21:30:44.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient: init 2024-03-27T21:30:44.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:44.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient: _add_conns ranks=[4,0,10,8,1,9,5,6,3,2,7] 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7ff1ac136d00 0x7ff1ac1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): picked mon.noname-c con 0x7ff1ac136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff1ac0a3d70 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1ac137620 0x7ff1ac1340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): picked mon.noname-f con 0x7ff1ac137620 addr v2:172.21.15.63:3300/0 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac0618f0 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac0a25b0 con 0x7ff1ac137620 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0a13f0 con 0x7ff1ac136d00 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b3a69640 10 monclient(hunting): authenticate will time out at 866.457685s 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.150+0000 7ff1b1805640 1 -- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7ff1ac136d00 msgr2=0x7ff1ac1370e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3302/0 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b1004640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7ff1ac0a3d70 legacy=0x7ff1ac1339e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b1805640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7ff1ac136d00 0x7ff1ac1370e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1ac137620 0x7ff1ac1340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff1ac137620 0x7ff1ac1340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:44932/0 (socket says 172.21.15.28:44932) 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 -- 172.21.15.28:0/2980571161 learned_addr learned my addr 172.21.15.28:0/2980571161 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): get_auth_request con 0x7ff1ac137620 auth_method 0 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient(hunting): handle_auth_done global_id 4663 payload 274 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 -- 172.21.15.28:0/2980571161 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7ff1ac136d00 msgr2=0x7ff1ac1370e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 --2- 172.21.15.28:0/2980571161 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7ff1ac136d00 0x7ff1ac1370e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 -- 172.21.15.28:0/2980571161 >> v1:172.21.15.28:6789/0 conn(0x7ff1ac0a3d70 legacy=0x7ff1ac1339e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 monclient: found mon.noname-f 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 10 monclient: _send_mon_message to mon.noname-f at v2:172.21.15.63:3300/0 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.151+0000 7ff1b2006640 1 -- 172.21.15.28:0/2980571161 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0a1f60 con 0x7ff1ac137620 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b2006640 1 --2- 172.21.15.28:0/2980571161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac137620 0x7ff1ac1340f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009e50 tx=0x7ff1a402bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37b62372cecad4b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 1 -- 172.21.15.28:0/2980571161 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a402cbf0 con 0x7ff1ac137620 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: dump: 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.154 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 1 -- 172.21.15.28:0/2980571161 <== mon.1 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a402cd70 con 0x7ff1ac137620 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 1 -- 172.21.15.28:0/2980571161 <== mon.1 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a4034860 con 0x7ff1ac137620 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 5 monclient: authenticate success, global_id 4663 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 4 set_mon_vals no callback set 2024-03-27T21:30:44.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b0803640 10 monclient: dump: 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.156 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 10 monclient: shutdown 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 1 -- 172.21.15.28:0/2980571161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac137620 msgr2=0x7ff1ac1340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/2980571161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac137620 0x7ff1ac1340f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009e50 tx=0x7ff1a402bde0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 1 -- 172.21.15.28:0/2980571161 shutdown_connections 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/2980571161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1ac137620 0x7ff1ac1340f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/2980571161 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7ff1ac136d00 0x7ff1ac1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.152+0000 7ff1b3a69640 1 -- 172.21.15.28:0/2980571161 >> 172.21.15.28:0/2980571161 conn(0x7ff1ac0a9430 msgr2=0x7ff1ac0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 -- 172.21.15.28:0/2980571161 shutdown_connections 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 -- 172.21.15.28:0/2980571161 wait complete. 2024-03-27T21:30:44.157 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 10 monclient: build_initial_monmap 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 10 monclient: monmap: 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:44.158 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 librados: starting msgr at 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 librados: starting objecter 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 Processor -- start 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 -- start start 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 librados: setting wanted keys 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 1 librados: calling monclient init 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.153+0000 7ff1b3a69640 10 monclient: init 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient: _add_conns ranks=[8,6,2,5,3,0,1,4,7] 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 0x7ff1ac135340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): picked mon.noname-e con 0x7ff1ac0a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ff1ac136d00 0x7ff1ac135880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): picked mon.noname-d con 0x7ff1ac136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff1ac137620 0x7ff1ac11f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): picked mon.noname-b con 0x7ff1ac137620 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1cc310 con 0x7ff1ac137620 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1212d0 con 0x7ff1ac136d00 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0a1630 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b3a69640 10 monclient(hunting): authenticate will time out at 866.461131s 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 0x7ff1ac135340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff1ac137620 0x7ff1ac11f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff1ac137620 0x7ff1ac11f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:39226/0 (socket says 172.21.15.28:39226) 2024-03-27T21:30:44.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 0x7ff1ac135340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:41446/0 (socket says 172.21.15.28:41446) 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 1 -- 172.21.15.28:0/3028398560 learned_addr learned my addr 172.21.15.28:0/3028398560 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): get_auth_request con 0x7ff1ac137620 auth_method 0 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): get_auth_request con 0x7ff1ac0a3d70 auth_method 0 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ff1ac136d00 0x7ff1ac135880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): get_auth_request con 0x7ff1ac136d00 auth_method 0 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1004640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient(hunting): handle_auth_done global_id 4463 payload 824 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ff1ac136d00 msgr2=0x7ff1ac135880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7ff1ac136d00 0x7ff1ac135880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff1ac137620 msgr2=0x7ff1ac11f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff1ac137620 0x7ff1ac11f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 monclient: found mon.noname-e 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b1805640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a4009b30 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.154+0000 7ff1b2006640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7ff1ac137620 0x7ff1ac11f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b1805640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 0x7ff1ac135340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800b400 tx=0x7ff1a800b8c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 client.?.objecter ms_handle_connect 0x7ff1ac0a3d70 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a8003bc0 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: dump: 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.164 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a8003d60 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a80103a0 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 5 monclient: authenticate success, global_id 4463 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 10 monclient: _renew_subs 2024-03-27T21:30:44.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac122ad0 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a37fe640 4 set_mon_vals no callback set 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1a27fc640 10 monclient: dump: 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.166 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 10 monclient: _renew_subs 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac121010 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.155+0000 7ff1b3a69640 1 librados: init done 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7ff1a8005070 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b3a69640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ff19003a250 0x7ff19003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 0x7ff1ac1201c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac069c80 con 0x7ff1ac11fde0 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7ff1a8049090 con 0x7ff1ac0a3d70 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 10 client.4463.objecter ms_dispatch 0x7ff1ac000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 3 client.4463.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 3 client.4463.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 20 client.4463.objecter dump_active .. 0 homeless 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b1004640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ff19003a250 0x7ff19003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b1004640 10 monclient: get_auth_request con 0x7ff19003a250 auth_method 0 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 0x7ff1ac1201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient: get_auth_request con 0x7ff1ac11fde0 auth_method 0 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 10 monclient(hunting): handle_auth_done global_id 4548 payload 824 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b2006640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1ac122230 con 0x7ff1ac11fde0 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1a27fc640 10 client.4463.objecter ms_handle_connect 0x7ff19003a250 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.156+0000 7ff1b1004640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ff19003a250 0x7ff19003c710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac09edc0 tx=0x7ff19c0090e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 client.4463.objecter ms_handle_connect 0x7ff1ac11fde0 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 client.4463.objecter resend_mon_ops 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1b2006640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 0x7ff1ac1201c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac067230 tx=0x7ff1a4004a40 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a40048a0 con 0x7ff1ac11fde0 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 monclient: dump: 2024-03-27T21:30:44.169 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.170 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.3 v2:172.21.15.63:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7ff1a4009510 con 0x7ff1ac11fde0 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 msgr2=0x7ff1ac1201c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 0x7ff1ac1201c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac067230 tx=0x7ff1a4004a40 comp rx=0 tx=0).stop 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 msgr2=0x7ff1ac1201c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.157+0000 7ff1a27fc640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac11fde0 0x7ff1ac1201c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.173 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b3a69640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 0x7ff1ac09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b3a69640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac122c60 con 0x7ff1ac09aa10 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 0x7ff1ac09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient: get_auth_request con 0x7ff1ac09aa10 auth_method 0 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.163+0000 7ff1b2006640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b2006640 10 monclient(hunting): handle_auth_done global_id 4557 payload 824 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b2006640 1 -- 172.21.15.28:0/3028398560 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff1ac0a3020 con 0x7ff1ac09aa10 2024-03-27T21:30:44.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b2006640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 0x7ff1ac09ae20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40093e0 tx=0x7ff1a4009000 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 client.4463.objecter ms_handle_connect 0x7ff1ac09aa10 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 client.4463.objecter resend_mon_ops 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff1a40099b0 con 0x7ff1ac09aa10 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 monclient: dump: 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.175 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 <== mon.3 v2:172.21.15.63:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9485 (secure 0 0 0) 0x7ff1a403f920 con 0x7ff1ac09aa10 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 msgr2=0x7ff1ac09ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 0x7ff1ac09ae20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40093e0 tx=0x7ff1a4009000 comp rx=0 tx=0).stop 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 msgr2=0x7ff1ac09ae20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.176 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1a27fc640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7ff1ac09aa10 0x7ff1ac09ae20 secure :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff1a40093e0 tx=0x7ff1a4009000 comp rx=0 tx=0).stop 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:44.177 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 1, 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.178 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.180 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.181 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.182 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.183 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.184 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.185 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.186 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:44.187 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.188 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.189 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.190 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:44.191 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.192 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.193 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.194 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:44.195 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.196 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.197 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.198 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": [ 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:44.199 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 10 librados: watch_flush enter 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 10 librados: watch_flush exit 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 20 client.4463.objecter shutdown clearing up homeless session... 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 10 client.4463.objecter successfully canceled tick 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ff19003a250 msgr2=0x7ff19003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7ff19003a250 0x7ff19003c710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac09edc0 tx=0x7ff19c0090e0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 10 monclient: shutdown 2024-03-27T21:30:44.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.164+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 msgr2=0x7ff1ac135340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b2006640 1 -- 172.21.15.28:0/3028398560 reap_dead start 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 0x7ff1ac135340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff1a800b400 tx=0x7ff1a800b8c0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 shutdown_connections 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 --2- 172.21.15.28:0/3028398560 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7ff1ac0a3d70 0x7ff1ac135340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 >> 172.21.15.28:0/3028398560 conn(0x7ff1ac0a9430 msgr2=0x7ff1ac1becc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 shutdown_connections 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 -- 172.21.15.28:0/3028398560 wait complete. 2024-03-27T21:30:44.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.165+0000 7ff1b3a69640 1 librados: shutdown 2024-03-27T21:30:44.202 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:44.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-03-27T21:30:44.203 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.315+0000 7f13c4e74640 10 monclient: get_monmap_and_config 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.315+0000 7f13c4e74640 10 monclient: build_initial_monmap 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.315+0000 7f13c4e74640 10 monclient: monmap: 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:44.315994+0000 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:44.315994+0000 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:44.304 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:44.305 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.315+0000 7f13c4e74640 1 Processor -- start 2024-03-27T21:30:44.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.315+0000 7f13c4e74640 1 -- start start 2024-03-27T21:30:44.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.315+0000 7f13c4e74640 10 monclient: init 2024-03-27T21:30:44.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:44.315 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient: _add_conns ranks=[7,9,0,6,4,8,1,2,10,5,3] 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 0x7f13c0098900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): picked mon.noname-i con 0x7f13c0098520 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f13c009f480 0x7f13c00a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): picked mon.noname-a con 0x7f13c009f480 addr v2:172.21.15.28:3300/0 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f13c009f880 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c00618f0 con 0x7f13c009f880 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c009e0e0 con 0x7f13c009f480 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f13c009e5e0 con 0x7f13c0098520 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13c4e74640 10 monclient(hunting): authenticate will time out at 866.623194s 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13bed9d640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7f13c009f880 legacy=0x7f13c00a1590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:44.316 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13b7fff640 1 -- >> v2:172.21.15.28:3300/0 conn(0x7f13c009f480 msgr2=0x7f13c00a1050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13b7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f13c009f480 0x7f13c00a1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 0x7f13c0098900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 0x7f13c0098900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3303/0 says I am v2:172.21.15.28:48934/0 (socket says 172.21.15.28:48934) 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 1 -- 172.21.15.28:0/1444440255 learned_addr learned my addr 172.21.15.28:0/1444440255 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 10 monclient(hunting): get_auth_request con 0x7f13c0098520 auth_method 0 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.316+0000 7f13be59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 10 monclient(hunting): handle_auth_done global_id 4534 payload 274 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 1 -- 172.21.15.28:0/1444440255 >> v2:172.21.15.28:3300/0 conn(0x7f13c009f480 msgr2=0x7f13c00a1050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:44.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 1 --2- 172.21.15.28:0/1444440255 >> v2:172.21.15.28:3300/0 conn(0x7f13c009f480 0x7f13c00a1050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 1 -- 172.21.15.28:0/1444440255 >> v1:172.21.15.28:6789/0 conn(0x7f13c009f880 legacy=0x7f13c00a1590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 1 monclient: found mon.noname-i 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 1 -- 172.21.15.28:0/1444440255 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c009e8c0 con 0x7f13c0098520 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.317+0000 7f13be59c640 1 --2- 172.21.15.28:0/1444440255 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 0x7f13c0098900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098a0 tx=0x7f13b002b7f0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=4df6e76be1cc7fca server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 1 -- 172.21.15.28:0/1444440255 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13b00319c0 con 0x7f13c0098520 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: dump: 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.318 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 1 -- 172.21.15.28:0/1444440255 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0031b40 con 0x7f13c0098520 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 5 monclient: authenticate success, global_id 4534 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 1 -- 172.21.15.28:0/1444440255 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13b0031cf0 con 0x7f13c0098520 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 4 set_mon_vals no callback set 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13bdd9b640 10 monclient: dump: 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.320 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.321 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 10 monclient: shutdown 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 -- 172.21.15.28:0/1444440255 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 msgr2=0x7f13c0098900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 --2- 172.21.15.28:0/1444440255 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 0x7f13c0098900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13b00098a0 tx=0x7f13b002b7f0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 -- 172.21.15.28:0/1444440255 shutdown_connections 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 --2- 172.21.15.28:0/1444440255 >> v2:172.21.15.28:3300/0 conn(0x7f13c009f480 0x7f13c00a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 --2- 172.21.15.28:0/1444440255 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f13c0098520 0x7f13c0098900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 -- 172.21.15.28:0/1444440255 >> 172.21.15.28:0/1444440255 conn(0x7f13c00a5c40 msgr2=0x7f13c00a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 -- 172.21.15.28:0/1444440255 shutdown_connections 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.318+0000 7f13c4e74640 1 -- 172.21.15.28:0/1444440255 wait complete. 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 10 monclient: build_initial_monmap 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 10 monclient: monmap: 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:44.322 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:44.323 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 1 librados: starting msgr at 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 1 librados: starting objecter 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 1 Processor -- start 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 1 -- start start 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 1 librados: setting wanted keys 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 1 librados: calling monclient init 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.319+0000 7f13c4e74640 10 monclient: init 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient: _add_conns ranks=[2,0,3,6,8,1,5,7,4] 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f13c0098520 0x7f13c0096390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): picked mon.noname-b con 0x7f13c0098520 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13c009f480 0x7f13c00968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): picked mon.noname-a con 0x7f13c009f480 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f13c009f880 0x7f13c0130b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.324 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): picked mon.noname-g con 0x7f13c009f880 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c012d730 con 0x7f13c009f480 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0099100 con 0x7f13c0098520 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c01bb4e0 con 0x7f13c009f880 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13c4e74640 10 monclient(hunting): authenticate will time out at 866.627045s 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13b7fff640 1 -- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13c009f480 msgr2=0x7f13c00968d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.28:3300/0 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13b7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13c009f480 0x7f13c00968d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f13c0098520 0x7f13c0096390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f13c0098520 0x7f13c0096390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:39238/0 (socket says 172.21.15.28:39238) 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 -- 172.21.15.28:0/3778584052 learned_addr learned my addr 172.21.15.28:0/3778584052 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:44.325 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): get_auth_request con 0x7f13c0098520 auth_method 0 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient(hunting): handle_auth_done global_id 4520 payload 824 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f13c009f880 msgr2=0x7f13c0130b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13bed9d640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f13c009f880 0x7f13c0130b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f13c009f880 0x7f13c0130b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13c009f480 msgr2=0x7f13c00968d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f13c009f480 0x7f13c00968d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.326 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 monclient: found mon.noname-b 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00094d0 con 0x7f13c0098520 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13bed9d640 10 monclient: get_auth_request con 0x7f13c009f880 auth_method 0 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13bed9d640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f13c009f880 0x7f13c0130b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13be59c640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f13c0098520 0x7f13c0096390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13b6ffd640 10 client.?.objecter ms_handle_connect 0x7f13c0098520 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.320+0000 7f13b6ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13b0003a80 con 0x7f13c0098520 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: dump: 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.327 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.328 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 5 monclient: authenticate success, global_id 4520 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0003be0 con 0x7f13c0098520 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13b0003d50 con 0x7f13c0098520 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 10 monclient: _renew_subs 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c0132250 con 0x7f13c0098520 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13bd59a640 4 set_mon_vals no callback set 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13b6ffd640 10 monclient: dump: 2024-03-27T21:30:44.329 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.330 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 10 client.4520.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 10 monclient: _renew_subs 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c009b9c0 con 0x7f13c0098520 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.321+0000 7f13c4e74640 1 librados: init done 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f13b003a040 con 0x7f13c0098520 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13c4e74640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13c4e74640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 0x7f13c0131090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c006b5d0 con 0x7f13c009c090 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f13a003a250 0x7f13a003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f13b006c210 con 0x7f13c0098520 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 0x7f13c0131090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.331 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 client.4520.objecter ms_dispatch 0x7f13c0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 3 client.4520.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 3 client.4520.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient: get_auth_request con 0x7f13c009c090 auth_method 0 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13bed9d640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f13a003a250 0x7f13a003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 20 client.4520.objecter dump_active .. 0 homeless 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13bed9d640 10 monclient: get_auth_request con 0x7f13a003a250 auth_method 0 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 10 monclient(hunting): handle_auth_done global_id 4478 payload 824 2024-03-27T21:30:44.332 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13c0098e40 con 0x7f13c009c090 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13bed9d640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f13a003a250 0x7f13a003c710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13c0133df0 tx=0x7f13b8007320 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 client.4520.objecter ms_handle_connect 0x7f13a003a250 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 client.4520.objecter ms_handle_connect 0x7f13c009c090 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 client.4520.objecter resend_mon_ops 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b7fff640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 0x7f13c0131090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13c009d870 tx=0x7f13a800b810 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13a8005070 con 0x7f13c009c090 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.322+0000 7f13b6ffd640 10 monclient: dump: 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.333 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.5 v2:172.21.15.63:3302/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f13a8003aa0 con 0x7f13c009c090 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:44.334 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 msgr2=0x7f13c0131090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 0x7f13c0131090 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f13c009d870 tx=0x7f13a800b810 comp rx=0 tx=0).stop 2024-03-27T21:30:44.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 msgr2=0x7f13c0131090 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.335 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.323+0000 7f13b6ffd640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c009c090 0x7f13c0131090 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13c4e74640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13c4e74640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 0x7f13c01315d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13c4e74640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0073150 con 0x7f13c0133460 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 0x7f13c01315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient: get_auth_request con 0x7f13c0133460 auth_method 0 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.337 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.329+0000 7f13b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b7fff640 10 monclient(hunting): handle_auth_done global_id 4487 payload 824 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b7fff640 1 -- 172.21.15.28:0/3778584052 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f13c00a2b50 con 0x7f13c0133460 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 client.4520.objecter ms_handle_connect 0x7f13c0133460 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 client.4520.objecter resend_mon_ops 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b7fff640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 0x7f13c01315d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f13c009d870 tx=0x7f13a8005910 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f13a8003e10 con 0x7f13c0133460 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 monclient: dump: 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.338 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 <== mon.5 v2:172.21.15.63:3302/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9315 (secure 0 0 0) 0x7f13a80129a0 con 0x7f13c0133460 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:44.339 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 msgr2=0x7f13c01315d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 0x7f13c01315d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f13c009d870 tx=0x7f13a8005910 comp rx=0 tx=0).stop 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 msgr2=0x7f13c01315d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13b6ffd640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f13c0133460 0x7f13c01315d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:44.340 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 1, 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.341 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.342 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:44.343 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.344 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.345 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.346 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.347 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.349 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.350 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.351 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.352 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:44.353 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.354 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.355 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.356 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.357 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.358 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.359 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.360 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:44.361 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:44.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 10 librados: watch_flush enter 2024-03-27T21:30:44.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 10 librados: watch_flush exit 2024-03-27T21:30:44.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 20 client.4520.objecter shutdown clearing up homeless session... 2024-03-27T21:30:44.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 10 client.4520.objecter successfully canceled tick 2024-03-27T21:30:44.363 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f13a003a250 msgr2=0x7f13a003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f13a003a250 0x7f13a003c710 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f13c0133df0 tx=0x7f13b8007320 comp rx=0 tx=0).stop 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 10 monclient: shutdown 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f13c0098520 msgr2=0x7f13c0096390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 1 --2- 172.21.15.28:0/3778584052 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f13c0098520 0x7f13c0096390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13b0000c00 tx=0x7f13b00046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13bed9d640 1 -- 172.21.15.28:0/3778584052 reap_dead start 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13bed9d640 1 -- 172.21.15.28:0/3778584052 reap_dead start 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 shutdown_connections 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.330+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 >> 172.21.15.28:0/3778584052 conn(0x7f13c00a5c40 msgr2=0x7f13c00a4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.331+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 shutdown_connections 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.331+0000 7f13c4e74640 1 -- 172.21.15.28:0/3778584052 wait complete. 2024-03-27T21:30:44.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.331+0000 7f13c4e74640 1 librados: shutdown 2024-03-27T21:30:44.365 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:44.365 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-03-27T21:30:44.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.477+0000 7fc0ee7a9640 10 monclient: get_monmap_and_config 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.477+0000 7fc0ee7a9640 10 monclient: build_initial_monmap 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.477+0000 7fc0ee7a9640 10 monclient: monmap: 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:30:44.478173+0000 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:30:44.478173+0000 2024-03-27T21:30:44.466 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:30:44.467 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 Processor -- start 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 -- start start 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient: init 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient: _add_conns ranks=[8,0,3,9,10,4,5,1,2,7,6] 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 0x7fc0e81370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): picked mon.noname-e con 0x7fc0e8136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc0e80a3d70 addr v1:172.21.15.28:6789/0 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc0e8137620 0x7fc0e81340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): picked mon.noname-g con 0x7fc0e8137620 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e80618f0 con 0x7fc0e80a3d70 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80a25b0 con 0x7fc0e8137620 2024-03-27T21:30:44.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80a13f0 con 0x7fc0e8136d00 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ee7a9640 10 monclient(hunting): authenticate will time out at 866.785287s 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e77fe640 1 -- >> v1:172.21.15.28:6789/0 conn(0x7fc0e80a3d70 legacy=0x7fc0e81339e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.28:6789/0 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 0x7fc0e81370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 0x7fc0e81370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:41452/0 (socket says 172.21.15.28:41452) 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 1 -- 172.21.15.28:0/2525169788 learned_addr learned my addr 172.21.15.28:0/2525169788 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): get_auth_request con 0x7fc0e8136d00 auth_method 0 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc0e8137620 0x7fc0e81340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): get_auth_request con 0x7fc0e8137620 auth_method 0 2024-03-27T21:30:44.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_done global_id 4472 payload 274 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 1 -- 172.21.15.28:0/2525169788 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc0e8137620 msgr2=0x7fc0e81340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.478+0000 7fc0e7fff640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc0e8137620 0x7fc0e81340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 1 -- 172.21.15.28:0/2525169788 >> v1:172.21.15.28:6789/0 conn(0x7fc0e80a3d70 legacy=0x7fc0e81339e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 1 monclient: found mon.noname-e 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 1 -- 172.21.15.28:0/2525169788 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e80a1f60 con 0x7fc0e8136d00 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0ecd46640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc0e8137620 0x7fc0e81340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e7fff640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 0x7fc0e81370e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80098a0 tx=0x7fc0d802b7b0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=23823cf468d72240 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 1 -- 172.21.15.28:0/2525169788 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0d8031980 con 0x7fc0e8136d00 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: dump: 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.481 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0ee7a9640 5 monclient: authenticate success, global_id 4472 2024-03-27T21:30:44.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 1 -- 172.21.15.28:0/2525169788 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d802f050 con 0x7fc0e8136d00 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0ee7a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0ee7a9640 10 monclient: get_monmap_and_config success 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 1 -- 172.21.15.28:0/2525169788 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0d80323a0 con 0x7fc0e8136d00 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0ee7a9640 4 set_mon_vals no callback set 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.479+0000 7fc0e6ffd640 10 monclient: dump: 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.483 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 10 monclient: shutdown 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/2525169788 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 msgr2=0x7fc0e81370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 0x7fc0e81370e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0d80098a0 tx=0x7fc0d802b7b0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/2525169788 shutdown_connections 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fc0e8137620 0x7fc0e81340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/2525169788 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fc0e8136d00 0x7fc0e81370e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/2525169788 >> 172.21.15.28:0/2525169788 conn(0x7fc0e80a9430 msgr2=0x7fc0e80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/2525169788 shutdown_connections 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/2525169788 wait complete. 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.480+0000 7fc0ee7a9640 10 monclient: build_initial_monmap 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient: monmap: 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:30:44.485 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 librados: starting msgr at 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 librados: starting objecter 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 Processor -- start 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 -- start start 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 librados: setting wanted keys 2024-03-27T21:30:44.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 librados: calling monclient init 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient: init 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient: _add_conns ranks=[7,1,5,3,6,2,4,8,0] 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e80a3d70 0x7fc0e8121340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): picked mon.noname-i con 0x7fc0e80a3d70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0e8136d00 0x7fc0e81c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): picked mon.noname-f con 0x7fc0e8136d00 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fc0e8137620 0x7fc0e8135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): picked mon.noname-h con 0x7fc0e8137620 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e81222a0 con 0x7fc0e8136d00 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8120c80 con 0x7fc0e8137620 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80a1630 con 0x7fc0e80a3d70 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.481+0000 7fc0ee7a9640 10 monclient(hunting): authenticate will time out at 866.788683s 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fc0e8137620 0x7fc0e8135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0e8136d00 0x7fc0e81c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e80a3d70 0x7fc0e8121340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fc0e8137620 0x7fc0e8135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.28:52822/0 (socket says 172.21.15.28:52822) 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 -- 172.21.15.28:0/1509360027 learned_addr learned my addr 172.21.15.28:0/1509360027 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): get_auth_request con 0x7fc0e8137620 auth_method 0 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): get_auth_request con 0x7fc0e80a3d70 auth_method 0 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): get_auth_request con 0x7fc0e8136d00 auth_method 0 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient(hunting): handle_auth_done global_id 4496 payload 824 2024-03-27T21:30:44.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e80a3d70 msgr2=0x7fc0e8121340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e80a3d70 0x7fc0e8121340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0e8136d00 msgr2=0x7fc0e81c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0e8136d00 0x7fc0e81c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient: _finish_hunting 0 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 monclient: found mon.noname-h 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0009a70 con 0x7fc0e8137620 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e77fe640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc0e8136d00 0x7fc0e81c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0ecd46640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fc0e8137620 0x7fc0e8135180 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009db0 tx=0x7fc0e000c490 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e4ff9640 10 client.?.objecter ms_handle_connect 0x7fc0e8137620 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e4ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.482+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0e0009c20 con 0x7fc0e8137620 2024-03-27T21:30:44.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: dump: 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.491 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: _finish_auth 0 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 5 monclient: authenticate success, global_id 4496 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e000f040 con 0x7fc0e8137620 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0e0014d80 con 0x7fc0e8137620 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e67fc640 4 set_mon_vals no callback set 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 10 monclient: dump: 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.492 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 10 monclient: _renew_subs 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d80094d0 con 0x7fc0e8137620 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 10 client.4496.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 10 monclient: _renew_subs 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 10 monclient: _send_mon_message to mon.h at v2:172.21.15.63:3302/0 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e81c8730 con 0x7fc0e8137620 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 1 librados: init done 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.5 v2:172.21.15.63:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fc0e000cd30 con 0x7fc0e8137620 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.483+0000 7fc0ee7a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 0x7fc0e81cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e80a0790 con 0x7fc0e81356c0 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc0d403a250 0x7fc0d403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.5 v2:172.21.15.63:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fc0e004a6e0 con 0x7fc0e8137620 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 client.4496.objecter ms_dispatch 0x7fc0e8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 3 client.4496.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 3 client.4496.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 0x7fc0e81cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient: get_auth_request con 0x7fc0e81356c0 auth_method 0 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e77fe640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc0d403a250 0x7fc0d403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e77fe640 10 monclient: get_auth_request con 0x7fc0d403a250 auth_method 0 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 20 client.4496.objecter dump_active .. 0 homeless 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_done global_id 4552 payload 824 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0e80a3020 con 0x7fc0e81356c0 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 client.4496.objecter ms_handle_connect 0x7fc0d403a250 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e77fe640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc0d403a250 0x7fc0d403c710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0e809f470 tx=0x7fc0dc0090e0 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 client.4496.objecter ms_handle_connect 0x7fc0e81356c0 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 client.4496.objecter resend_mon_ops 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e7fff640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 0x7fc0e81cbeb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80a2f90 tx=0x7fc0d80046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0d8003ea0 con 0x7fc0e81356c0 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.484+0000 7fc0e4ff9640 10 monclient: dump: 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.496 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.7 v2:172.21.15.63:3303/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fc0d8004500 con 0x7fc0e81356c0 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:30:44.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:30:44.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 msgr2=0x7fc0e81cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 0x7fc0e81cbeb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80a2f90 tx=0x7fc0d80046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 msgr2=0x7fc0e81cbeb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.485+0000 7fc0e4ff9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e81356c0 0x7fc0e81cbeb0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80a2f90 tx=0x7fc0d80046c0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0ee7a9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 0x7fc0e802b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0ee7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e8069c80 con 0x7fc0e802b170 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 0x7fc0e802b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient: get_auth_request con 0x7fc0e802b170 auth_method 0 2024-03-27T21:30:44.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 10 monclient(hunting): handle_auth_done global_id 4561 payload 824 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.491+0000 7fc0e7fff640 1 -- 172.21.15.28:0/1509360027 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc0e8137ad0 con 0x7fc0e802b170 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e7fff640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 0x7fc0e802b580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8000c00 tx=0x7fc0d8009240 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 client.4496.objecter ms_handle_connect 0x7fc0e802b170 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 client.4496.objecter resend_mon_ops 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fc0d8047c80 con 0x7fc0e802b170 2024-03-27T21:30:44.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 monclient: dump: 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:30:44.502 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 <== mon.7 v2:172.21.15.63:3303/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9145 (secure 0 0 0) 0x7fc0d8047de0 con 0x7fc0e802b170 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 msgr2=0x7fc0e802b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 0x7fc0e802b580 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8000c00 tx=0x7fc0d8009240 comp rx=0 tx=0).stop 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 msgr2=0x7fc0e802b580 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:30:44.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0e4ff9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fc0e802b170 0x7fc0e802b580 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 18, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:30:44.504 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 1, 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.505 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.506 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:30:44.507 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:30:44.508 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.509 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.510 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.511 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:30:44.512 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.513 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.514 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.515 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.516 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.517 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.518 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.519 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.520 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:30:44.521 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.522 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.523 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:30:44.524 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:30:44.525 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:30:44.525 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 10 librados: watch_flush enter 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 10 librados: watch_flush exit 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 20 client.4496.objecter shutdown clearing up homeless session... 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 10 client.4496.objecter successfully canceled tick 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc0d403a250 msgr2=0x7fc0d403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fc0d403a250 0x7fc0d403c710 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0e809f470 tx=0x7fc0dc0090e0 comp rx=0 tx=0).stop 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 10 monclient: shutdown 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fc0e8137620 msgr2=0x7fc0e8135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 --2- 172.21.15.28:0/1509360027 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fc0e8137620 0x7fc0e8135180 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009db0 tx=0x7fc0e000c490 comp rx=0 tx=0).stop 2024-03-27T21:30:44.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ecd46640 1 -- 172.21.15.28:0/1509360027 reap_dead start 2024-03-27T21:30:44.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ecd46640 1 -- 172.21.15.28:0/1509360027 reap_dead start 2024-03-27T21:30:44.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 shutdown_connections 2024-03-27T21:30:44.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 >> 172.21.15.28:0/1509360027 conn(0x7fc0e80a9430 msgr2=0x7fc0e80a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:30:44.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 shutdown_connections 2024-03-27T21:30:44.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.492+0000 7fc0ee7a9640 1 -- 172.21.15.28:0/1509360027 wait complete. 2024-03-27T21:30:44.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:30:44.493+0000 7fc0ee7a9640 1 librados: shutdown 2024-03-27T21:30:44.528 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-03-27T21:30:44.528 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-03-27T21:31:19.242 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 97% (11815/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-03-27T21:31:19.270 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-27T21:31:19.271 INFO:tasks.workunit.client.0.smithi063.stderr:fatal: reference is not a tree: 7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:31:19.271 INFO:tasks.workunit:failed to check out '7c37d80f7a88f4eb561c4fe02558660a650b10ac' from https://github.com/ceph/ceph-ci.git; will also try in https://github.com/ceph/ceph.git 2024-03-27T21:31:19.271 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:31:19.539 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-27T21:32:13.640 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-27T21:32:13.641 INFO:tasks.workunit.client.0.smithi063.stderr:fatal: reference is not a tree: 7c37d80f7a88f4eb561c4fe02558660a650b10ac 2024-03-27T21:32:13.641 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks/workunit.py", line 360, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac' 2024-03-27T21:32:13.930 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=478edac61e49456c8d770bd701f809b7 Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks/workunit.py", line 345, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_7c37d80f7a88f4eb561c4fe02558660a650b10ac/qa/tasks/workunit.py", line 360, in _run_tests remote.run(logger=log.getChild(role), File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac' 2024-03-27T21:32:13.933 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-03-27T21:32:13.947 INFO:tasks.mon_thrash:joining mon_thrasher 2024-03-27T21:32:14.530 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-03-27T21:32:14.530 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-03-27T21:32:14.530 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-27T21:32:14.530 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-27T21:32:14.533 INFO:tasks.ceph.mon.a:Started 2024-03-27T21:32:14.533 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-03-27T21:32:14.534 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-03-27T21:32:14.534 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-27T21:32:14.534 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-27T21:32:14.536 INFO:tasks.ceph.mon.c:Started 2024-03-27T21:32:14.536 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-03-27T21:32:14.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:32:14.632 INFO:tasks.ceph.mon.a.smithi028.stderr:2024-03-27T21:32:14.644+0000 7f8079952b00 -1 mon.a@-1(???).log v0 log_external_backlog rewinding external_log_to from 19 -> 0 (sync_force? mon rebuild?) 2024-03-27T21:32:14.633 INFO:tasks.ceph.mon.c.smithi028.stderr:2024-03-27T21:32:14.644+0000 7f1905e47b00 -1 mon.c@-1(???).log v0 log_external_backlog rewinding external_log_to from 19 -> 0 (sync_force? mon rebuild?) 2024-03-27T21:32:14.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.663+0000 7fa63b9f6640 10 monclient: get_monmap_and_config 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.663+0000 7fa63b9f6640 10 monclient: build_initial_monmap 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.663+0000 7fa63b9f6640 10 monclient: monmap: 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:14.664413+0000 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:14.664413+0000 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:14.652 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:14.653 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:14.654 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:14.654 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:14.654 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:14.654 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 1 Processor -- start 2024-03-27T21:32:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 1 -- start start 2024-03-27T21:32:14.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 10 monclient: init 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 10 monclient: _add_conns ranks=[8,9,1,0,7,4,3,5,6,2,10] 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 0x7fa634070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 10 monclient(hunting): picked mon.noname-e con 0x7fa634131c70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.664+0000 7fa63b9f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 0x7fa634134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 10 monclient(hunting): picked mon.noname-a con 0x7fa634132050 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 0x7fa634070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:14.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa6341324b0 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6340618f0 con 0x7fa6341324b0 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6340a1b20 con 0x7fa634132050 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 0x7fa634070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42158/0 (socket says 172.21.15.28:42158) 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340706e0 con 0x7fa634131c70 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 -- 172.21.15.28:0/436436732 learned_addr learned my addr 172.21.15.28:0/436436732 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:14.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa63b9f6640 10 monclient(hunting): authenticate will time out at 956.971811s 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): get_auth_request con 0x7fa634131c70 auth_method 0 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:14.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 1 --2- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 0x7fa634134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 10 monclient(hunting): get_auth_request con 0x7fa634132050 auth_method 0 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient(hunting): handle_auth_done global_id 4481 payload 274 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 1 -- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 msgr2=0x7fa634134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 -- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 msgr2=0x7fa634134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 1 -- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 msgr2=0x7fa634134ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:32:14.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 1 --2- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 0x7fa634134ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa638f91640 1 --2- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 0x7fa634134ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 --2- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 0x7fa634134ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 -- 172.21.15.28:0/436436732 >> v1:172.21.15.63:6789/0 conn(0x7fa6341324b0 legacy=0x7fa634135000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient: _finish_hunting 0 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 monclient: found mon.noname-e 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:14.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.665+0000 7fa639792640 1 -- 172.21.15.28:0/436436732 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340712f0 con 0x7fa634131c70 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa639792640 1 --2- 172.21.15.28:0/436436732 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 0x7fa634070db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6300098a0 tx=0x7fa63002b860 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1992acc072cccd07 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 1 -- 172.21.15.28:0/436436732 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa630031a30 con 0x7fa634131c70 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: dump: 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:14.670 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:14.671 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: _finish_auth 0 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:14.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 5 monclient: authenticate success, global_id 4481 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 1 -- 172.21.15.28:0/436436732 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630031bb0 con 0x7fa634131c70 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 1 -- 172.21.15.28:0/436436732 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa630031d60 con 0x7fa634131c70 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 4 set_mon_vals no callback set 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:14.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa62bfff640 10 monclient: dump: 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:14.674 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:14.675 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 10 monclient: shutdown 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 1 -- 172.21.15.28:0/436436732 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 msgr2=0x7fa634070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.666+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/436436732 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 0x7fa634070db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa6300098a0 tx=0x7fa63002b860 comp rx=0 tx=0).stop 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 -- 172.21.15.28:0/436436732 shutdown_connections 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/436436732 >> v2:172.21.15.28:3300/0 conn(0x7fa634132050 0x7fa634134ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/436436732 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa634131c70 0x7fa634070db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 -- 172.21.15.28:0/436436732 >> 172.21.15.28:0/436436732 conn(0x7fa6340a44a0 msgr2=0x7fa634069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 -- 172.21.15.28:0/436436732 shutdown_connections 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 -- 172.21.15.28:0/436436732 wait complete. 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 10 monclient: build_initial_monmap 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 10 monclient: monmap: 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:14.677 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:14.678 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 librados: starting msgr at 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.667+0000 7fa63b9f6640 1 librados: starting objecter 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 Processor -- start 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 -- start start 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 librados: setting wanted keys 2024-03-27T21:32:14.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 librados: calling monclient init 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient: init 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient: _add_conns ranks=[7,0,2,5,4,6,8,3,1] 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa634131c70 0x7fa6341cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): picked mon.noname-i con 0x7fa634131c70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): picked mon.noname-a con 0x7fa634132050 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6341324b0 0x7fa634123930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:14.680 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): picked mon.noname-b con 0x7fa6341324b0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63406f610 con 0x7fa634132050 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa634125980 con 0x7fa6341324b0 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa634127180 con 0x7fa634131c70 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:14.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa63b9f6640 10 monclient(hunting): authenticate will time out at 956.975550s 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639f93640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6341324b0 0x7fa634123930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639792640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa634131c70 0x7fa6341cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53020/0 (socket says 172.21.15.28:53020) 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 1 -- 172.21.15.28:0/2505098809 learned_addr learned my addr 172.21.15.28:0/2505098809 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 10 monclient(hunting): get_auth_request con 0x7fa634132050 auth_method 0 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:14.682 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa638f91640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639f93640 10 monclient(hunting): get_auth_request con 0x7fa6341324b0 auth_method 0 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639f93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639f93640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639f93640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639792640 10 monclient(hunting): get_auth_request con 0x7fa634131c70 auth_method 0 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639792640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639792640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:14.683 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.668+0000 7fa639792640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa638f91640 1 -- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 msgr2=0x7fa6341233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa638f91640 1 -- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 msgr2=0x7fa6341233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa638f91640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639792640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:14.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639792640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639792640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa638f91640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 10 monclient(hunting): handle_auth_done global_id 4529 payload 824 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 -- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa634131c70 msgr2=0x7fa6341cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa634131c70 0x7fa6341cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 -- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 msgr2=0x7fa6341233f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 10 monclient: _finish_hunting 0 2024-03-27T21:32:14.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 monclient: found mon.noname-b 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 -- 172.21.15.28:0/2505098809 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300094d0 con 0x7fa6341324b0 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa639f93640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6341324b0 0x7fa634123930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c700 tx=0x7fa62c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 client.?.objecter ms_handle_connect 0x7fa6341324b0 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:14.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa62c0016e0 con 0x7fa6341324b0 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: dump: 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:14.687 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:14.688 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62c003de0 con 0x7fa6341324b0 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa62c005540 con 0x7fa6341324b0 2024-03-27T21:32:14.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa629ffb640 10 monclient: dump: 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:14.690 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:14.691 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa62b7fe640 4 set_mon_vals no callback set 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 5 monclient: authenticate success, global_id 4529 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 10 monclient: _renew_subs 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6341268e0 con 0x7fa6341324b0 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 10 client.4529.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:14.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 10 monclient: _renew_subs 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.669+0000 7fa63b9f6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634127b60 con 0x7fa6341324b0 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa63b9f6640 1 librados: init done 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa62c0056a0 con 0x7fa6341324b0 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa61803a250 0x7fa61803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa62c049a80 con 0x7fa6341324b0 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 10 client.4529.objecter ms_dispatch 0x7fa634000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:14.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 3 client.4529.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 3 client.4529.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa629ffb640 20 client.4529.objecter dump_active .. 0 homeless 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa63b9f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa639792640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa61803a250 0x7fa61803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa63b9f6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa63b9f6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.670+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa634067320 con 0x7fa6341324b0 2024-03-27T21:32:14.694 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.671+0000 7fa639792640 10 monclient: get_auth_request con 0x7fa61803a250 auth_method 0 2024-03-27T21:32:14.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.671+0000 7fa639792640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa61803a250 0x7fa61803c710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa630036000 tx=0x7fa63003d040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:14.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.671+0000 7fa629ffb640 10 client.4529.objecter ms_handle_connect 0x7fa61803a250 2024-03-27T21:32:14.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.675+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa62c011de0 con 0x7fa6341324b0 2024-03-27T21:32:14.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.675+0000 7fa629ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:14.695 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.675+0000 7fa629ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:14.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.936+0000 7fa63b9f6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:32:14.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.937+0000 7fa63b9f6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:32:14.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.937+0000 7fa63b9f6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:14.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.937+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa634074b50 con 0x7fa6341324b0 2024-03-27T21:32:14.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.937+0000 7fa629ffb640 1 -- 172.21.15.28:0/2505098809 <== mon.2 v2:172.21.15.28:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3159 (secure 0 0 0) 0x7fa62c011380 con 0x7fa6341324b0 2024-03-27T21:32:14.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.937+0000 7fa629ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:32:14.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.937+0000 7fa629ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:14.926 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":20,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:32:14.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 10 librados: watch_flush enter 2024-03-27T21:32:14.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 10 librados: watch_flush exit 2024-03-27T21:32:14.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 20 client.4529.objecter shutdown clearing up homeless session... 2024-03-27T21:32:14.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 10 client.4529.objecter successfully canceled tick 2024-03-27T21:32:14.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa61803a250 msgr2=0x7fa61803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:14.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa61803a250 0x7fa61803c710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa630036000 tx=0x7fa63003d040 comp rx=0 tx=0).stop 2024-03-27T21:32:14.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 10 monclient: shutdown 2024-03-27T21:32:14.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:14.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6341324b0 msgr2=0x7fa634123930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:14.929 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6341324b0 0x7fa634123930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa62c00c700 tx=0x7fa62c00cbc0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 shutdown_connections 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa61803a250 0x7fa61803c710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa6341324b0 0x7fa634123930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa634132050 0x7fa6341233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 --2- 172.21.15.28:0/2505098809 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa634131c70 0x7fa6341cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 >> 172.21.15.28:0/2505098809 conn(0x7fa6340a44a0 msgr2=0x7fa63406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:14.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 shutdown_connections 2024-03-27T21:32:14.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 -- 172.21.15.28:0/2505098809 wait complete. 2024-03-27T21:32:14.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:14.939+0000 7fa63b9f6640 1 librados: shutdown 2024-03-27T21:32:14.938 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-03-27T21:32:14.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-03-27T21:32:14.939 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-03-27T21:32:15.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.051+0000 7f8143054640 10 monclient: get_monmap_and_config 2024-03-27T21:32:15.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.051+0000 7f8143054640 10 monclient: build_initial_monmap 2024-03-27T21:32:15.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.051+0000 7f8143054640 10 monclient: monmap: 2024-03-27T21:32:15.055 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:15.055 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:15.052535+0000 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:15.052535+0000 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:15.056 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:15.057 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:15.058 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:15.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 1 Processor -- start 2024-03-27T21:32:15.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 1 -- start start 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient: init 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient: _add_conns ranks=[4,3,1,8,10,2,9,5,6,0,7] 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient(hunting): picked mon.noname-c con 0x7f813c136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f813c0a3d70 0x7f813c137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient(hunting): picked mon.noname-g con 0x7f813c0a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f813c1339e0 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:15.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c0618f0 con 0x7f813c1339e0 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.052+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8143054640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a25b0 con 0x7f813c0a3d70 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8143054640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f813c137b60 con 0x7f813c136d00 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8143054640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8143054640 10 monclient(hunting): authenticate will time out at 957.359736s 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:36720/0 (socket says 172.21.15.28:36720) 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 -- 172.21.15.28:0/1662774652 learned_addr learned my addr 172.21.15.28:0/1662774652 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 10 monclient(hunting): get_auth_request con 0x7f813c136d00 auth_method 0 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 -- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 msgr2=0x7f813c1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 -- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 msgr2=0x7f813c1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:15.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f8140df0640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f813c0a3d70 0x7f813c137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): get_auth_request con 0x7f813c0a3d70 auth_method 0 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:15.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813b7fe640 1 -- 172.21.15.28:0/1662774652 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274219374 0 0) 0x7f813c0618f0 con 0x7f813c1339e0 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient(hunting): handle_auth_done global_id 4575 payload 274 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 1 -- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 msgr2=0x7f813c1370e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 1 -- 172.21.15.28:0/1662774652 >> v1:172.21.15.63:6789/0 conn(0x7f813c1339e0 legacy=0x7f813c133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 1 monclient: found mon.noname-g 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:15.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813bfff640 1 -- 172.21.15.28:0/1662774652 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0a13f0 con 0x7f813c0a3d70 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.053+0000 7f813b7fe640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813bfff640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f813c0a3d70 0x7f813c137620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8130009800 tx=0x7f813002b760 comp rx=0 tx=0).ready entity=mon.3 client_cookie=e1eaa3abdf97cbf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 1 -- 172.21.15.28:0/1662774652 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f81300044a0 con 0x7f813c0a3d70 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: dump: 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:15.064 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:15.065 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: _finish_auth 0 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:32:15.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 1 -- 172.21.15.28:0/1662774652 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813002e050 con 0x7f813c0a3d70 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 1 -- 172.21.15.28:0/1662774652 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8130003a80 con 0x7f813c0a3d70 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f8143054640 5 monclient: authenticate success, global_id 4575 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f8143054640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f8143054640 4 set_mon_vals no callback set 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:15.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:32:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.054+0000 7f813b7fe640 10 monclient: dump: 2024-03-27T21:32:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.068 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:15.069 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 10 monclient: shutdown 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 -- 172.21.15.28:0/1662774652 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f813c0a3d70 msgr2=0x7f813c137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f813c0a3d70 0x7f813c137620 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8130009800 tx=0x7f813002b760 comp rx=0 tx=0).stop 2024-03-27T21:32:15.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 -- 172.21.15.28:0/1662774652 shutdown_connections 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f813c0a3d70 0x7f813c137620 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 --2- 172.21.15.28:0/1662774652 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f813c136d00 0x7f813c1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 -- 172.21.15.28:0/1662774652 >> 172.21.15.28:0/1662774652 conn(0x7f813c0a9430 msgr2=0x7f813c0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 -- 172.21.15.28:0/1662774652 shutdown_connections 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 1 -- 172.21.15.28:0/1662774652 wait complete. 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 10 monclient: build_initial_monmap 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.055+0000 7f8143054640 10 monclient: monmap: 2024-03-27T21:32:15.071 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:15.072 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 librados: starting msgr at 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 librados: starting objecter 2024-03-27T21:32:15.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 Processor -- start 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 -- start start 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 librados: setting wanted keys 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 librados: calling monclient init 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient: init 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient: _add_conns ranks=[6,2,1,3,4,5,7,8,0] 2024-03-27T21:32:15.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 0x7f813c1cb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): picked mon.noname-d con 0x7f813c0a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f813c1339e0 0x7f813c132c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): picked mon.noname-b con 0x7f813c1339e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c136d00 0x7f813c09c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): picked mon.noname-f con 0x7f813c136d00 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:15.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c120090 con 0x7f813c136d00 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a16a0 con 0x7f813c1339e0 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f813c0a11e0 con 0x7f813c0a3d70 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8143054640 10 monclient(hunting): authenticate will time out at 957.363544s 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 0x7f813c1cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f813bfff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f813c1339e0 0x7f813c132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 0x7f813c1cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:46206/0 (socket says 172.21.15.28:46206) 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 1 -- 172.21.15.28:0/119508314 learned_addr learned my addr 172.21.15.28:0/119508314 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 10 monclient(hunting): get_auth_request con 0x7f813c0a3d70 auth_method 0 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f8140df0640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f813bfff640 10 monclient(hunting): get_auth_request con 0x7f813c1339e0 auth_method 0 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f813bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f813bfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.056+0000 7f813bfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:15.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f813bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f813bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f813bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c136d00 0x7f813c09c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): get_auth_request con 0x7f813c136d00 auth_method 0 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:15.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 10 monclient(hunting): handle_auth_done global_id 4533 payload 824 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f813c1339e0 msgr2=0x7f813c132c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f813c1339e0 0x7f813c132c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c136d00 msgr2=0x7f813c09c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c136d00 0x7f813c09c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:15.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 10 monclient: _finish_hunting 0 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 monclient: found mon.noname-d 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8130009400 con 0x7f813c0a3d70 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f813bfff640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f813c1339e0 0x7f813c132c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8140df0640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 0x7f813c1cb020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f812c00e810 tx=0x7f812c00ecd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:15.081 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 client.?.objecter ms_handle_connect 0x7f813c0a3d70 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f812c00ee00 con 0x7f813c0a3d70 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: dump: 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.082 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:15.083 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: _finish_auth 0 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: _check_auth_tickets 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 5 monclient: authenticate success, global_id 4533 2024-03-27T21:32:15.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00cb40 con 0x7f813c0a3d70 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 10 monclient: _renew_subs 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c09e4b0 con 0x7f813c0a3d70 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f812c00ccb0 con 0x7f813c0a3d70 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:15.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f81397fa640 10 monclient: dump: 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:15.086 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:15.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 10 client.4533.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f813affd640 4 set_mon_vals no callback set 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 10 monclient: _renew_subs 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c09f2a0 con 0x7f813c0a3d70 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.057+0000 7f8143054640 1 librados: init done 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f812c00c670 con 0x7f813c0a3d70 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f812803a280 0x7f812803c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f812c0498f0 con 0x7f813c0a3d70 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 10 client.4533.objecter ms_dispatch 0x7f813c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f8143054640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 3 client.4533.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 3 client.4533.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f8143054640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c1203a0 con 0x7f813c1331b0 2024-03-27T21:32:15.089 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81397fa640 20 client.4533.objecter dump_active .. 0 homeless 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f813bfff640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f812803a280 0x7f812803c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f813c1331b0 auth_method 0 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f813bfff640 10 monclient: get_auth_request con 0x7f812803a280 auth_method 0 2024-03-27T21:32:15.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:15.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:15.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:15.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.058+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:15.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.059+0000 7f813bfff640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f812803a280 0x7f812803c740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8130034000 tx=0x7f8130008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:15.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.059+0000 7f81397fa640 10 client.4533.objecter ms_handle_connect 0x7f812803a280 2024-03-27T21:32:15.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f813c1331b0 auth_method 0 2024-03-27T21:32:15.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:15.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:15.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:15.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:15.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.259+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:32:15.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:15.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f813c1331b0 auth_method 0 2024-03-27T21:32:15.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:15.660+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T21:32:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.461+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.461+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f813c1331b0 auth_method 0 2024-03-27T21:32:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.461+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.461+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.461+0000 7f81415f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.461+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.462+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.462+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:16.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:16.462+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T21:32:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.056+0000 7f8123fff640 10 monclient: tick 2024-03-27T21:32:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.056+0000 7f8123fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.056+0000 7f8123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:18.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.056+0000 7f8123fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:18.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:18.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f813c1331b0 auth_method 0 2024-03-27T21:32:18.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:18.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:18.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:18.064+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-27T21:32:19.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 10 monclient: tick 2024-03-27T21:32:19.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:19.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:19.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 5 monclient: _check_tell_commands timeout tell command 1 2024-03-27T21:32:19.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 msgr2=0x7f813c09cf30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c1331b0 0x7f813c09cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f8123fff640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c1203a0 con 0x7f8114003540 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f8114003540 auth_method 0 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 msgr2=0x7f8114005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 msgr2=0x7f8114005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:19.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.057+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:19.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f8114003540 auth_method 0 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 msgr2=0x7f8114005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 msgr2=0x7f8114005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:19.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.258+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T21:32:19.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f8114003540 auth_method 0 2024-03-27T21:32:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 10 monclient(hunting): handle_auth_done global_id 34101 payload 824 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81140060e0 con 0x7f8114003540 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8134003fd0 tx=0x7f8134001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81397fa640 10 client.4533.objecter ms_handle_connect 0x7f8114003540 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81397fa640 10 client.4533.objecter resend_mon_ops 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f813401c070 con 0x7f8114003540 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81397fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.659+0000 7f81397fa640 10 monclient: dump: 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.652 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.653 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.0 v2:172.21.15.28:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f8134017b90 con 0x7f8114003540 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 msgr2=0x7f8114005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8134003fd0 tx=0x7f8134001f90 comp rx=0 tx=0).stop 2024-03-27T21:32:19.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 msgr2=0x7f8114005a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:19.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.660+0000 7f81397fa640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8114003540 0x7f8114005a00 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8134003fd0 tx=0x7f8134001f90 comp rx=0 tx=0).stop 2024-03-27T21:32:19.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f8143054640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:19.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f8143054640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 0x7f813c0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f8143054640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c069c80 con 0x7f813c09d470 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 0x7f813c0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient: get_auth_request con 0x7f813c09d470 auth_method 0 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 10 monclient(hunting): handle_auth_done global_id 34110 payload 824 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f813c0a2240 con 0x7f813c09d470 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81415f1640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 0x7f813c0a7050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8134003fd0 tx=0x7f8134007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81397fa640 10 client.4533.objecter ms_handle_connect 0x7f813c09d470 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81397fa640 10 client.4533.objecter resend_mon_ops 2024-03-27T21:32:19.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f8134017e40 con 0x7f813c09d470 2024-03-27T21:32:19.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81397fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:19.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.667+0000 7f81397fa640 10 monclient: dump: 2024-03-27T21:32:19.660 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.660 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.660 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.661 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.662 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.662 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.662 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.662 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.663 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 <== mon.0 v2:172.21.15.28:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9167 (secure 0 0 0) 0x7f813402a650 con 0x7f813c09d470 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 msgr2=0x7f813c0a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 0x7f813c0a7050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8134003fd0 tx=0x7f8134007f50 comp rx=0 tx=0).stop 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 msgr2=0x7f813c0a7050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81397fa640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f813c09d470 0x7f813c0a7050 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8134003fd0 tx=0x7f8134007f50 comp rx=0 tx=0).stop 2024-03-27T21:32:19.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f81415f1640 1 -- 172.21.15.28:0/119508314 reap_dead start 2024-03-27T21:32:19.665 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:19.665 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:19.665 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:19.666 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:19.666 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:19.666 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:19.666 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:19.666 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:19.666 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 4, 2024-03-27T21:32:19.667 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:19.668 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:19.669 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:19.670 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:19.671 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:19.672 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:19.673 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.674 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.675 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:19.676 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.677 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.678 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.680 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.681 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.682 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.683 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.684 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:19.685 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.686 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.687 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.688 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.689 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.690 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.691 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.692 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.693 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.694 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.695 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.696 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.697 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:19.698 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.699 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.700 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.701 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.702 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:19.702 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 10 librados: watch_flush enter 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 10 librados: watch_flush exit 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 20 client.4533.objecter shutdown clearing up homeless session... 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 10 client.4533.objecter successfully canceled tick 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f812803a280 msgr2=0x7f812803c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f812803a280 0x7f812803c740 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8130034000 tx=0x7f8130008030 comp rx=0 tx=0).stop 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 10 monclient: shutdown 2024-03-27T21:32:19.704 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 msgr2=0x7f813c1cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 0x7f813c1cb020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f812c00e810 tx=0x7f812c00ecd0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 shutdown_connections 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f812803a280 0x7f812803c740 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 --2- 172.21.15.28:0/119508314 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f813c0a3d70 0x7f813c1cb020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 >> 172.21.15.28:0/119508314 conn(0x7f813c0a9430 msgr2=0x7f813c0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 shutdown_connections 2024-03-27T21:32:19.705 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 -- 172.21.15.28:0/119508314 wait complete. 2024-03-27T21:32:19.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.668+0000 7f8143054640 1 librados: shutdown 2024-03-27T21:32:19.706 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:19.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-03-27T21:32:19.706 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-03-27T21:32:19.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.824+0000 7f5cc7d00640 10 monclient: get_monmap_and_config 2024-03-27T21:32:19.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.824+0000 7f5cc7d00640 10 monclient: build_initial_monmap 2024-03-27T21:32:19.813 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.824+0000 7f5cc7d00640 10 monclient: monmap: 2024-03-27T21:32:19.813 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:19.813 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:19.825426+0000 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:19.825426+0000 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:19.814 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 Processor -- start 2024-03-27T21:32:19.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 -- start start 2024-03-27T21:32:19.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient: init 2024-03-27T21:32:19.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient: _add_conns ranks=[5,8,7,10,3,0,1,6,4,9,2] 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f5cc0136d00 0x7f5cc01370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): picked mon.noname-h con 0x7f5cc0136d00 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc0137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): picked mon.noname-e con 0x7f5cc00a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc01339e0 0x7f5cc0133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): picked mon.noname-i con 0x7f5cc01339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:19.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00a25b0 con 0x7f5cc0136d00 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0137b60 con 0x7f5cc01339e0 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00a13f0 con 0x7f5cc00a3d70 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:19.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc7d00640 10 monclient(hunting): authenticate will time out at 962.132579s 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.825+0000 7f5cc529b640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc0137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc0137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42198/0 (socket says 172.21.15.28:42198) 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 -- 172.21.15.28:0/3556356147 learned_addr learned my addr 172.21.15.28:0/3556356147 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): get_auth_request con 0x7f5cc00a3d70 auth_method 0 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc629d640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc01339e0 0x7f5cc0133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient(hunting): handle_auth_done global_id 4490 payload 274 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc5a9c640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f5cc0136d00 0x7f5cc01370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 -- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc01339e0 msgr2=0x7f5cc0133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc01339e0 0x7f5cc0133e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 -- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f5cc0136d00 msgr2=0x7f5cc01370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f5cc0136d00 0x7f5cc01370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient: _finish_hunting 0 2024-03-27T21:32:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 monclient: found mon.noname-e 2024-03-27T21:32:19.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.826+0000 7f5cc529b640 1 -- 172.21.15.28:0/3556356147 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00618f0 con 0x7f5cc00a3d70 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc529b640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc0137620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00098a0 tx=0x7f5cb002b7a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=f83440e2fc52bb59 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 1 -- 172.21.15.28:0/3556356147 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5cb002f050 con 0x7f5cc00a3d70 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: dump: 2024-03-27T21:32:19.830 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.831 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: _finish_auth 0 2024-03-27T21:32:19.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: _check_auth_tickets 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 5 monclient: authenticate success, global_id 4490 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 1 -- 172.21.15.28:0/3556356147 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb0031970 con 0x7f5cc00a3d70 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:19.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 4 set_mon_vals no callback set 2024-03-27T21:32:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 1 -- 172.21.15.28:0/3556356147 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5cb0032390 con 0x7f5cc00a3d70 2024-03-27T21:32:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc4a9a640 10 monclient: dump: 2024-03-27T21:32:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.834 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.835 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 10 monclient: shutdown 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:19.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 -- 172.21.15.28:0/3556356147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 msgr2=0x7f5cc0137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc0137620 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00098a0 tx=0x7f5cb002b7a0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 -- 172.21.15.28:0/3556356147 shutdown_connections 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc01339e0 0x7f5cc0133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc0137620 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/3556356147 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f5cc0136d00 0x7f5cc01370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 -- 172.21.15.28:0/3556356147 >> 172.21.15.28:0/3556356147 conn(0x7f5cc00a9430 msgr2=0x7f5cc00a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 -- 172.21.15.28:0/3556356147 shutdown_connections 2024-03-27T21:32:19.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.827+0000 7f5cc7d00640 1 -- 172.21.15.28:0/3556356147 wait complete. 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 10 monclient: build_initial_monmap 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 10 monclient: monmap: 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:19.838 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:19.839 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 1 librados: starting msgr at 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 1 librados: starting objecter 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 1 Processor -- start 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 1 -- start start 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 1 librados: setting wanted keys 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 1 librados: calling monclient init 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.828+0000 7f5cc7d00640 10 monclient: init 2024-03-27T21:32:19.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient: _add_conns ranks=[8,0,7,5,6,4,1,2,3] 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc01cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): picked mon.noname-e con 0x7f5cc00a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc01339e0 0x7f5cc0132e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): picked mon.noname-a con 0x7f5cc01339e0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc0136d00 0x7f5cc01c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): picked mon.noname-i con 0x7f5cc0136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0120300 con 0x7f5cc01339e0 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00a1630 con 0x7f5cc0136d00 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc00a11e0 con 0x7f5cc00a3d70 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient(hunting): authenticate will time out at 962.135896s 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc01cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc01339e0 0x7f5cc0132e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc01cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42210/0 (socket says 172.21.15.28:42210) 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 -- 172.21.15.28:0/2683021778 learned_addr learned my addr 172.21.15.28:0/2683021778 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): get_auth_request con 0x7f5cc00a3d70 auth_method 0 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): get_auth_request con 0x7f5cc01339e0 auth_method 0 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc0136d00 0x7f5cc01c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): get_auth_request con 0x7f5cc0136d00 auth_method 0 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc629d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient(hunting): handle_auth_done global_id 4499 payload 824 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc0136d00 msgr2=0x7f5cc01c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f5cc0136d00 0x7f5cc01c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc01339e0 msgr2=0x7f5cc0132e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc01339e0 0x7f5cc0132e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient: _finish_hunting 0 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 monclient: found mon.noname-e 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb00094d0 con 0x7f5cc00a3d70 2024-03-27T21:32:19.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc529b640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5cc01339e0 0x7f5cc0132e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc5a9c640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc01cb580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c7f0 tx=0x7f5cbc00ccb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 client.?.objecter ms_handle_connect 0x7f5cc00a3d70 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5cbc007a90 con 0x7f5cc00a3d70 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: dump: 2024-03-27T21:32:19.847 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.848 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.849 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.850 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:19.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:19.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:19.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc007c10 con 0x7f5cc00a3d70 2024-03-27T21:32:19.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 5 monclient: authenticate success, global_id 4499 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient: _renew_subs 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc009e630 con 0x7f5cc00a3d70 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5cbc007d80 con 0x7f5cc00a3d70 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cb67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cb67fc640 10 monclient: dump: 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.852 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.853 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.854 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.854 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.854 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 10 client.4499.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:19.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.829+0000 7f5cb7fff640 4 set_mon_vals no callback set 2024-03-27T21:32:19.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 10 monclient: _renew_subs 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc011ff90 con 0x7f5cc00a3d70 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 1 librados: init done 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 0x7f5cc01c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f5cbc019400 con 0x7f5cc00a3d70 2024-03-27T21:32:19.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0069c80 con 0x7f5cc0133390 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc529b640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 0x7f5cc01c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc529b640 10 monclient: get_auth_request con 0x7f5cc0133390 auth_method 0 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc529b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc529b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cc529b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.830+0000 7f5cb67fc640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5ca403a250 0x7f5ca403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f5cbc049da0 con 0x7f5cc00a3d70 2024-03-27T21:32:19.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 client.4499.objecter ms_dispatch 0x7f5cc0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 3 client.4499.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 3 client.4499.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 20 client.4499.objecter dump_active .. 0 homeless 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc529b640 10 monclient(hunting): handle_auth_done global_id 4547 payload 824 2024-03-27T21:32:19.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc529b640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc00a3020 con 0x7f5cc0133390 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc629d640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5ca403a250 0x7f5ca403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc629d640 10 monclient: get_auth_request con 0x7f5ca403a250 auth_method 0 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 client.4499.objecter ms_handle_connect 0x7f5cc0133390 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 client.4499.objecter resend_mon_ops 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc529b640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 0x7f5cc01c85c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009870 tx=0x7f5cb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5cb0003d50 con 0x7f5cc0133390 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:19.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 monclient: dump: 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.859 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 client.4499.objecter ms_handle_connect 0x7f5ca403a250 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cc629d640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5ca403a250 0x7f5ca403c710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800f400 tx=0x7f5cb8007640 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.2 v2:172.21.15.28:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f5cb0003eb0 con 0x7f5cc0133390 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 msgr2=0x7f5cc01c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 0x7f5cc01c85c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009870 tx=0x7f5cb00046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 msgr2=0x7f5cc01c85c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:19.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.831+0000 7f5cb67fc640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc0133390 0x7f5cc01c85c0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0009870 tx=0x7f5cb00046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc7d00640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:19.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 0x7f5cc00a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:19.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc7d00640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:19.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc0073150 con 0x7f5cc01c8b00 2024-03-27T21:32:19.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 0x7f5cc00a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:19.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient: get_auth_request con 0x7f5cc01c8b00 auth_method 0 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:19.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 10 monclient(hunting): handle_auth_done global_id 4556 payload 824 2024-03-27T21:32:19.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 1 -- 172.21.15.28:0/2683021778 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5cc00a2240 con 0x7f5cc01c8b00 2024-03-27T21:32:19.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cc529b640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 0x7f5cc00a7050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097c0 tx=0x7f5cb0031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:19.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cb67fc640 10 client.4499.objecter ms_handle_connect 0x7f5cc01c8b00 2024-03-27T21:32:19.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cb67fc640 10 client.4499.objecter resend_mon_ops 2024-03-27T21:32:19.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5cb002f040 con 0x7f5cc01c8b00 2024-03-27T21:32:19.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cb67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:19.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cb67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:19.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.838+0000 7f5cb67fc640 10 monclient: dump: 2024-03-27T21:32:19.867 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:19.867 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:19.868 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 <== mon.2 v2:172.21.15.28:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9337 (secure 0 0 0) 0x7f5cb003d440 con 0x7f5cc01c8b00 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:19.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:19.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 msgr2=0x7f5cc00a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 0x7f5cc00a7050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097c0 tx=0x7f5cb0031000 comp rx=0 tx=0).stop 2024-03-27T21:32:19.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 msgr2=0x7f5cc00a7050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:19.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cb67fc640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f5cc01c8b00 0x7f5cc00a7050 secure :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5cb00097c0 tx=0x7f5cb0031000 comp rx=0 tx=0).stop 2024-03-27T21:32:19.870 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:19.870 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:19.871 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 4, 2024-03-27T21:32:19.872 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:19.873 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:19.874 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:19.875 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:19.876 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:19.877 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:19.878 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:19.879 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.880 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:19.881 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.882 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:19.883 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.884 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.885 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.886 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:19.887 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.888 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:19.889 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.890 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:19.891 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.892 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.893 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.894 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.895 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.897 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.898 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.899 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.900 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.901 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:19.902 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:19.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:19.904 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.905 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.906 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:19.907 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:19.908 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:19.908 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:19.908 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:19.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:19.908 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:19.908 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:19.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 10 librados: watch_flush enter 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 10 librados: watch_flush exit 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 20 client.4499.objecter shutdown clearing up homeless session... 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 10 client.4499.objecter successfully canceled tick 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5ca403a250 msgr2=0x7f5ca403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f5ca403a250 0x7f5ca403c710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5cb800f400 tx=0x7f5cb8007640 comp rx=0 tx=0).stop 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 10 monclient: shutdown 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:19.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 msgr2=0x7f5cc01cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 --2- 172.21.15.28:0/2683021778 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f5cc00a3d70 0x7f5cc01cb580 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c7f0 tx=0x7f5cbc00ccb0 comp rx=0 tx=0).stop 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc629d640 1 -- 172.21.15.28:0/2683021778 reap_dead start 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc629d640 1 -- 172.21.15.28:0/2683021778 reap_dead start 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 shutdown_connections 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 >> 172.21.15.28:0/2683021778 conn(0x7f5cc00a9430 msgr2=0x7f5cc00662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 shutdown_connections 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 -- 172.21.15.28:0/2683021778 wait complete. 2024-03-27T21:32:19.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:19.839+0000 7f5cc7d00640 1 librados: shutdown 2024-03-27T21:32:19.913 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:19.913 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-03-27T21:32:19.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-03-27T21:32:20.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.026+0000 7f7f8d7a4640 10 monclient: get_monmap_and_config 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.026+0000 7f7f8d7a4640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.026+0000 7f7f8d7a4640 10 monclient: monmap: 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:20.026960+0000 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:20.026960+0000 2024-03-27T21:32:20.015 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.016 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.026+0000 7f7f8d7a4640 1 Processor -- start 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.026+0000 7f7f8d7a4640 1 -- start start 2024-03-27T21:32:20.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.026+0000 7f7f8d7a4640 10 monclient: init 2024-03-27T21:32:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient: _add_conns ranks=[2,6,3,1,4,0,10,8,5,7,9] 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 0x7f7f8809b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): picked mon.noname-b con 0x7f7f8809c160 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 0x7f7f880a1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): picked mon.noname-d con 0x7f7f880a1050 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7f880a1970 0x7f7f8813d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): picked mon.noname-g con 0x7f7f880a1970 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8806a3b0 con 0x7f7f8809c160 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88099fa0 con 0x7f7f880a1970 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8809acb0 con 0x7f7f880a1050 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f8d7a4640 10 monclient(hunting): authenticate will time out at 962.334028s 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 0x7f7f8809b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 0x7f7f880a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 0x7f7f8809b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:59276/0 (socket says 172.21.15.28:59276) 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 0x7f7f880a1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:46226/0 (socket says 172.21.15.28:46226) 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 -- 172.21.15.28:0/3832464198 learned_addr learned my addr 172.21.15.28:0/3832464198 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): get_auth_request con 0x7f7f8809c160 auth_method 0 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): get_auth_request con 0x7f7f880a1050 auth_method 0 2024-03-27T21:32:20.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f877fe640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7f880a1970 0x7f7f8813d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_done global_id 4565 payload 274 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 -- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 msgr2=0x7f7f880a1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 0x7f7f880a1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 -- 172.21.15.28:0/3832464198 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7f880a1970 msgr2=0x7f7f8813d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7f880a1970 0x7f7f8813d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 monclient: found mon.noname-b 2024-03-27T21:32:20.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f86ffd640 1 -- 172.21.15.28:0/3832464198 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880618f0 con 0x7f7f8809c160 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f877fe640 10 monclient: get_auth_request con 0x7f7f880a1970 auth_method 0 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f867fc640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 0x7f7f880a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.027+0000 7f7f877fe640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7f880a1970 0x7f7f8813d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 0x7f7f8809b690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f800098a0 tx=0x7f7f8002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334f5e89f252a9d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 1 -- 172.21.15.28:0/3832464198 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f8002f050 con 0x7f7f8809c160 2024-03-27T21:32:20.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: dump: 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.036 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.037 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 1 -- 172.21.15.28:0/3832464198 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80031970 con 0x7f7f8809c160 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f8d7a4640 5 monclient: authenticate success, global_id 4565 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f8d7a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:20.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f8d7a4640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 1 -- 172.21.15.28:0/3832464198 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f80032390 con 0x7f7f8809c160 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f8d7a4640 4 set_mon_vals no callback set 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.028+0000 7f7f85ffb640 10 monclient: dump: 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.039 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.040 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 10 monclient: shutdown 2024-03-27T21:32:20.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 msgr2=0x7f7f8809b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 0x7f7f8809b690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f800098a0 tx=0x7f7f8002b7a0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/3832464198 shutdown_connections 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7f880a1970 0x7f7f8813d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7f880a1050 0x7f7f880a1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/3832464198 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7f8809c160 0x7f7f8809b690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/3832464198 >> 172.21.15.28:0/3832464198 conn(0x7f7f880a2140 msgr2=0x7f7f880a2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/3832464198 shutdown_connections 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/3832464198 wait complete. 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.029+0000 7f7f8d7a4640 10 monclient: monmap: 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:20.043 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.044 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 librados: starting msgr at 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 librados: starting objecter 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 Processor -- start 2024-03-27T21:32:20.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 -- start start 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 librados: setting wanted keys 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 librados: calling monclient init 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient: init 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient: _add_conns ranks=[8,1,0,3,4,2,7,6,5] 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7f8809c160 0x7f7f8806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): picked mon.noname-e con 0x7f7f8809c160 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:20.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f880a1050 0x7f7f8806e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): picked mon.noname-f con 0x7f7f880a1050 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 0x7f7f8806edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): picked mon.noname-a con 0x7f7f880a1970 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f880718e0 con 0x7f7f880a1970 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88071b50 con 0x7f7f880a1050 2024-03-27T21:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88071e30 con 0x7f7f8809c160 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f8d7a4640 10 monclient(hunting): authenticate will time out at 962.337482s 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7f8809c160 0x7f7f8806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 0x7f7f8806edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7f8809c160 0x7f7f8806e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:42222/0 (socket says 172.21.15.28:42222) 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 1 -- 172.21.15.28:0/88120838 learned_addr learned my addr 172.21.15.28:0/88120838 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 10 monclient(hunting): get_auth_request con 0x7f7f8809c160 auth_method 0 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 0x7f7f8806edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53106/0 (socket says 172.21.15.28:53106) 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 10 monclient(hunting): get_auth_request con 0x7f7f880a1970 auth_method 0 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.030+0000 7f7f877fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f867fc640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f880a1050 0x7f7f8806e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f867fc640 10 monclient(hunting): get_auth_request con 0x7f7f880a1050 auth_method 0 2024-03-27T21:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f867fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f867fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 10 monclient(hunting): handle_auth_done global_id 34128 payload 824 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7f8809c160 msgr2=0x7f7f8806e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7f8809c160 0x7f7f8806e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f880a1050 msgr2=0x7f7f8806e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f880a1050 0x7f7f8806e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 monclient: found mon.noname-a 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c009400 con 0x7f7f880a1970 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7f8809c160 0x7f7f8806e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f877fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 0x7f7f8806edf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800cce0 tx=0x7f7f7800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 client.?.objecter ms_handle_connect 0x7f7f880a1970 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:20.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f7800f8f0 con 0x7f7f880a1970 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: dump: 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.053 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.054 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7800fab0 con 0x7f7f880a1970 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 5 monclient: authenticate success, global_id 34128 2024-03-27T21:32:20.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 10 monclient: _renew_subs 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f800094d0 con 0x7f7f880a1970 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f7800fc60 con 0x7f7f880a1970 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f6f7fe640 10 monclient: dump: 2024-03-27T21:32:20.056 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.057 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f857fa640 4 set_mon_vals no callback set 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 10 client.34128.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 10 monclient: _renew_subs 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f88070910 con 0x7f7f880a1970 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.031+0000 7f7f8d7a4640 1 librados: init done 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f8d7a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 0x7f7f881cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8806b5d0 con 0x7f7f88097f40 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f7f7800b040 con 0x7f7f880a1970 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 0x7f7f881cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient: get_auth_request con 0x7f7f88097f40 auth_method 0 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7f7403a280 0x7f7f7403c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f7f7804a440 con 0x7f7f880a1970 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 10 client.34128.objecter ms_dispatch 0x7f7f88000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 3 client.34128.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 3 client.34128.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:20.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f6f7fe640 20 client.34128.objecter dump_active .. 0 homeless 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_done global_id 34105 payload 824 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f86ffd640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f880990a0 con 0x7f7f88097f40 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f867fc640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7f7403a280 0x7f7f7403c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.032+0000 7f7f867fc640 10 monclient: get_auth_request con 0x7f7f7403a280 auth_method 0 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 client.34128.objecter ms_handle_connect 0x7f7f88097f40 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 0x7f7f881cb250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f80000c00 tx=0x7f7f800046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 client.34128.objecter resend_mon_ops 2024-03-27T21:32:20.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f80003c90 con 0x7f7f88097f40 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 monclient: dump: 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.063 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.064 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 client.34128.objecter ms_handle_connect 0x7f7f7403a280 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f867fc640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7f7403a280 0x7f7f7403c740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f8809bfe0 tx=0x7f7f7c008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.4 v2:172.21.15.28:3302/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f7f80003df0 con 0x7f7f88097f40 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 msgr2=0x7f7f881cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 0x7f7f881cb250 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7f80000c00 tx=0x7f7f800046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 msgr2=0x7f7f881cb250 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.033+0000 7f7f6f7fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f88097f40 0x7f7f881cb250 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f8d7a4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 0x7f7f881cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f8d7a4640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f88073150 con 0x7f7f881cb790 2024-03-27T21:32:20.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 0x7f7f881cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f86ffd640 10 monclient: get_auth_request con 0x7f7f881cb790 auth_method 0 2024-03-27T21:32:20.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f86ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.039+0000 7f7f86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f86ffd640 10 monclient(hunting): handle_auth_done global_id 34114 payload 824 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f86ffd640 1 -- 172.21.15.28:0/88120838 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7f8809a9d0 con 0x7f7f881cb790 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 client.34128.objecter ms_handle_connect 0x7f7f881cb790 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 client.34128.objecter resend_mon_ops 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f86ffd640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 0x7f7f881cbba0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f8002b7e0 tx=0x7f7f80031000 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7f8002f040 con 0x7f7f881cb790 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 monclient: dump: 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.069 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.070 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 <== mon.4 v2:172.21.15.28:3302/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9167 (secure 0 0 0) 0x7f7f8003de10 con 0x7f7f881cb790 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 msgr2=0x7f7f881cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 0x7f7f881cbba0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f8002b7e0 tx=0x7f7f80031000 comp rx=0 tx=0).stop 2024-03-27T21:32:20.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 msgr2=0x7f7f881cbba0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.072 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f6f7fe640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7f881cb790 0x7f7f881cbba0 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7f8002b7e0 tx=0x7f7f80031000 comp rx=0 tx=0).stop 2024-03-27T21:32:20.072 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:20.072 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:20.072 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:20.072 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:20.073 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 5, 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.074 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.075 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.076 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:20.077 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:20.078 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.079 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.080 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.081 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:20.082 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.083 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:20.084 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.085 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:20.086 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.087 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.088 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.089 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.090 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.091 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.092 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.093 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:20.094 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.095 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.096 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.097 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.098 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.099 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.100 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.101 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:20.102 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.103 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.104 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.105 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.106 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.107 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.107 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:20.107 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f8d7a4640 10 librados: watch_flush enter 2024-03-27T21:32:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f8d7a4640 10 librados: watch_flush exit 2024-03-27T21:32:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f8d7a4640 20 client.34128.objecter shutdown clearing up homeless session... 2024-03-27T21:32:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.040+0000 7f7f8d7a4640 10 client.34128.objecter successfully canceled tick 2024-03-27T21:32:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7f7403a280 msgr2=0x7f7f7403c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.109 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7f7403a280 0x7f7f7403c740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7f8809bfe0 tx=0x7f7f7c008040 comp rx=0 tx=0).stop 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 10 monclient: shutdown 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 msgr2=0x7f7f8806edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f877fe640 1 -- 172.21.15.28:0/88120838 reap_dead start 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 0x7f7f8806edf0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800cce0 tx=0x7f7f7800a650 comp rx=0 tx=0).stop 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 shutdown_connections 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 --2- 172.21.15.28:0/88120838 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7f880a1970 0x7f7f8806edf0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 >> 172.21.15.28:0/88120838 conn(0x7f7f880a2140 msgr2=0x7f7f881bedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.110 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 shutdown_connections 2024-03-27T21:32:20.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 -- 172.21.15.28:0/88120838 wait complete. 2024-03-27T21:32:20.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.041+0000 7f7f8d7a4640 1 librados: shutdown 2024-03-27T21:32:20.111 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:20.111 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-03-27T21:32:20.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-03-27T21:32:20.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.224+0000 7fe5c3841640 10 monclient: get_monmap_and_config 2024-03-27T21:32:20.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.224+0000 7fe5c3841640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.224+0000 7fe5c3841640 10 monclient: monmap: 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:20.225680+0000 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:20.225680+0000 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:20.216 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:20.216 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.225+0000 7fe5c3841640 1 Processor -- start 2024-03-27T21:32:20.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.225+0000 7fe5c3841640 1 -- start start 2024-03-27T21:32:20.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.225+0000 7fe5c3841640 10 monclient: init 2024-03-27T21:32:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient: _add_conns ranks=[4,7,3,9,8,6,2,1,0,5,10] 2024-03-27T21:32:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 0x7fe5bc1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): picked mon.noname-c con 0x7fe5bc136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe5bc0a3d70 0x7fe5bc137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): picked mon.noname-i con 0x7fe5bc0a3d70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5bc1339e0 0x7fe5bc133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): picked mon.noname-g con 0x7fe5bc1339e0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0a25b0 con 0x7fe5bc1339e0 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc137b60 con 0x7fe5bc136d00 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc0a13f0 con 0x7fe5bc0a3d70 2024-03-27T21:32:20.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c3841640 10 monclient(hunting): authenticate will time out at 962.532819s 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 0x7fe5bc1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 0x7fe5bc1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:36766/0 (socket says 172.21.15.28:36766) 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 -- 172.21.15.28:0/3435364978 learned_addr learned my addr 172.21.15.28:0/3435364978 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): get_auth_request con 0x7fe5bc136d00 auth_method 0 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5bc1339e0 0x7fe5bc133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): get_auth_request con 0x7fe5bc1339e0 auth_method 0 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c0ddc640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe5bc0a3d70 0x7fe5bc137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c0ddc640 10 monclient(hunting): get_auth_request con 0x7fe5bc0a3d70 auth_method 0 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c0ddc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c0ddc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c0ddc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c1dde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_done global_id 34123 payload 274 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 -- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe5bc0a3d70 msgr2=0x7fe5bc137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe5bc0a3d70 0x7fe5bc137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 -- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5bc1339e0 msgr2=0x7fe5bc133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5bc1339e0 0x7fe5bc133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 monclient: found mon.noname-c 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c15dd640 1 -- 172.21.15.28:0/3435364978 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc0618f0 con 0x7fe5bc136d00 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.226+0000 7fe5c0ddc640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe5bc0a3d70 0x7fe5bc137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 0x7fe5bc1370e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e80 tx=0x7fe5b402bd70 comp rx=0 tx=0).ready entity=mon.4 client_cookie=f8e3baa87a5bffa4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 1 -- 172.21.15.28:0/3435364978 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b402cb80 con 0x7fe5bc136d00 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: dump: 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.234 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.235 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 1 -- 172.21.15.28:0/3435364978 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b402cd00 con 0x7fe5bc136d00 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 5 monclient: authenticate success, global_id 34123 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 1 -- 172.21.15.28:0/3435364978 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b4034860 con 0x7fe5bc136d00 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 4 set_mon_vals no callback set 2024-03-27T21:32:20.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5bbfff640 10 monclient: dump: 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.238 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.239 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 10 monclient: shutdown 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 1 -- 172.21.15.28:0/3435364978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 msgr2=0x7fe5bc1370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.227+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 0x7fe5bc1370e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e80 tx=0x7fe5b402bd70 comp rx=0 tx=0).stop 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 -- 172.21.15.28:0/3435364978 shutdown_connections 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fe5bc0a3d70 0x7fe5bc137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fe5bc1339e0 0x7fe5bc133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3435364978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc136d00 0x7fe5bc1370e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 -- 172.21.15.28:0/3435364978 >> 172.21.15.28:0/3435364978 conn(0x7fe5bc0a9430 msgr2=0x7fe5bc0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 -- 172.21.15.28:0/3435364978 shutdown_connections 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 -- 172.21.15.28:0/3435364978 wait complete. 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 10 monclient: monmap: 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:20.241 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.242 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 librados: starting msgr at 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 librados: starting objecter 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 Processor -- start 2024-03-27T21:32:20.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 -- start start 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 librados: setting wanted keys 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 1 librados: calling monclient init 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.228+0000 7fe5c3841640 10 monclient: init 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient: _add_conns ranks=[2,4,8,5,1,7,6,0,3] 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe5bc0a3d70 0x7fe5bc1cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): picked mon.noname-b con 0x7fe5bc0a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 0x7fe5bc132ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): picked mon.noname-c con 0x7fe5bc1339e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe5bc136d00 0x7fe5bc133010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): picked mon.noname-e con 0x7fe5bc136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc133550 con 0x7fe5bc0a3d70 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc1201d0 con 0x7fe5bc1339e0 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc09e460 con 0x7fe5bc136d00 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c3841640 10 monclient(hunting): authenticate will time out at 962.536141s 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 0x7fe5bc132ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe5bc0a3d70 0x7fe5bc1cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe5bc136d00 0x7fe5bc133010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 0x7fe5bc132ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:36770/0 (socket says 172.21.15.28:36770) 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 -- 172.21.15.28:0/3801015959 learned_addr learned my addr 172.21.15.28:0/3801015959 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): get_auth_request con 0x7fe5bc1339e0 auth_method 0 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): get_auth_request con 0x7fe5bc0a3d70 auth_method 0 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): get_auth_request con 0x7fe5bc136d00 auth_method 0 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c1dde640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient(hunting): handle_auth_done global_id 34132 payload 824 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe5bc136d00 msgr2=0x7fe5bc133010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fe5bc136d00 0x7fe5bc133010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe5bc0a3d70 msgr2=0x7fe5bc1cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe5bc0a3d70 0x7fe5bc1cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 monclient: found mon.noname-c 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c0ddc640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4009b30 con 0x7fe5bc1339e0 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.229+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fe5bc0a3d70 0x7fe5bc1cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c0ddc640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 0x7fe5bc132ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000e810 tx=0x7fe5b000ecd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 client.?.objecter ms_handle_connect 0x7fe5bc1339e0 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b000eec0 con 0x7fe5bc1339e0 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: dump: 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.251 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.252 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000cb40 con 0x7fe5bc1339e0 2024-03-27T21:32:20.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 5 monclient: authenticate success, global_id 34132 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 10 monclient: _renew_subs 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5bc0a1250 con 0x7fe5bc1339e0 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b000ccb0 con 0x7fe5bc1339e0 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:20.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5b9ffb640 10 monclient: dump: 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.255 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5bb7fe640 4 set_mon_vals no callback set 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 10 client.34132.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 10 monclient: _renew_subs 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5bc09f1f0 con 0x7fe5bc1339e0 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.230+0000 7fe5c3841640 1 librados: init done 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c3841640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 0x7fe5bc09c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc069c80 con 0x7fe5bc11fc70 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fe5b000c6d0 con 0x7fe5bc1339e0 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 0x7fe5bc09c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient: get_auth_request con 0x7fe5bc11fc70 auth_method 0 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe5a803a250 0x7fe5a803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fe5b0049b80 con 0x7fe5bc1339e0 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 10 client.34132.objecter ms_dispatch 0x7fe5bc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 3 client.34132.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 3 client.34132.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 20 client.34132.objecter dump_active .. 0 homeless 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_done global_id 4551 payload 824 2024-03-27T21:32:20.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5bc0a0b80 con 0x7fe5bc11fc70 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c1dde640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe5a803a250 0x7fe5a803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c1dde640 10 monclient: get_auth_request con 0x7fe5a803a250 auth_method 0 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 10 client.34132.objecter ms_handle_connect 0x7fe5bc11fc70 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 10 client.34132.objecter resend_mon_ops 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 0x7fe5bc09c700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e50 tx=0x7fe5b4004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b4009510 con 0x7fe5bc11fc70 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.231+0000 7fe5b9ffb640 10 monclient: dump: 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.261 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.262 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 10 client.34132.objecter ms_handle_connect 0x7fe5a803a250 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5c1dde640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe5a803a250 0x7fe5a803c710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ab0 tx=0x7fe5ac009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.6 v2:172.21.15.28:3303/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fe5b4004600 con 0x7fe5bc11fc70 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 msgr2=0x7fe5bc09c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 0x7fe5bc09c700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e50 tx=0x7fe5b4004a40 comp rx=0 tx=0).stop 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 msgr2=0x7fe5bc09c700 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.232+0000 7fe5b9ffb640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc11fc70 0x7fe5bc09c700 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e50 tx=0x7fe5b4004a40 comp rx=0 tx=0).stop 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c3841640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 0x7fe5bc09d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c3841640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fe5bc073150 con 0x7fe5bc09cc40 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 0x7fe5bc09d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient: get_auth_request con 0x7fe5bc09cc40 auth_method 0 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 10 monclient(hunting): handle_auth_done global_id 4560 payload 824 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 1 -- 172.21.15.28:0/3801015959 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe5bc0a3020 con 0x7fe5bc09cc40 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5c15dd640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 0x7fe5bc09d050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e80 tx=0x7fe5b4009000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5b9ffb640 10 client.34132.objecter ms_handle_connect 0x7fe5bc09cc40 2024-03-27T21:32:20.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.238+0000 7fe5b9ffb640 10 client.34132.objecter resend_mon_ops 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe5b404e070 con 0x7fe5bc09cc40 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 10 monclient: dump: 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.266 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.267 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.268 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.268 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.268 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 <== mon.6 v2:172.21.15.28:3303/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9167 (secure 0 0 0) 0x7fe5b403f690 con 0x7fe5bc09cc40 2024-03-27T21:32:20.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:20.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:20.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 msgr2=0x7fe5bc09d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 0x7fe5bc09d050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e80 tx=0x7fe5b4009000 comp rx=0 tx=0).stop 2024-03-27T21:32:20.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 msgr2=0x7fe5bc09d050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5b9ffb640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fe5bc09cc40 0x7fe5bc09d050 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009e80 tx=0x7fe5b4009000 comp rx=0 tx=0).stop 2024-03-27T21:32:20.269 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:20.270 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.271 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 5, 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.272 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.273 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.274 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:20.275 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:20.276 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.277 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.278 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.279 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.280 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.281 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.282 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.283 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.284 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.285 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.286 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.287 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.288 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:20.289 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.290 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.291 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.292 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.293 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.294 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:20.295 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.296 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:20.297 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.298 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.299 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.300 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:20.301 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.302 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.303 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.304 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.305 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:20.305 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 10 librados: watch_flush enter 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 10 librados: watch_flush exit 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 20 client.34132.objecter shutdown clearing up homeless session... 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 10 client.34132.objecter successfully canceled tick 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe5a803a250 msgr2=0x7fe5a803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fe5a803a250 0x7fe5a803c710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009ab0 tx=0x7fe5ac009190 comp rx=0 tx=0).stop 2024-03-27T21:32:20.307 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 10 monclient: shutdown 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 msgr2=0x7fe5bc132ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c1dde640 1 -- 172.21.15.28:0/3801015959 reap_dead start 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 0x7fe5bc132ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000e810 tx=0x7fe5b000ecd0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 shutdown_connections 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 --2- 172.21.15.28:0/3801015959 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fe5bc1339e0 0x7fe5bc132ad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 >> 172.21.15.28:0/3801015959 conn(0x7fe5bc0a9430 msgr2=0x7fe5bc136540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 shutdown_connections 2024-03-27T21:32:20.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 -- 172.21.15.28:0/3801015959 wait complete. 2024-03-27T21:32:20.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.239+0000 7fe5c3841640 1 librados: shutdown 2024-03-27T21:32:20.309 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:20.309 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-03-27T21:32:20.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-03-27T21:32:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.423+0000 7fd1e1df0640 10 monclient: get_monmap_and_config 2024-03-27T21:32:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.423+0000 7fd1e1df0640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.423+0000 7fd1e1df0640 10 monclient: monmap: 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:20.424696+0000 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:20.424696+0000 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:20.413 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.414 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.424+0000 7fd1e1df0640 1 Processor -- start 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.424+0000 7fd1e1df0640 1 -- start start 2024-03-27T21:32:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.424+0000 7fd1e1df0640 10 monclient: init 2024-03-27T21:32:20.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient: _add_conns ranks=[7,4,1,10,5,3,0,9,8,6,2] 2024-03-27T21:32:20.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): picked mon.noname-i con 0x7fd1dc136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 0x7fd1dc137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): picked mon.noname-c con 0x7fd1dc0a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd1dc1339e0 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0618f0 con 0x7fd1dc1339e0 2024-03-27T21:32:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0a25b0 con 0x7fd1dc0a3d70 2024-03-27T21:32:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc137b60 con 0x7fd1dc136d00 2024-03-27T21:32:20.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1e1df0640 10 monclient(hunting): authenticate will time out at 962.731838s 2024-03-27T21:32:20.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 0x7fd1dc137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 0x7fd1dc137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:36786/0 (socket says 172.21.15.28:36786) 2024-03-27T21:32:20.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 -- 172.21.15.28:0/636442536 learned_addr learned my addr 172.21.15.28:0/636442536 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): get_auth_request con 0x7fd1dc0a3d70 auth_method 0 2024-03-27T21:32:20.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 1 --2- 172.21.15.28:0/636442536 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): get_auth_request con 0x7fd1dc136d00 auth_method 0 2024-03-27T21:32:20.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient(hunting): handle_auth_done global_id 34141 payload 274 2024-03-27T21:32:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 -- 172.21.15.28:0/636442536 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 msgr2=0x7fd1dc1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 --2- 172.21.15.28:0/636442536 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc1370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 -- 172.21.15.28:0/636442536 >> v1:172.21.15.63:6789/0 conn(0x7fd1dc1339e0 legacy=0x7fd1dc133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 monclient: found mon.noname-c 2024-03-27T21:32:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.425+0000 7fd1daffd640 1 -- 172.21.15.28:0/636442536 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0a13f0 con 0x7fd1dc0a3d70 2024-03-27T21:32:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1daffd640 1 --2- 172.21.15.28:0/636442536 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 0x7fd1dc137620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00098d0 tx=0x7fd1d002b840 comp rx=0 tx=0).ready entity=mon.4 client_cookie=994e161c45e56289 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 1 -- 172.21.15.28:0/636442536 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd1d002e070 con 0x7fd1dc0a3d70 2024-03-27T21:32:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:20.444 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: dump: 2024-03-27T21:32:20.444 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.444 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.444 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.445 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 1 -- 172.21.15.28:0/636442536 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0031a10 con 0x7fd1dc0a3d70 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 5 monclient: authenticate success, global_id 34141 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 1 -- 172.21.15.28:0/636442536 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd1d0031c00 con 0x7fd1dc0a3d70 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 4 set_mon_vals no callback set 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1da7fc640 10 monclient: dump: 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.448 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.449 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 10 monclient: shutdown 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 -- 172.21.15.28:0/636442536 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 msgr2=0x7fd1dc137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/636442536 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 0x7fd1dc137620 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00098d0 tx=0x7fd1d002b840 comp rx=0 tx=0).stop 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 -- 172.21.15.28:0/636442536 shutdown_connections 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/636442536 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc0a3d70 0x7fd1dc137620 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/636442536 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 -- 172.21.15.28:0/636442536 >> 172.21.15.28:0/636442536 conn(0x7fd1dc0a9430 msgr2=0x7fd1dc0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 -- 172.21.15.28:0/636442536 shutdown_connections 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.426+0000 7fd1e1df0640 1 -- 172.21.15.28:0/636442536 wait complete. 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.427+0000 7fd1e1df0640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.427+0000 7fd1e1df0640 10 monclient: monmap: 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:20.451 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.452 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.427+0000 7fd1e1df0640 1 librados: starting msgr at 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.427+0000 7fd1e1df0640 1 librados: starting objecter 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.427+0000 7fd1e1df0640 1 Processor -- start 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.427+0000 7fd1e1df0640 1 -- start start 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 librados: setting wanted keys 2024-03-27T21:32:20.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 librados: calling monclient init 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient: init 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient: _add_conns ranks=[1,4,7,3,0,2,6,5,8] 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1dc0a3d70 0x7fd1dc1cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): picked mon.noname-f con 0x7fd1dc0a3d70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 0x7fd1dc132a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): picked mon.noname-c con 0x7fd1dc1339e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): picked mon.noname-i con 0x7fd1dc136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc1cb8c0 con 0x7fd1dc0a3d70 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc11fe80 con 0x7fd1dc1339e0 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0a1630 con 0x7fd1dc136d00 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1e1df0640 10 monclient(hunting): authenticate will time out at 962.735137s 2024-03-27T21:32:20.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 0x7fd1dc132a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 0x7fd1dc132a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:36794/0 (socket says 172.21.15.28:36794) 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 -- 172.21.15.28:0/3639721561 learned_addr learned my addr 172.21.15.28:0/3639721561 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): get_auth_request con 0x7fd1dc1339e0 auth_method 0 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1dc0a3d70 0x7fd1dc1cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): get_auth_request con 0x7fd1dc0a3d70 auth_method 0 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1dbfff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1dbfff640 10 monclient(hunting): get_auth_request con 0x7fd1dc136d00 auth_method 0 2024-03-27T21:32:20.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1dbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1dbfff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient(hunting): handle_auth_done global_id 34150 payload 824 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 msgr2=0x7fd1dc132fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.458 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc132fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1dc0a3d70 msgr2=0x7fd1dc1cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1dc0a3d70 0x7fd1dc1cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 monclient: found mon.noname-c 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00094d0 con 0x7fd1dc1339e0 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1dbfff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fd1dc136d00 0x7fd1dc132fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:20.459 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1daffd640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 0x7fd1dc132a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00090b0 tx=0x7fd1d00046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1c3fff640 10 client.?.objecter ms_handle_connect 0x7fd1dc1339e0 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.428+0000 7fd1c3fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd1d0004250 con 0x7fd1dc1339e0 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: dump: 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.460 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.461 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d003f070 con 0x7fd1dc1339e0 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 5 monclient: authenticate success, global_id 34150 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 10 monclient: _renew_subs 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0a11e0 con 0x7fd1dc1339e0 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd1d00043d0 con 0x7fd1dc1339e0 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:20.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 10 client.34150.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 10 monclient: dump: 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.464 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.465 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 10 monclient: _renew_subs 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1d9ffb640 4 set_mon_vals no callback set 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc120440 con 0x7fd1dc1339e0 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1e1df0640 1 librados: init done 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.429+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fd1d0003610 con 0x7fd1dc1339e0 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1e1df0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.466 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 0x7fd1dc09ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc069c80 con 0x7fd1dc09c680 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd1c803a250 0x7fd1c803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 0x7fd1dc09ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fd1d006b920 con 0x7fd1dc1339e0 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 client.34150.objecter ms_dispatch 0x7fd1dc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 3 client.34150.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 3 client.34150.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:20.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient: get_auth_request con 0x7fd1dc09c680 auth_method 0 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 20 client.34150.objecter dump_active .. 0 homeless 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1dbfff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd1c803a250 0x7fd1c803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1dbfff640 10 monclient: get_auth_request con 0x7fd1c803a250 auth_method 0 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_done global_id 4526 payload 824 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1dc0a3020 con 0x7fd1dc09c680 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 client.34150.objecter ms_handle_connect 0x7fd1dc09c680 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 client.34150.objecter resend_mon_ops 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1db7fe640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 0x7fd1dc09ca60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc011890 tx=0x7fd1cc011d50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd1cc00fd00 con 0x7fd1dc09c680 2024-03-27T21:32:20.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 monclient: dump: 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.470 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.471 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1c3fff640 10 client.34150.objecter ms_handle_connect 0x7fd1c803a250 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.430+0000 7fd1dbfff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd1c803a250 0x7fd1c803c710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc1cc440 tx=0x7fd1d4009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.8 v2:172.21.15.28:3304/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fd1cc00fe60 con 0x7fd1dc09c680 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 msgr2=0x7fd1dc09ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 0x7fd1dc09ca60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc011890 tx=0x7fd1cc011d50 comp rx=0 tx=0).stop 2024-03-27T21:32:20.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 msgr2=0x7fd1dc09ca60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.431+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09c680 0x7fd1dc09ca60 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc011890 tx=0x7fd1cc011d50 comp rx=0 tx=0).stop 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1e1df0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 0x7fd1dc0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1e1df0640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc073150 con 0x7fd1dc09cfa0 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 0x7fd1dc0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient: get_auth_request con 0x7fd1dc09cfa0 auth_method 0 2024-03-27T21:32:20.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 10 monclient(hunting): handle_auth_done global_id 4535 payload 824 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.437+0000 7fd1db7fe640 1 -- 172.21.15.28:0/3639721561 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd1dc0a2240 con 0x7fd1dc09cfa0 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1db7fe640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 0x7fd1dc0a7050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc011890 tx=0x7fd1cc0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 client.34150.objecter ms_handle_connect 0x7fd1dc09cfa0 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 client.34150.objecter resend_mon_ops 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd1cc02c070 con 0x7fd1dc09cfa0 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 monclient: dump: 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.475 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.476 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 <== mon.8 v2:172.21.15.28:3304/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9337 (secure 0 0 0) 0x7fd1cc024040 con 0x7fd1dc09cfa0 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 msgr2=0x7fd1dc0a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 0x7fd1dc0a7050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc011890 tx=0x7fd1cc0046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 msgr2=0x7fd1dc0a7050 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1c3fff640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fd1dc09cfa0 0x7fd1dc0a7050 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc011890 tx=0x7fd1cc0046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.478 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:20.478 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:20.478 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:20.479 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 5, 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:20.480 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.481 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.482 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:20.483 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:20.484 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:20.485 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.486 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.487 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.488 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.489 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.490 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.491 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.492 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:20.493 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.494 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:20.495 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.496 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.497 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.498 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:20.499 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.500 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:20.501 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:20.503 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.504 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.505 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.506 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.507 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.508 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.509 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.510 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.511 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.512 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.513 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.514 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:20.515 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 10 librados: watch_flush enter 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 10 librados: watch_flush exit 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 20 client.34150.objecter shutdown clearing up homeless session... 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 10 client.34150.objecter successfully canceled tick 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd1c803a250 msgr2=0x7fd1c803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fd1c803a250 0x7fd1c803c710 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc1cc440 tx=0x7fd1d4009040 comp rx=0 tx=0).stop 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 10 monclient: shutdown 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 msgr2=0x7fd1dc132a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 0x7fd1dc132a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00090b0 tx=0x7fd1d00046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1dbfff640 1 -- 172.21.15.28:0/3639721561 reap_dead start 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 shutdown_connections 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 --2- 172.21.15.28:0/3639721561 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fd1dc1339e0 0x7fd1dc132a80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 >> 172.21.15.28:0/3639721561 conn(0x7fd1dc0a9430 msgr2=0x7fd1dc1365b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.438+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 shutdown_connections 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.439+0000 7fd1e1df0640 1 -- 172.21.15.28:0/3639721561 wait complete. 2024-03-27T21:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.439+0000 7fd1e1df0640 1 librados: shutdown 2024-03-27T21:32:20.519 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:20.519 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-03-27T21:32:20.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-03-27T21:32:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.634+0000 7f7d9d6af640 10 monclient: get_monmap_and_config 2024-03-27T21:32:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.634+0000 7f7d9d6af640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.634+0000 7f7d9d6af640 10 monclient: monmap: 2024-03-27T21:32:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.622 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:20.634905+0000 2024-03-27T21:32:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:20.634905+0000 2024-03-27T21:32:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.623 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.624 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.625 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.625 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.625 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:20.625 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:20.625 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.634 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.634+0000 7f7d9d6af640 1 Processor -- start 2024-03-27T21:32:20.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.634+0000 7f7d9d6af640 1 -- start start 2024-03-27T21:32:20.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.634+0000 7f7d9d6af640 10 monclient: init 2024-03-27T21:32:20.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient: _add_conns ranks=[1,8,9,4,2,10,7,0,5,6,3] 2024-03-27T21:32:20.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7d980a3230 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:20.635 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 0x7f7d98139da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): picked mon.noname-e con 0x7f7d98134f40 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7d9813a2e0 0x7f7d9813c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): picked mon.noname-a con 0x7f7d9813a2e0 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d980618f0 con 0x7f7d980a3230 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d980a0400 con 0x7f7d9813a2e0 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98071a70 con 0x7f7d98134f40 2024-03-27T21:32:20.636 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d9d6af640 10 monclient(hunting): authenticate will time out at 962.942060s 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 0x7f7d98139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7d9813a2e0 0x7f7d9813c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 0x7f7d98139da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44200/0 (socket says 172.21.15.28:44200) 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 -- 172.21.15.28:0/678471554 learned_addr learned my addr 172.21.15.28:0/678471554 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): get_auth_request con 0x7f7d98134f40 auth_method 0 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.637 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): get_auth_request con 0x7f7d9813a2e0 auth_method 0 2024-03-27T21:32:20.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.638 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient(hunting): handle_auth_done global_id 4544 payload 274 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 -- 172.21.15.28:0/678471554 >> v2:172.21.15.28:3300/0 conn(0x7f7d9813a2e0 msgr2=0x7f7d9813c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 --2- 172.21.15.28:0/678471554 >> v2:172.21.15.28:3300/0 conn(0x7f7d9813a2e0 0x7f7d9813c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.639 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 -- 172.21.15.28:0/678471554 >> v1:172.21.15.63:6789/0 conn(0x7f7d980a3230 legacy=0x7f7d9809c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 monclient: found mon.noname-e 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d967fc640 1 -- 172.21.15.28:0/678471554 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d980a3610 con 0x7f7d98134f40 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.635+0000 7f7d977fe640 1 --2- 172.21.15.28:0/678471554 >> v2:172.21.15.28:3300/0 conn(0x7f7d9813a2e0 0x7f7d9813c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d967fc640 1 --2- 172.21.15.28:0/678471554 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 0x7f7d98139da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009870 tx=0x7f7d8002b7e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=13ba62b39462b846 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 1 -- 172.21.15.28:0/678471554 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d800319b0 con 0x7f7d98134f40 2024-03-27T21:32:20.640 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: dump: 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.641 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.642 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 1 -- 172.21.15.28:0/678471554 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d80031b30 con 0x7f7d98134f40 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d9d6af640 5 monclient: authenticate success, global_id 4544 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d9d6af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.643 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d9d6af640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:20.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 1 -- 172.21.15.28:0/678471554 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d80031ce0 con 0x7f7d98134f40 2024-03-27T21:32:20.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d9d6af640 4 set_mon_vals no callback set 2024-03-27T21:32:20.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:20.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.636+0000 7f7d95ffb640 10 monclient: dump: 2024-03-27T21:32:20.644 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.645 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.645 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.645 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.645 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.645 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.646 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 10 monclient: shutdown 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 -- 172.21.15.28:0/678471554 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 msgr2=0x7f7d98139da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/678471554 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 0x7f7d98139da0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009870 tx=0x7f7d8002b7e0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 -- 172.21.15.28:0/678471554 shutdown_connections 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/678471554 >> v2:172.21.15.28:3300/0 conn(0x7f7d9813a2e0 0x7f7d9813c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/678471554 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7d98134f40 0x7f7d98139da0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 -- 172.21.15.28:0/678471554 >> 172.21.15.28:0/678471554 conn(0x7f7d980a6670 msgr2=0x7f7d980a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 -- 172.21.15.28:0/678471554 shutdown_connections 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 1 -- 172.21.15.28:0/678471554 wait complete. 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.637+0000 7f7d9d6af640 10 monclient: monmap: 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:20.648 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.649 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 librados: starting msgr at 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 librados: starting objecter 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 Processor -- start 2024-03-27T21:32:20.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 -- start start 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 librados: setting wanted keys 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 librados: calling monclient init 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient: init 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient: _add_conns ranks=[3,2,7,4,6,1,0,5,8] 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7d980a3230 0x7f7d98131370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): picked mon.noname-g con 0x7f7d980a3230 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:20.651 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7d98134f40 0x7f7d981318b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): picked mon.noname-b con 0x7f7d98134f40 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7d9813a2e0 0x7f7d9811c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): picked mon.noname-i con 0x7f7d9813a2e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9811e3e0 con 0x7f7d98134f40 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d981bf890 con 0x7f7d980a3230 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9811fd40 con 0x7f7d9813a2e0 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d9d6af640 10 monclient(hunting): authenticate will time out at 962.945575s 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d967fc640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7d98134f40 0x7f7d981318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.638+0000 7f7d967fc640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7d98134f40 0x7f7d981318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38444/0 (socket says 172.21.15.28:38444) 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 -- 172.21.15.28:0/821000776 learned_addr learned my addr 172.21.15.28:0/821000776 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): get_auth_request con 0x7f7d98134f40 auth_method 0 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d977fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7d9813a2e0 0x7f7d9811c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d977fe640 10 monclient(hunting): get_auth_request con 0x7f7d9813a2e0 auth_method 0 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.654 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d96ffd640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7d980a3230 0x7f7d98131370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d977fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d977fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d96ffd640 10 monclient(hunting): get_auth_request con 0x7f7d980a3230 auth_method 0 2024-03-27T21:32:20.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d96ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient(hunting): handle_auth_done global_id 4583 payload 824 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7d9813a2e0 msgr2=0x7f7d9811c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7d9813a2e0 0x7f7d9811c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7d980a3230 msgr2=0x7f7d98131370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7d980a3230 0x7f7d98131370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 monclient: found mon.noname-b 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88009a70 con 0x7f7d98134f40 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d96ffd640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7d980a3230 0x7f7d98131370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d977fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7d9813a2e0 0x7f7d9811c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d967fc640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7d98134f40 0x7f7d981318b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d80000c00 tx=0x7f7d800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 client.?.objecter ms_handle_connect 0x7f7d98134f40 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d80031970 con 0x7f7d98134f40 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: dump: 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.658 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.659 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d80003a80 con 0x7f7d98134f40 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 5 monclient: authenticate success, global_id 4583 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d80003bf0 con 0x7f7d98134f40 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 10 monclient: _renew_subs 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d800094d0 con 0x7f7d98134f40 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d957fa640 4 set_mon_vals no callback set 2024-03-27T21:32:20.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 10 client.4583.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d8f7fe640 10 monclient: dump: 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.662 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.663 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 10 monclient: _renew_subs 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9806a5c0 con 0x7f7d98134f40 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.639+0000 7f7d9d6af640 1 librados: init done 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d9d6af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f7d8003a040 con 0x7f7d98134f40 2024-03-27T21:32:20.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 0x7f7d9811cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98069d30 con 0x7f7d9811cac0 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7d7803a240 0x7f7d7803c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f7d8006bf20 con 0x7f7d98134f40 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 0x7f7d9811cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 10 client.4583.objecter ms_dispatch 0x7f7d98000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 3 client.4583.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:20.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 3 client.4583.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:20.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient: get_auth_request con 0x7f7d9811cac0 auth_method 0 2024-03-27T21:32:20.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d8f7fe640 20 client.4583.objecter dump_active .. 0 homeless 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d977fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7d7803a240 0x7f7d7803c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.640+0000 7f7d977fe640 10 monclient: get_auth_request con 0x7f7d7803a240 auth_method 0 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_done global_id 4726 payload 824 2024-03-27T21:32:20.667 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d96ffd640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d9809a010 con 0x7f7d9811cac0 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 client.4583.objecter ms_handle_connect 0x7f7d9811cac0 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d96ffd640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 0x7f7d9811cea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000e500 tx=0x7f7d9000e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 client.4583.objecter resend_mon_ops 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 client.4583.objecter ms_handle_connect 0x7f7d7803a240 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d977fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7d7803a240 0x7f7d7803c700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d9811d600 tx=0x7f7d8800b040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d900074a0 con 0x7f7d9811cac0 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 monclient: dump: 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.669 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.670 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.1 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7f7d90007600 con 0x7f7d9811cac0 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 msgr2=0x7f7d9811cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 0x7f7d9811cea0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000e500 tx=0x7f7d9000e9c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 msgr2=0x7f7d9811cea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.641+0000 7f7d8f7fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9811cac0 0x7f7d9811cea0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000e500 tx=0x7f7d9000e9c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.647+0000 7f7d9d6af640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:20.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.647+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 0x7f7d9809d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.647+0000 7f7d9d6af640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.647+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d98073150 con 0x7f7d9809d430 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 0x7f7d9809d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient: get_auth_request con 0x7f7d9809d430 auth_method 0 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 10 monclient(hunting): handle_auth_done global_id 4735 payload 824 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 1 -- 172.21.15.28:0/821000776 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7d98099cc0 con 0x7f7d9809d430 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d96ffd640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 0x7f7d9809d840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000e500 tx=0x7f7d90003760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d8f7fe640 10 client.4583.objecter ms_handle_connect 0x7f7d9809d430 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d8f7fe640 10 client.4583.objecter resend_mon_ops 2024-03-27T21:32:20.675 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.1 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7d90005490 con 0x7f7d9809d430 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d8f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d8f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.648+0000 7f7d8f7fe640 10 monclient: dump: 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.677 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 <== mon.1 v2:172.21.15.63:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9169 (secure 0 0 0) 0x7f7d90005020 con 0x7f7d9809d430 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 msgr2=0x7f7d9809d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 0x7f7d9809d840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000e500 tx=0x7f7d90003760 comp rx=0 tx=0).stop 2024-03-27T21:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 msgr2=0x7f7d9809d840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d8f7fe640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d9809d430 0x7f7d9809d840 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000e500 tx=0x7f7d90003760 comp rx=0 tx=0).stop 2024-03-27T21:32:20.679 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:20.679 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:20.679 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:20.679 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "leader", 2024-03-27T21:32:20.679 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 5, 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.683 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:20.684 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:20.685 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.686 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.687 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.689 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.690 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:20.691 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.692 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:20.693 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.694 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.695 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.696 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.697 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.698 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:20.699 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.700 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:20.701 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.702 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.703 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.704 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:20.705 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.706 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.707 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.708 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.709 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.710 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.711 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:20.712 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.713 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:20.714 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 10 librados: watch_flush enter 2024-03-27T21:32:20.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 10 librados: watch_flush exit 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 20 client.4583.objecter shutdown clearing up homeless session... 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 10 client.4583.objecter successfully canceled tick 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7d7803a240 msgr2=0x7f7d7803c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7d7803a240 0x7f7d7803c700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7d9811d600 tx=0x7f7d8800b040 comp rx=0 tx=0).stop 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 10 monclient: shutdown 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7d98134f40 msgr2=0x7f7d981318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 --2- 172.21.15.28:0/821000776 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7d98134f40 0x7f7d981318b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d80000c00 tx=0x7f7d800046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d977fe640 1 -- 172.21.15.28:0/821000776 reap_dead start 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d977fe640 1 -- 172.21.15.28:0/821000776 reap_dead start 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 shutdown_connections 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 >> 172.21.15.28:0/821000776 conn(0x7f7d980a6670 msgr2=0x7f7d9809a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 shutdown_connections 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 -- 172.21.15.28:0/821000776 wait complete. 2024-03-27T21:32:20.718 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.649+0000 7f7d9d6af640 1 librados: shutdown 2024-03-27T21:32:20.719 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:20.719 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-03-27T21:32:20.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-03-27T21:32:20.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.832+0000 7febdd392640 10 monclient: get_monmap_and_config 2024-03-27T21:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.832+0000 7febdd392640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.833+0000 7febdd392640 10 monclient: monmap: 2024-03-27T21:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:20.833756+0000 2024-03-27T21:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:20.833756+0000 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.833+0000 7febdd392640 1 Processor -- start 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.833+0000 7febdd392640 1 -- start start 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.833+0000 7febdd392640 10 monclient: init 2024-03-27T21:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient: _add_conns ranks=[9,8,5,3,4,6,2,7,0,1,10] 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 0x7febd81370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): picked mon.noname-a con 0x7febd8136d00 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd8137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): picked mon.noname-e con 0x7febd80a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd81339e0 0x7febd8133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): picked mon.noname-h con 0x7febd81339e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80a25b0 con 0x7febd8136d00 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febd8137b60 con 0x7febd81339e0 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7febd80a13f0 con 0x7febd80a3d70 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febdd392640 10 monclient(hunting): authenticate will time out at 963.140850s 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd8137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 0x7febd81370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd8137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44204/0 (socket says 172.21.15.28:44204) 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 0x7febd81370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58376/0 (socket says 172.21.15.28:58376) 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 -- 172.21.15.28:0/2356239728 learned_addr learned my addr 172.21.15.28:0/2356239728 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): get_auth_request con 0x7febd80a3d70 auth_method 0 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): get_auth_request con 0x7febd8136d00 auth_method 0 2024-03-27T21:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd77fe640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd81339e0 0x7febd8133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd77fe640 10 monclient(hunting): get_auth_request con 0x7febd81339e0 auth_method 0 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient(hunting): handle_auth_done global_id 4553 payload 274 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 -- 172.21.15.28:0/2356239728 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd81339e0 msgr2=0x7febd8133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd81339e0 0x7febd8133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 -- 172.21.15.28:0/2356239728 >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 msgr2=0x7febd81370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:20.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 --2- 172.21.15.28:0/2356239728 >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 0x7febd81370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 monclient: found mon.noname-e 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd67fc640 1 -- 172.21.15.28:0/2356239728 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80618f0 con 0x7febd80a3d70 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd6ffd640 1 --2- 172.21.15.28:0/2356239728 >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 0x7febd81370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.834+0000 7febd77fe640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd81339e0 0x7febd8133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:20.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd67fc640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd8137620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7febc0009870 tx=0x7febc002b7c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b1150f1376d018f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 1 -- 172.21.15.28:0/2356239728 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7febc0031990 con 0x7febd80a3d70 2024-03-27T21:32:20.840 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: dump: 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.842 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.843 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 1 -- 172.21.15.28:0/2356239728 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc0031b10 con 0x7febd80a3d70 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 5 monclient: authenticate success, global_id 4553 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:20.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 1 -- 172.21.15.28:0/2356239728 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7febc0031cc0 con 0x7febd80a3d70 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 4 set_mon_vals no callback set 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febd5ffb640 10 monclient: dump: 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.845 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.846 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 10 monclient: shutdown 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 -- 172.21.15.28:0/2356239728 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 msgr2=0x7febd8137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd8137620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7febc0009870 tx=0x7febc002b7c0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 -- 172.21.15.28:0/2356239728 shutdown_connections 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd81339e0 0x7febd8133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 --2- 172.21.15.28:0/2356239728 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd8137620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 --2- 172.21.15.28:0/2356239728 >> v2:172.21.15.28:3300/0 conn(0x7febd8136d00 0x7febd81370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.835+0000 7febdd392640 1 -- 172.21.15.28:0/2356239728 >> 172.21.15.28:0/2356239728 conn(0x7febd80a9430 msgr2=0x7febd80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.836+0000 7febdd392640 1 -- 172.21.15.28:0/2356239728 shutdown_connections 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.836+0000 7febdd392640 1 -- 172.21.15.28:0/2356239728 wait complete. 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.836+0000 7febdd392640 10 monclient: build_initial_monmap 2024-03-27T21:32:20.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.836+0000 7febdd392640 10 monclient: monmap: 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:20.849 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.836+0000 7febdd392640 1 librados: starting msgr at 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.836+0000 7febdd392640 1 librados: starting objecter 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 Processor -- start 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 -- start start 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 librados: setting wanted keys 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 librados: calling monclient init 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient: init 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient: _add_conns ranks=[8,2,5,6,4,7,0,1,3] 2024-03-27T21:32:20.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd81cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): picked mon.noname-e con 0x7febd80a3d70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 0x7febd8132b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): picked mon.noname-b con 0x7febd81339e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd8136d00 0x7febd81330a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): picked mon.noname-h con 0x7febd8136d00 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd811fa20 con 0x7febd81339e0 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7febd8120240 con 0x7febd8136d00 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7febd80a11e0 con 0x7febd80a3d70 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febdd392640 10 monclient(hunting): authenticate will time out at 963.144240s 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd81cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 0x7febd8132b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd81cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44216/0 (socket says 172.21.15.28:44216) 2024-03-27T21:32:20.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 -- 172.21.15.28:0/2766225735 learned_addr learned my addr 172.21.15.28:0/2766225735 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): get_auth_request con 0x7febd80a3d70 auth_method 0 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): get_auth_request con 0x7febd81339e0 auth_method 0 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.854 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 msgr2=0x7febd8132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 msgr2=0x7febd8132b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:20.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd77fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd8136d00 0x7febd81330a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 0x7febd8132b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd77fe640 10 monclient(hunting): get_auth_request con 0x7febd8136d00 auth_method 0 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd67fc640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 0x7febd8132b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient(hunting): handle_auth_done global_id 4562 payload 824 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd8136d00 msgr2=0x7febd81330a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd8136d00 0x7febd81330a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 msgr2=0x7febd8132b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7febd81339e0 0x7febd8132b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient: _finish_hunting 0 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 monclient: found mon.noname-e 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd6ffd640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd0009400 con 0x7febd80a3d70 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.837+0000 7febd77fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7febd8136d00 0x7febd81330a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:20.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febd6ffd640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd81cb250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febd000e960 tx=0x7febd000ee20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 client.?.objecter ms_handle_connect 0x7febd80a3d70 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7febd000ce70 con 0x7febd80a3d70 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: dump: 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.858 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.859 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: _finish_auth 0 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:32:20.860 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0013470 con 0x7febd80a3d70 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 5 monclient: authenticate success, global_id 4562 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7febd0013a50 con 0x7febd80a3d70 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 10 monclient: _renew_subs 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc00094d0 con 0x7febd80a3d70 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febd57fa640 4 set_mon_vals no callback set 2024-03-27T21:32:20.861 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febcf7fe640 10 monclient: dump: 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.862 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.863 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 10 client.4562.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 10 monclient: _renew_subs 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd811ff60 con 0x7febd80a3d70 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.838+0000 7febdd392640 1 librados: init done 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7febd0013bd0 con 0x7febd80a3d70 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7febb803a250 0x7febb803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febdd392640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7febd0049f90 con 0x7febd80a3d70 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 10 client.4562.objecter ms_dispatch 0x7febd8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febdd392640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 0x7febd809cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 3 client.4562.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 3 client.4562.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd8069c80 con 0x7febd809c810 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 20 client.4562.objecter dump_active .. 0 homeless 2024-03-27T21:32:20.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd67fc640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7febb803a250 0x7febb803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 0x7febd809cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd67fc640 10 monclient: get_auth_request con 0x7febb803a250 auth_method 0 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient: get_auth_request con 0x7febd809c810 auth_method 0 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 10 monclient(hunting): handle_auth_done global_id 4602 payload 824 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd77fe640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febd80a0b80 con 0x7febd809c810 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febcf7fe640 10 client.4562.objecter ms_handle_connect 0x7febb803a250 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.839+0000 7febd67fc640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7febb803a250 0x7febb803c710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febc0035000 tx=0x7febc0030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 client.4562.objecter ms_handle_connect 0x7febd809c810 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 client.4562.objecter resend_mon_ops 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febd77fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 0x7febd809cbf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7febc8004650 tx=0x7febc8007700 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7febc8014880 con 0x7febd809c810 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 monclient: dump: 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.868 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.869 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.3 v2:172.21.15.63:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7febc800f050 con 0x7febd809c810 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 msgr2=0x7febd809cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 0x7febd809cbf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7febc8004650 tx=0x7febc8007700 comp rx=0 tx=0).stop 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 msgr2=0x7febd809cbf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.840+0000 7febcf7fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809c810 0x7febd809cbf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.846+0000 7febdd392640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.846+0000 7febdd392640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 0x7febd80a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.846+0000 7febdd392640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.846+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd8073150 con 0x7febd809d130 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 0x7febd80a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient: get_auth_request con 0x7febd809d130 auth_method 0 2024-03-27T21:32:20.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 10 monclient(hunting): handle_auth_done global_id 4611 payload 824 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 1 -- 172.21.15.28:0/2766225735 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7febd80a3020 con 0x7febd809d130 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febd77fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 0x7febd80a7100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7febc8004650 tx=0x7febc8004a40 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:20.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febcf7fe640 10 client.4562.objecter ms_handle_connect 0x7febd809d130 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febcf7fe640 10 client.4562.objecter resend_mon_ops 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7febc8023070 con 0x7febd809d130 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febcf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febcf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.847+0000 7febcf7fe640 10 monclient: dump: 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.875 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:20.876 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 <== mon.3 v2:172.21.15.63:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9337 (secure 0 0 0) 0x7febc801c380 con 0x7febd809d130 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 msgr2=0x7febd80a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 0x7febd80a7100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7febc8004650 tx=0x7febc8004a40 comp rx=0 tx=0).stop 2024-03-27T21:32:20.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 msgr2=0x7febd80a7100 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:20.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febcf7fe640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7febd809d130 0x7febd80a7100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.878 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:20.878 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:20.878 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:20.879 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 5, 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:20.880 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.881 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.882 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:20.883 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:20.884 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:20.885 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.886 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.887 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.888 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.889 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.890 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.891 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.892 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:20.893 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.894 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:20.895 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.896 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:20.897 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.898 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.899 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.900 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.901 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.902 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:20.903 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.904 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:20.905 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.906 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.907 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.908 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:20.909 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:20.910 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.911 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:20.912 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:20.913 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:20.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 10 librados: watch_flush enter 2024-03-27T21:32:20.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 10 librados: watch_flush exit 2024-03-27T21:32:20.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 20 client.4562.objecter shutdown clearing up homeless session... 2024-03-27T21:32:20.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 10 client.4562.objecter successfully canceled tick 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7febb803a250 msgr2=0x7febb803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7febb803a250 0x7febb803c710 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febc0035000 tx=0x7febc0030000 comp rx=0 tx=0).stop 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 10 monclient: shutdown 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 msgr2=0x7febd81cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febd77fe640 1 -- 172.21.15.28:0/2766225735 reap_dead start 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd81cb250 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7febd000e960 tx=0x7febd000ee20 comp rx=0 tx=0).stop 2024-03-27T21:32:20.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 shutdown_connections 2024-03-27T21:32:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 --2- 172.21.15.28:0/2766225735 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7febd80a3d70 0x7febd81cb250 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 >> 172.21.15.28:0/2766225735 conn(0x7febd80a9430 msgr2=0x7febd8136560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 shutdown_connections 2024-03-27T21:32:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 -- 172.21.15.28:0/2766225735 wait complete. 2024-03-27T21:32:20.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:20.848+0000 7febdd392640 1 librados: shutdown 2024-03-27T21:32:20.917 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:20.918 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-03-27T21:32:20.918 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-03-27T21:32:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.030+0000 7fcf00742640 10 monclient: get_monmap_and_config 2024-03-27T21:32:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.030+0000 7fcf00742640 10 monclient: build_initial_monmap 2024-03-27T21:32:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.030+0000 7fcf00742640 10 monclient: monmap: 2024-03-27T21:32:21.019 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:21.031649+0000 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:21.031649+0000 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:21.020 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:21.021 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.031+0000 7fcf00742640 1 Processor -- start 2024-03-27T21:32:21.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.031+0000 7fcf00742640 1 -- start start 2024-03-27T21:32:21.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.031+0000 7fcf00742640 10 monclient: init 2024-03-27T21:32:21.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:21.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient: _add_conns ranks=[3,1,5,7,10,8,6,9,0,2,4] 2024-03-27T21:32:21.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fcef8136d00 0x7fcef81370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): picked mon.noname-g con 0x7fcef8136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:21.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcef80a3d70 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:21.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8137620 0x7fcef81340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): picked mon.noname-h con 0x7fcef8137620 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef80618f0 con 0x7fcef80a3d70 2024-03-27T21:32:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80a25b0 con 0x7fcef8136d00 2024-03-27T21:32:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80a13f0 con 0x7fcef8137620 2024-03-27T21:32:21.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcf00742640 10 monclient(hunting): authenticate will time out at 963.338857s 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fcef8136d00 0x7fcef81370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8137620 0x7fcef81340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefdcdd640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcef80a3d70 0x7fcef81339e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.28:56304/0 (socket says 172.21.15.28:56304) 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefdcdd640 1 -- 172.21.15.28:0/658379184 learned_addr learned my addr 172.21.15.28:0/658379184 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): get_auth_request con 0x7fcef8136d00 auth_method 0 2024-03-27T21:32:21.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): get_auth_request con 0x7fcef8137620 auth_method 0 2024-03-27T21:32:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient(hunting): handle_auth_done global_id 4620 payload 274 2024-03-27T21:32:21.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 1 -- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8137620 msgr2=0x7fcef81340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 1 --2- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8137620 0x7fcef81340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 1 -- 172.21.15.28:0/658379184 >> v1:172.21.15.63:6789/0 conn(0x7fcef80a3d70 legacy=0x7fcef81339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefd4dc640 1 -- 172.21.15.28:0/658379184 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011153575 0 0) 0x7fcef80618f0 con 0x7fcef80a3d70 2024-03-27T21:32:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient: _finish_hunting 0 2024-03-27T21:32:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 1 monclient: found mon.noname-g 2024-03-27T21:32:21.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:32:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefe4de640 1 -- 172.21.15.28:0/658379184 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80a1f60 con 0x7fcef8136d00 2024-03-27T21:32:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefecdf640 1 --2- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8137620 0x7fcef81340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.032+0000 7fcefd4dc640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:32:21.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefe4de640 1 --2- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fcef8136d00 0x7fcef81370e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009dc0 tx=0x7fcee802bd50 comp rx=0 tx=0).ready entity=mon.3 client_cookie=b9ffd7ebaf74fa33 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 1 -- 172.21.15.28:0/658379184 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcee802cd70 con 0x7fcef8136d00 2024-03-27T21:32:21.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: dump: 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.047 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.048 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: _finish_auth 0 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 1 -- 172.21.15.28:0/658379184 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8032340 con 0x7fcef8136d00 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcf00742640 5 monclient: authenticate success, global_id 4620 2024-03-27T21:32:21.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 1 -- 172.21.15.28:0/658379184 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcee80324b0 con 0x7fcef8136d00 2024-03-27T21:32:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcf00742640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcf00742640 4 set_mon_vals no callback set 2024-03-27T21:32:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:32:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.033+0000 7fcefd4dc640 10 monclient: dump: 2024-03-27T21:32:21.050 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.051 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.052 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 10 monclient: shutdown 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 -- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fcef8136d00 msgr2=0x7fcef81370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 --2- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fcef8136d00 0x7fcef81370e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcee8009dc0 tx=0x7fcee802bd50 comp rx=0 tx=0).stop 2024-03-27T21:32:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 -- 172.21.15.28:0/658379184 shutdown_connections 2024-03-27T21:32:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 --2- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8137620 0x7fcef81340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 --2- 172.21.15.28:0/658379184 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fcef8136d00 0x7fcef81370e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 -- 172.21.15.28:0/658379184 >> 172.21.15.28:0/658379184 conn(0x7fcef80a9430 msgr2=0x7fcef80a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 -- 172.21.15.28:0/658379184 shutdown_connections 2024-03-27T21:32:21.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 1 -- 172.21.15.28:0/658379184 wait complete. 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 10 monclient: build_initial_monmap 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.034+0000 7fcf00742640 10 monclient: monmap: 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:21.055 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:21.056 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 librados: starting msgr at 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 librados: starting objecter 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 Processor -- start 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 -- start start 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 librados: setting wanted keys 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 librados: calling monclient init 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient: init 2024-03-27T21:32:21.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient: _add_conns ranks=[2,5,6,4,3,0,1,7,8] 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fcef80a3d70 0x7fcef81cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): picked mon.noname-b con 0x7fcef80a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8136d00 0x7fcef8133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): picked mon.noname-h con 0x7fcef8136d00 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 0x7fcef81341a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): picked mon.noname-d con 0x7fcef8137620 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8120da0 con 0x7fcef80a3d70 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80a1630 con 0x7fcef8136d00 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80a11e0 con 0x7fcef8137620 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:21.059 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcf00742640 10 monclient(hunting): authenticate will time out at 963.342369s 2024-03-27T21:32:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 0x7fcef81341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fcef80a3d70 0x7fcef81cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 0x7fcef81341a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45128/0 (socket says 172.21.15.28:45128) 2024-03-27T21:32:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 1 -- 172.21.15.28:0/4121431575 learned_addr learned my addr 172.21.15.28:0/4121431575 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): get_auth_request con 0x7fcef8137620 auth_method 0 2024-03-27T21:32:21.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): get_auth_request con 0x7fcef80a3d70 auth_method 0 2024-03-27T21:32:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefdcdd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8136d00 0x7fcef8133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefecdf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefdcdd640 10 monclient(hunting): get_auth_request con 0x7fcef8136d00 auth_method 0 2024-03-27T21:32:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefdcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefdcdd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.035+0000 7fcefdcdd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefdcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefdcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefdcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 10 monclient(hunting): handle_auth_done global_id 4569 payload 824 2024-03-27T21:32:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8136d00 msgr2=0x7fcef8133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef8136d00 0x7fcef8133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fcef80a3d70 msgr2=0x7fcef81cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fcef80a3d70 0x7fcef81cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 10 monclient: _finish_hunting 0 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 monclient: found mon.noname-d 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef0009400 con 0x7fcef8137620 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefe4de640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fcef80a3d70 0x7fcef81cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefecdf640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 0x7fcef81341a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcef000e7d0 tx=0x7fcef000ec90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 client.?.objecter ms_handle_connect 0x7fcef8137620 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcef00095b0 con 0x7fcef8137620 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: dump: 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.067 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.068 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:21.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef000cdb0 con 0x7fcef8137620 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 5 monclient: authenticate success, global_id 4569 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 10 monclient: _renew_subs 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee8009a70 con 0x7fcef8137620 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcef000eee0 con 0x7fcef8137620 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcefccdb640 4 set_mon_vals no callback set 2024-03-27T21:32:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 10 client.4569.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcef6ffd640 10 monclient: dump: 2024-03-27T21:32:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.071 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.072 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.073 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.074 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.074 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 10 monclient: _renew_subs 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef811fbc0 con 0x7fcef8137620 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.036+0000 7fcf00742640 1 librados: init done 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcf00742640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcf00742640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 0x7fcef809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8121140 con 0x7fcef809d8c0 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fcef000c940 con 0x7fcef8137620 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fcee403a280 0x7fcee403c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fcef0049e30 con 0x7fcef8137620 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 10 client.4569.objecter ms_dispatch 0x7fcef8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 3 client.4569.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 3 client.4569.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:21.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 0x7fcef809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient: get_auth_request con 0x7fcef809d8c0 auth_method 0 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcef6ffd640 20 client.4569.objecter dump_active .. 0 homeless 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefdcdd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fcee403a280 0x7fcee403c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefdcdd640 10 monclient: get_auth_request con 0x7fcee403a280 auth_method 0 2024-03-27T21:32:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 10 monclient(hunting): handle_auth_done global_id 4541 payload 824 2024-03-27T21:32:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.037+0000 7fcefe4de640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcef80a3020 con 0x7fcef809d8c0 2024-03-27T21:32:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 client.4569.objecter ms_handle_connect 0x7fcef809d8c0 2024-03-27T21:32:21.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 client.4569.objecter resend_mon_ops 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 client.4569.objecter ms_handle_connect 0x7fcee403a280 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcefe4de640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 0x7fcef809dca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcef80a2f90 tx=0x7fcee8004a40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcefdcdd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fcee403a280 0x7fcee403c740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceec007f70 tx=0x7fceec007f00 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcee8007000 con 0x7fcef809d8c0 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 monclient: dump: 2024-03-27T21:32:21.079 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.080 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.081 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.082 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.5 v2:172.21.15.63:3302/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fcee8004620 con 0x7fcef809d8c0 2024-03-27T21:32:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 msgr2=0x7fcef809dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.082 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 0x7fcef809dca0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcef80a2f90 tx=0x7fcee8004a40 comp rx=0 tx=0).stop 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 msgr2=0x7fcef809dca0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.038+0000 7fcef6ffd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809d8c0 0x7fcef809dca0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.044+0000 7fcf00742640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.044+0000 7fcf00742640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 0x7fcef8099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.044+0000 7fcf00742640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.044+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8069c80 con 0x7fcef809e1e0 2024-03-27T21:32:21.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 0x7fcef8099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient: get_auth_request con 0x7fcef809e1e0 auth_method 0 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 10 monclient(hunting): handle_auth_done global_id 4550 payload 824 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 1 -- 172.21.15.28:0/4121431575 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcef8137ad0 con 0x7fcef809e1e0 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcefe4de640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 0x7fcef8099a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f80 tx=0x7fcee8031000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcef6ffd640 10 client.4569.objecter ms_handle_connect 0x7fcef809e1e0 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcef6ffd640 10 client.4569.objecter resend_mon_ops 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcee804e070 con 0x7fcef809e1e0 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcef6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcef6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.045+0000 7fcef6ffd640 10 monclient: dump: 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.086 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.087 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 <== mon.5 v2:172.21.15.63:3302/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9337 (secure 0 0 0) 0x7fcee8047400 con 0x7fcef809e1e0 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 msgr2=0x7fcef8099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 0x7fcef8099a00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f80 tx=0x7fcee8031000 comp rx=0 tx=0).stop 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 msgr2=0x7fcef8099a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:21.088 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcef6ffd640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fcef809e1e0 0x7fcef8099a00 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcee8000f80 tx=0x7fcee8031000 comp rx=0 tx=0).stop 2024-03-27T21:32:21.089 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:21.089 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:21.089 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:21.089 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:21.090 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 6, 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:21.091 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:21.092 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:21.092 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:21.092 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:21.092 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:21.092 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:21.092 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:21.093 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:21.094 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:21.094 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:21.094 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:21.094 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:21.094 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:21.094 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:21.095 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:21.096 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:21.097 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:21.098 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:21.098 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:21.098 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:21.098 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:21.098 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:21.098 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:21.099 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:21.100 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.101 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.102 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:21.102 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:21.102 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.102 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.102 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.103 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.103 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.103 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:21.103 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:21.103 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.104 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.104 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.104 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.104 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:21.104 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.105 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.106 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.107 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.108 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:21.109 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.110 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:21.111 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.112 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.113 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.113 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.113 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:21.113 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.113 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.114 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.115 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:21.116 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.117 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:21.118 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.119 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:21.120 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.121 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.122 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:21.123 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.123 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.123 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.123 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.123 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:21.123 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:21.124 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.124 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.124 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.124 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.124 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.124 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:21.125 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:21.125 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.125 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.125 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.125 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.125 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.126 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.127 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:21.128 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": [ 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.129 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.130 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.131 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:21.131 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:21.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 10 librados: watch_flush enter 2024-03-27T21:32:21.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 10 librados: watch_flush exit 2024-03-27T21:32:21.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 20 client.4569.objecter shutdown clearing up homeless session... 2024-03-27T21:32:21.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 10 client.4569.objecter successfully canceled tick 2024-03-27T21:32:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fcee403a280 msgr2=0x7fcee403c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fcee403a280 0x7fcee403c740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fceec007f70 tx=0x7fceec007f00 comp rx=0 tx=0).stop 2024-03-27T21:32:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 10 monclient: shutdown 2024-03-27T21:32:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:21.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 msgr2=0x7fcef81341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 0x7fcef81341a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcef000e7d0 tx=0x7fcef000ec90 comp rx=0 tx=0).stop 2024-03-27T21:32:21.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcefecdf640 1 -- 172.21.15.28:0/4121431575 reap_dead start 2024-03-27T21:32:21.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 shutdown_connections 2024-03-27T21:32:21.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 --2- 172.21.15.28:0/4121431575 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcef8137620 0x7fcef81341a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 >> 172.21.15.28:0/4121431575 conn(0x7fcef80a9430 msgr2=0x7fcef8134e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:21.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 shutdown_connections 2024-03-27T21:32:21.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 -- 172.21.15.28:0/4121431575 wait complete. 2024-03-27T21:32:21.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.046+0000 7fcf00742640 1 librados: shutdown 2024-03-27T21:32:21.138 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:21.138 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-03-27T21:32:21.138 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-03-27T21:32:21.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.251+0000 7fdaf3c3a640 10 monclient: get_monmap_and_config 2024-03-27T21:32:21.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.251+0000 7fdaf3c3a640 10 monclient: build_initial_monmap 2024-03-27T21:32:21.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.251+0000 7fdaf3c3a640 10 monclient: monmap: 2024-03-27T21:32:21.240 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:21.240 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.240 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:21.252564+0000 2024-03-27T21:32:21.240 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:21.252564+0000 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:21.241 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:21.242 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:21.242 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:21.242 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:21.242 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:21.242 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:21.242 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 Processor -- start 2024-03-27T21:32:21.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 -- start start 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient: init 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient: _add_conns ranks=[8,5,1,9,4,2,3,10,7,6,0] 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 0x7fdaec1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): picked mon.noname-e con 0x7fdaec136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdaec0a3d70 0x7fdaec137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): picked mon.noname-h con 0x7fdaec0a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fdaec1339e0 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaec0618f0 con 0x7fdaec1339e0 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec0a25b0 con 0x7fdaec0a3d70 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec137b60 con 0x7fdaec136d00 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:21.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.252+0000 7fdaf3c3a640 10 monclient(hunting): authenticate will time out at 963.559713s 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 0x7fdaec1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 0x7fdaec1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44226/0 (socket says 172.21.15.28:44226) 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 -- 172.21.15.28:0/3173707421 learned_addr learned my addr 172.21.15.28:0/3173707421 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): get_auth_request con 0x7fdaec136d00 auth_method 0 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf11d5640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdaec0a3d70 0x7fdaec137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_done global_id 4571 payload 274 2024-03-27T21:32:21.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 -- 172.21.15.28:0/3173707421 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdaec0a3d70 msgr2=0x7fdaec137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:21.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdaec0a3d70 0x7fdaec137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 -- 172.21.15.28:0/3173707421 >> v1:172.21.15.63:6789/0 conn(0x7fdaec1339e0 legacy=0x7fdaec133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient: _finish_hunting 0 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 monclient: found mon.noname-e 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf19d6640 1 -- 172.21.15.28:0/3173707421 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec0a13f0 con 0x7fdaec136d00 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf11d5640 10 monclient: get_auth_request con 0x7fdaec0a3d70 auth_method 0 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.253+0000 7fdaf11d5640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdaec0a3d70 0x7fdaec137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:21.261 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 0x7fdaec1370e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdae80098a0 tx=0x7fdae802b840 comp rx=0 tx=0).ready entity=mon.8 client_cookie=5cc4017d1d6d0c88 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 1 -- 172.21.15.28:0/3173707421 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdae802e070 con 0x7fdaec136d00 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: dump: 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.262 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.263 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.263 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.263 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.263 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.263 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.263 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: _finish_auth 0 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: _check_auth_tickets 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 1 -- 172.21.15.28:0/3173707421 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8031a10 con 0x7fdaec136d00 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 5 monclient: authenticate success, global_id 4571 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 1 -- 172.21.15.28:0/3173707421 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdae8031bc0 con 0x7fdaec136d00 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:21.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 4 set_mon_vals no callback set 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf09d4640 10 monclient: dump: 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.266 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.267 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 10 monclient: shutdown 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/3173707421 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 msgr2=0x7fdaec1370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 0x7fdaec1370e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdae80098a0 tx=0x7fdae802b840 comp rx=0 tx=0).stop 2024-03-27T21:32:21.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/3173707421 shutdown_connections 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fdaec0a3d70 0x7fdaec137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/3173707421 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fdaec136d00 0x7fdaec1370e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.254+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/3173707421 >> 172.21.15.28:0/3173707421 conn(0x7fdaec0a9430 msgr2=0x7fdaec0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/3173707421 shutdown_connections 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/3173707421 wait complete. 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 10 monclient: build_initial_monmap 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 10 monclient: monmap: 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:21.269 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:21.270 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 1 librados: starting msgr at 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 1 librados: starting objecter 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.255+0000 7fdaf3c3a640 1 Processor -- start 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 -- start start 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 librados: setting wanted keys 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 librados: calling monclient init 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient: init 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:21.272 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient: _add_conns ranks=[2,4,3,6,8,5,7,1,0] 2024-03-27T21:32:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdaec0a3d70 0x7fdaec1cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): picked mon.noname-b con 0x7fdaec0a3d70 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdaec1339e0 0x7fdaec132c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): picked mon.noname-c con 0x7fdaec1339e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fdaec136d00 0x7fdaec09c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): picked mon.noname-g con 0x7fdaec136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:21.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec1cb6b0 con 0x7fdaec0a3d70 2024-03-27T21:32:21.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec0a11e0 con 0x7fdaec136d00 2024-03-27T21:32:21.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec11fd60 con 0x7fdaec1339e0 2024-03-27T21:32:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf3c3a640 10 monclient(hunting): authenticate will time out at 963.563210s 2024-03-27T21:32:21.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdaec1339e0 0x7fdaec132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdaec0a3d70 0x7fdaec1cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdaec0a3d70 0x7fdaec1cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38462/0 (socket says 172.21.15.28:38462) 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 1 -- 172.21.15.28:0/1249682952 learned_addr learned my addr 172.21.15.28:0/1249682952 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdaec1339e0 0x7fdaec132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37390/0 (socket says 172.21.15.28:37390) 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): get_auth_request con 0x7fdaec0a3d70 auth_method 0 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): get_auth_request con 0x7fdaec1339e0 auth_method 0 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf21d7640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fdaec136d00 0x7fdaec09c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf21d7640 10 monclient(hunting): get_auth_request con 0x7fdaec136d00 auth_method 0 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf21d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf21d7640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf21d7640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient(hunting): handle_auth_done global_id 34159 payload 824 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fdaec136d00 msgr2=0x7fdaec09c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fdaec136d00 0x7fdaec09c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdaec0a3d70 msgr2=0x7fdaec1cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdaec0a3d70 0x7fdaec1cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient: _finish_hunting 0 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 monclient: found mon.noname-c 2024-03-27T21:32:21.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:21.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf11d5640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80094d0 con 0x7fdaec1339e0 2024-03-27T21:32:21.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.256+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fdaec0a3d70 0x7fdaec1cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:21.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf11d5640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdaec1339e0 0x7fdaec132c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00c7c0 tx=0x7fdadc00cc80 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 client.?.objecter ms_handle_connect 0x7fdaec1339e0 2024-03-27T21:32:21.280 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdadc007a90 con 0x7fdaec1339e0 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: dump: 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.281 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.282 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:21.283 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 5 monclient: authenticate success, global_id 34159 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdadc007c30 con 0x7fdaec1339e0 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 10 monclient: _renew_subs 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaec120040 con 0x7fdaec1339e0 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdadc007da0 con 0x7fdaec1339e0 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.284 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 10 client.34159.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae3fff640 4 set_mon_vals no callback set 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdae27fc640 10 monclient: dump: 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.285 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.286 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 10 monclient: _renew_subs 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaec09e460 con 0x7fdaec1339e0 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.257+0000 7fdaf3c3a640 1 librados: init done 2024-03-27T21:32:21.287 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fdadc007620 con 0x7fdaec1339e0 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf3c3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 0x7fdaec09cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec069c80 con 0x7fdaec133180 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdad003a280 0x7fdad003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fdadc049fa0 con 0x7fdaec1339e0 2024-03-27T21:32:21.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 10 client.34159.objecter ms_dispatch 0x7fdaec000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 3 client.34159.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 3 client.34159.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 20 client.34159.objecter dump_active .. 0 homeless 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 0x7fdaec09cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient: get_auth_request con 0x7fdaec133180 auth_method 0 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf21d7640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdad003a280 0x7fdad003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf21d7640 10 monclient: get_auth_request con 0x7fdad003a280 auth_method 0 2024-03-27T21:32:21.290 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_done global_id 4624 payload 824 2024-03-27T21:32:21.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaec0a3020 con 0x7fdaec133180 2024-03-27T21:32:21.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 10 client.34159.objecter ms_handle_connect 0x7fdad003a280 2024-03-27T21:32:21.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf21d7640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdad003a280 0x7fdad003c740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdae40012e0 tx=0x7fdae4009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 10 client.34159.objecter ms_handle_connect 0x7fdaec133180 2024-03-27T21:32:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdae27fc640 10 client.34159.objecter resend_mon_ops 2024-03-27T21:32:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.258+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 0x7fdaec09cd20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000c00 tx=0x7fdae80046c0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdae8041070 con 0x7fdaec133180 2024-03-27T21:32:21.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:32:21.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 10 monclient: dump: 2024-03-27T21:32:21.294 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.294 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.295 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.296 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.297 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.297 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.297 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.297 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.298 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.298 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.7 v2:172.21.15.63:3303/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+8468 (secure 0 0 0) 0x7fdae8003610 con 0x7fdaec133180 2024-03-27T21:32:21.298 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:21.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 msgr2=0x7fdaec09cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 0x7fdaec09cd20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000c00 tx=0x7fdae80046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.299 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 msgr2=0x7fdaec09cd20 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:21.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.259+0000 7fdae27fc640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec133180 0x7fdaec09cd20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.265+0000 7fdaf3c3a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-03-27T21:32:21.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.265+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 0x7fdaec0a7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.265+0000 7fdaf3c3a640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.300 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.265+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fdaec073150 con 0x7fdaec09d260 2024-03-27T21:32:21.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.265+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 0x7fdaec0a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient: get_auth_request con 0x7fdaec09d260 auth_method 0 2024-03-27T21:32:21.301 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.302 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 10 monclient(hunting): handle_auth_done global_id 4633 payload 824 2024-03-27T21:32:21.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 1 -- 172.21.15.28:0/1249682952 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fdaec0a2240 con 0x7fdaec09d260 2024-03-27T21:32:21.303 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 client.34159.objecter ms_handle_connect 0x7fdaec09d260 2024-03-27T21:32:21.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 client.34159.objecter resend_mon_ops 2024-03-27T21:32:21.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdaf19d6640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 0x7fdaec0a7050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdae802b880 tx=0x7fdae8031000 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdae8032ea0 con 0x7fdaec09d260 2024-03-27T21:32:21.304 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:32:21.305 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 monclient: dump: 2024-03-27T21:32:21.305 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.306 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.306 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.306 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.306 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.307 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.307 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.307 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.307 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.308 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.308 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.308 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.308 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.309 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.309 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.309 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 <== mon.7 v2:172.21.15.63:3303/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+9337 (secure 0 0 0) 0x7fdae8057410 con 0x7fdaec09d260 2024-03-27T21:32:21.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-03-27T21:32:21.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:21.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 msgr2=0x7fdaec0a7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.310 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 0x7fdaec0a7050 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdae802b880 tx=0x7fdae8031000 comp rx=0 tx=0).stop 2024-03-27T21:32:21.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 msgr2=0x7fdaec0a7050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:21.311 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.266+0000 7fdae27fc640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fdaec09d260 0x7fdaec0a7050 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.312 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:21.312 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:21.312 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:21.313 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "peon", 2024-03-27T21:32:21.313 INFO:teuthology.orchestra.run.smithi028.stdout: "election_epoch": 20, 2024-03-27T21:32:21.313 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum": [ 2024-03-27T21:32:21.313 INFO:teuthology.orchestra.run.smithi028.stdout: 0, 2024-03-27T21:32:21.313 INFO:teuthology.orchestra.run.smithi028.stdout: 1, 2024-03-27T21:32:21.314 INFO:teuthology.orchestra.run.smithi028.stdout: 2, 2024-03-27T21:32:21.314 INFO:teuthology.orchestra.run.smithi028.stdout: 3, 2024-03-27T21:32:21.314 INFO:teuthology.orchestra.run.smithi028.stdout: 4, 2024-03-27T21:32:21.314 INFO:teuthology.orchestra.run.smithi028.stdout: 5, 2024-03-27T21:32:21.314 INFO:teuthology.orchestra.run.smithi028.stdout: 6, 2024-03-27T21:32:21.315 INFO:teuthology.orchestra.run.smithi028.stdout: 7, 2024-03-27T21:32:21.315 INFO:teuthology.orchestra.run.smithi028.stdout: 8 2024-03-27T21:32:21.315 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.315 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_age": 6, 2024-03-27T21:32:21.315 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "required_con": "2449958758054445060", 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "required_mon": [ 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:21.316 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_con": "4540138322906710015", 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "quorum_mon": [ 2024-03-27T21:32:21.317 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:21.318 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "outside_quorum": [], 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "extra_probe_peers": [], 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "sync_provider": [], 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "monmap": { 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "epoch": 1, 2024-03-27T21:32:21.319 INFO:teuthology.orchestra.run.smithi028.stdout: "fsid": "4104f5c5-b145-4d95-98f1-cb5df7cc2f83", 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "modified": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "created": "2024-03-27T21:29:39.649723Z", 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release": 18, 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "min_mon_release_name": "reef", 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "election_strategy": 3, 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "disallowed_leaders: ": "", 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false, 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "tiebreaker_mon": "", 2024-03-27T21:32:21.320 INFO:teuthology.orchestra.run.smithi028.stdout: "removed_ranks: ": "", 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "features": { 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "persistent": [ 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "kraken", 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "luminous", 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "mimic", 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap-prune", 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "nautilus", 2024-03-27T21:32:21.321 INFO:teuthology.orchestra.run.smithi028.stdout: "octopus", 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: "pacific", 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: "elector-pinging", 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: "quincy", 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: "reef" 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: "optional": [] 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: "mons": [ 2024-03-27T21:32:21.322 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 0, 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "a", 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3300", 2024-03-27T21:32:21.323 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789", 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.324 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6789/0", 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6789/0", 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 1, 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "f", 2024-03-27T21:32:21.325 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3300", 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.326 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789", 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6789/0", 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6789/0", 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.327 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 2, 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "b", 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.328 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3301", 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790", 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.329 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6790/0", 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6790/0", 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.330 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 3, 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "g", 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.331 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3301", 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790", 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.332 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6790/0", 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6790/0", 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.333 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 4, 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "c", 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3302", 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.334 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791", 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6791/0", 2024-03-27T21:32:21.335 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6791/0", 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 5, 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "h", 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.336 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3302", 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.337 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791", 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6791/0", 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6791/0", 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.338 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 6, 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "d", 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.339 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3303", 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792", 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.340 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6792/0", 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6792/0", 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.341 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 7, 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "i", 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:3303", 2024-03-27T21:32:21.342 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792", 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.343 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.63:6792/0", 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.63:6792/0", 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "rank": 8, 2024-03-27T21:32:21.344 INFO:teuthology.orchestra.run.smithi028.stdout: "name": "e", 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addrs": { 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: "addrvec": [ 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v2", 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:3304", 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.345 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: "type": "v1", 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793", 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: "nonce": 0 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: "addr": "172.21.15.28:6793/0", 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: "public_addr": "172.21.15.28:6793/0", 2024-03-27T21:32:21.346 INFO:teuthology.orchestra.run.smithi028.stdout: "priority": 0, 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: "weight": 0, 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: "crush_location": "{}" 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: "feature_map": { 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": [ 2024-03-27T21:32:21.347 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: "client": [ 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:21.348 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 3 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: ], 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": [ 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: { 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: "features": "0x3f01cfbffffdffff", 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: "release": "luminous", 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: "num": 1 2024-03-27T21:32:21.349 INFO:teuthology.orchestra.run.smithi028.stdout: } 2024-03-27T21:32:21.350 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2024-03-27T21:32:21.350 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2024-03-27T21:32:21.350 INFO:teuthology.orchestra.run.smithi028.stdout: "stretch_mode": false 2024-03-27T21:32:21.350 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 10 librados: watch_flush enter 2024-03-27T21:32:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 10 librados: watch_flush exit 2024-03-27T21:32:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 20 client.34159.objecter shutdown clearing up homeless session... 2024-03-27T21:32:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 10 client.34159.objecter successfully canceled tick 2024-03-27T21:32:21.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdad003a280 msgr2=0x7fdad003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fdad003a280 0x7fdad003c740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdae40012e0 tx=0x7fdae4009040 comp rx=0 tx=0).stop 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 10 monclient: shutdown 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdaec1339e0 msgr2=0x7fdaec132c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 --2- 172.21.15.28:0/1249682952 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fdaec1339e0 0x7fdaec132c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdadc00c7c0 tx=0x7fdadc00cc80 comp rx=0 tx=0).stop 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf21d7640 1 -- 172.21.15.28:0/1249682952 reap_dead start 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf21d7640 1 -- 172.21.15.28:0/1249682952 reap_dead start 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 shutdown_connections 2024-03-27T21:32:21.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 >> 172.21.15.28:0/1249682952 conn(0x7fdaec0a9430 msgr2=0x7fdaec1365b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:21.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 shutdown_connections 2024-03-27T21:32:21.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 -- 172.21.15.28:0/1249682952 wait complete. 2024-03-27T21:32:21.354 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.267+0000 7fdaf3c3a640 1 librados: shutdown 2024-03-27T21:32:21.354 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-03-27T21:32:21.354 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-03-27T21:32:21.355 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-03-27T21:32:21.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.468+0000 7f2465f73640 10 monclient: get_monmap_and_config 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.468+0000 7f2465f73640 10 monclient: build_initial_monmap 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.468+0000 7f2465f73640 10 monclient: monmap: 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:21.469552+0000 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:21.469552+0000 2024-03-27T21:32:21.457 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:21.458 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:21.459 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:21.459 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:21.459 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:21.459 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:21.459 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.467 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 Processor -- start 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 -- start start 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient: init 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient: _add_conns ranks=[9,4,7,1,10,2,3,0,8,6,5] 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2460133ea0 0x7f2460134280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): picked mon.noname-a con 0x7f2460133ea0 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:21.468 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24600a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): picked mon.noname-c con 0x7f24600a3400 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f24600a5210 0x7f24600a5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): picked mon.noname-i con 0x7f24600a5210 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24600a0b30 con 0x7f2460133ea0 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a2a20 con 0x7f24600a3400 2024-03-27T21:32:21.469 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a2180 con 0x7f24600a5210 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.469+0000 7f2465f73640 10 monclient(hunting): authenticate will time out at 963.776700s 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2460133ea0 0x7f2460134280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24600a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2460133ea0 0x7f2460134280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58380/0 (socket says 172.21.15.28:58380) 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 -- 172.21.15.28:0/2057900351 learned_addr learned my addr 172.21.15.28:0/2057900351 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:21.470 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): get_auth_request con 0x7f2460133ea0 auth_method 0 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): get_auth_request con 0x7f24600a3400 auth_method 0 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.471 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245ffff640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f24600a5210 0x7f24600a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient(hunting): handle_auth_done global_id 34155 payload 274 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 -- 172.21.15.28:0/2057900351 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f24600a5210 msgr2=0x7f24600a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f24600a5210 0x7f24600a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.472 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 -- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 msgr2=0x7f24600a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24600a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 monclient: found mon.noname-a 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245f7fe640 1 -- 172.21.15.28:0/2057900351 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600618f0 con 0x7f2460133ea0 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245ffff640 10 monclient: get_auth_request con 0x7f24600a5210 auth_method 0 2024-03-27T21:32:21.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245effd640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24600a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.470+0000 7f245ffff640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f24600a5210 0x7f24600a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245f7fe640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2460133ea0 0x7f2460134280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2450009870 tx=0x7f245002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80ddc1c6ba7936f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 1 -- 172.21.15.28:0/2057900351 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2450031990 con 0x7f2460133ea0 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: dump: 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.474 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.475 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:21.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 1 -- 172.21.15.28:0/2057900351 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450031b10 con 0x7f2460133ea0 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 5 monclient: authenticate success, global_id 34155 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 1 -- 172.21.15.28:0/2057900351 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2450031cc0 con 0x7f2460133ea0 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 4 set_mon_vals no callback set 2024-03-27T21:32:21.477 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f245e7fc640 10 monclient: dump: 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.478 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.479 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 10 monclient: shutdown 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 -- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2460133ea0 msgr2=0x7f2460134280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2460133ea0 0x7f2460134280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2450009870 tx=0x7f245002b7c0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 -- 172.21.15.28:0/2057900351 shutdown_connections 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f24600a5210 0x7f24600a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24600a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 --2- 172.21.15.28:0/2057900351 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2460133ea0 0x7f2460134280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 -- 172.21.15.28:0/2057900351 >> 172.21.15.28:0/2057900351 conn(0x7f24600a98f0 msgr2=0x7f24600a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:21.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 -- 172.21.15.28:0/2057900351 shutdown_connections 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.471+0000 7f2465f73640 1 -- 172.21.15.28:0/2057900351 wait complete. 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.472+0000 7f2465f73640 10 monclient: build_initial_monmap 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.472+0000 7f2465f73640 10 monclient: monmap: 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:21.481 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:21.482 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.472+0000 7f2465f73640 1 librados: starting msgr at 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.472+0000 7f2465f73640 1 librados: starting objecter 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.472+0000 7f2465f73640 1 Processor -- start 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 -- start start 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 librados: setting wanted keys 2024-03-27T21:32:21.483 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 librados: calling monclient init 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient: init 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient: _add_conns ranks=[4,0,5,1,6,2,8,7,3] 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24601cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): picked mon.noname-c con 0x7f24600a3400 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 0x7f2460132c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): picked mon.noname-a con 0x7f24600a5210 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2460133ea0 0x7f2460133160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): picked mon.noname-h con 0x7f2460133ea0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2460120140 con 0x7f24600a5210 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2460120670 con 0x7f24600a3400 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24600a1830 con 0x7f2460133ea0 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f2465f73640 10 monclient(hunting): authenticate will time out at 963.780229s 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24601cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.485 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 0x7f2460132c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24601cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37404/0 (socket says 172.21.15.28:37404) 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 0x7f2460132c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58384/0 (socket says 172.21.15.28:58384) 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 -- 172.21.15.28:0/920297971 learned_addr learned my addr 172.21.15.28:0/920297971 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): get_auth_request con 0x7f24600a3400 auth_method 0 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): get_auth_request con 0x7f24600a5210 auth_method 0 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:21.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient(hunting): handle_auth_done global_id 34177 payload 824 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 -- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2460133ea0 msgr2=0x7f2460133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245ffff640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2460133ea0 0x7f2460133160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2460133ea0 0x7f2460133160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 -- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 msgr2=0x7f2460132c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 0x7f2460132c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:21.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 monclient: found mon.noname-c 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245f7fe640 1 -- 172.21.15.28:0/920297971 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009400 con 0x7f24600a3400 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.473+0000 7f245effd640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 0x7f2460132c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f245f7fe640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24601cb520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24500090b0 tx=0x7f24500046c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 client.?.objecter ms_handle_connect 0x7f24600a3400 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2450004410 con 0x7f24600a3400 2024-03-27T21:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: dump: 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.491 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450003a80 con 0x7f24600a3400 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 5 monclient: authenticate success, global_id 34177 2024-03-27T21:32:21.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 10 monclient: _renew_subs 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24500094d0 con 0x7f24600a3400 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2450003bf0 con 0x7f24600a3400 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 10 client.34177.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:21.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2447fff640 10 monclient: dump: 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:21.494 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:21.495 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 10 monclient: _renew_subs 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f245d7fa640 4 set_mon_vals no callback set 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246009e500 con 0x7f24600a3400 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.474+0000 7f2465f73640 1 librados: init done 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f245003a040 con 0x7f24600a3400 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2465f73640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2465f73640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2465f73640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f244c03a280 0x7f244c03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2460067320 con 0x7f24600a3400 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f245006bc90 con 0x7f24600a3400 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 10 client.34177.objecter ms_dispatch 0x7f2460000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 3 client.34177.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 3 client.34177.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f2447fff640 20 client.34177.objecter dump_active .. 0 homeless 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f245effd640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f244c03a280 0x7f244c03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:21.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.475+0000 7f245effd640 10 monclient: get_auth_request con 0x7f244c03a280 auth_method 0 2024-03-27T21:32:21.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.476+0000 7f2447fff640 10 client.34177.objecter ms_handle_connect 0x7f244c03a280 2024-03-27T21:32:21.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.476+0000 7f245effd640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f244c03a280 0x7f244c03c740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f246009e070 tx=0x7f2454009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:21.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.480+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2450038070 con 0x7f24600a3400 2024-03-27T21:32:21.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.480+0000 7f2447fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:21.498 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.480+0000 7f2447fff640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:21.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.733+0000 7f2465f73640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-03-27T21:32:21.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.733+0000 7f2465f73640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-03-27T21:32:21.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.733+0000 7f2465f73640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:21.721 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.733+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f2460074b50 con 0x7f24600a3400 2024-03-27T21:32:21.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.734+0000 7f2447fff640 1 -- 172.21.15.28:0/920297971 <== mon.4 v2:172.21.15.28:3302/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f245004c030 con 0x7f24600a3400 2024-03-27T21:32:21.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.734+0000 7f2447fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-03-27T21:32:21.722 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.734+0000 7f2447fff640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.736+0000 7f2465f73640 10 librados: watch_flush enter 2024-03-27T21:32:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.736+0000 7f2465f73640 10 librados: watch_flush exit 2024-03-27T21:32:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 20 client.34177.objecter shutdown clearing up homeless session... 2024-03-27T21:32:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 10 client.34177.objecter successfully canceled tick 2024-03-27T21:32:21.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f244c03a280 msgr2=0x7f244c03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f244c03a280 0x7f244c03c740 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f246009e070 tx=0x7f2454009190 comp rx=0 tx=0).stop 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 10 monclient: shutdown 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 msgr2=0x7f24601cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24601cb520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f24500090b0 tx=0x7f24500046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 shutdown_connections 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f244c03a280 0x7f244c03c740 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2460133ea0 0x7f2460133160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f24600a5210 0x7f2460132c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 --2- 172.21.15.28:0/920297971 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f24600a3400 0x7f24601cb520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 >> 172.21.15.28:0/920297971 conn(0x7f24600a98f0 msgr2=0x7f24600662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 shutdown_connections 2024-03-27T21:32:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 -- 172.21.15.28:0/920297971 wait complete. 2024-03-27T21:32:21.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:21.737+0000 7f2465f73640 1 librados: shutdown 2024-03-27T21:32:21.739 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-03-27T21:32:21.740 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.740 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.740 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=11,config=2,health=9,kv=12,logm=66} crc {auth=3562248410,config=3541143443,health=3720815262,kv=798360932,logm=577349608}) 2024-03-27T21:32:21.740 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.740 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=2,health=10,kv=11,logm=67} crc {auth=980000370,config=3541143443,health=3135208335,kv=1530435386,logm=3827452548}) 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.734+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=10,config=2,health=11,kv=12,logm=65} crc {auth=983383250,config=3541143443,health=2775374382,kv=1820762523,logm=2519048355}) 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=11,config=2,health=12,kv=11,logm=64} crc {auth=28267714,config=3541143443,health=3897446751,kv=3383837415,logm=4269282948}) 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.741 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=10,config=2,health=12,kv=12,logm=64} crc {auth=235249050,config=3541143443,health=3897446751,kv=798360932,logm=1713102032}) 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=11,config=2,health=11,kv=12,logm=64} crc {auth=3562248410,config=3541143443,health=588522927,kv=798360932,logm=3207478128}) 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=9,config=2,health=11,kv=12,logm=66} crc {auth=1360572118,config=3541143443,health=344943315,kv=612034163,logm=2492899046}) 2024-03-27T21:32:21.742 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=11,config=2,health=12,kv=12,logm=63} crc {auth=3562248410,config=3541143443,health=3897446751,kv=798360932,logm=1182682864}) 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.735+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=11,config=2,health=10,kv=10,logm=67} crc {auth=3562248410,config=3541143443,health=3851865294,kv=3385419082,logm=2823747544}) 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1413828286}) 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.743 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=551277946}) 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3474052219}) 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1550583295}) 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.744 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=65732469}) 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3961984541}) 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=67771206}) 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1958185805}) 2024-03-27T21:32:21.745 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.736+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1531649537}) 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3142259834}) 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=257013828}) 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.746 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655294547}) 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3424780533}) 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3245719187}) 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.747 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4149130090}) 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3137418573}) 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1818661099}) 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.738+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3297911892}) 2024-03-27T21:32:21.748 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2612887604}) 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2819355057}) 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3542792983}) 2024-03-27T21:32:21.749 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=124652361}) 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3583087980}) 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.750 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2588595045}) 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2966479282}) 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=613379631}) 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.739+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2993125790}) 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.751 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1580413699}) 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=643985602}) 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3297554355}) 2024-03-27T21:32:21.752 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4126018312}) 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1814108734}) 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3285866987}) 2024-03-27T21:32:21.753 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=782287761}) 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2111752787}) 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.740+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2651620446}) 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.754 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=14,monmap=3} crc {logm=2021201626,mdsmap=1531151339,mgr=3617822132,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=864780933,mon_config_key=11162682,monmap=3711813130}) 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=5} crc {logm=2635359918,mdsmap=1531151339,mgr=1570033452,mgr_command_descs=470045235,mgrstat=895507417,mon_config_key=1237358448,monmap=3711813130,osd_metadata=888749311}) 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=13,monmap=3,osd_metadata=3} crc {logm=3544051448,mdsmap=1531151339,mgr=3617822132,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=3420535392,mon_config_key=3695197828,monmap=3711813130,osd_metadata=3165428004}) 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.755 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=60,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=12,monmap=3,osd_metadata=4} crc {logm=659393601,mdsmap=1531151339,mgr=1776704548,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=3087106705,mon_config_key=357624628,monmap=3711813130,osd_metadata=3462753721}) 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=1} crc {logm=206050125,mdsmap=1531151339,mgr=3617822132,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=1388440819,mon_config_key=2403044603,monmap=886632950,osd_metadata=3362393062}) 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=59,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=14,monmap=2,osd_metadata=2} crc {logm=4015996048,mdsmap=1531151339,mgr=1570033452,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=864780933,mon_config_key=11162682,monmap=886632950,osd_metadata=1273091804}) 2024-03-27T21:32:21.756 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=12,monmap=3,osd_metadata=2} crc {logm=3097017652,mdsmap=1531151339,mgr=3617822132,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=4025964827,mon_config_key=4201939305,monmap=3711813130,osd_metadata=1273091804}) 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=13,monmap=2,osd_metadata=5} crc {logm=1569680031,mdsmap=1531151339,mgr=2030386528,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=2306237873,mon_config_key=1866495072,monmap=886632950,osd_metadata=888749311}) 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.742+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=14,monmap=3,osd_metadata=2} crc {logm=2654098542,mdsmap=1531151339,mgr=3617822132,mgr_command_descs=470045235,mgr_metadata=1673177215,mgrstat=3420535392,mon_config_key=11162682,monmap=3711813130,osd_metadata=1273091804}) 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=1,osdmap=29} crc {osd_metadata=3253789359,osdmap=1299822601}) 2024-03-27T21:32:21.757 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=1143975311}) 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=29} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=951889696}) 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.758 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=32} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=768753059}) 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=32} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=3602297602}) 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=32} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=1698015575}) 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.759 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.760 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=2689891224}) 2024-03-27T21:32:21.760 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-03-27T21:32:21.760 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=219402408}) 2024-03-27T21:32:21.760 INFO:tasks.ceph.mon.f.smithi063.stderr:2024-03-27T21:32:21.745+0000 7f53ae2d4640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_metadata=1,osd_pg_creating=1,osdmap=33} crc {osd_metadata=3253789359,osd_pg_creating=534015559,osdmap=1143975311}) 2024-03-27T21:32:22.740 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-03-27T21:32:22.740 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-03-27T21:32:22.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.863+0000 7fa2850ca640 10 monclient: get_monmap_and_config 2024-03-27T21:32:22.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.863+0000 7fa2850ca640 10 monclient: build_initial_monmap 2024-03-27T21:32:22.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.863+0000 7fa2850ca640 10 monclient: monmap: 2024-03-27T21:32:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:22.864525+0000 2024-03-27T21:32:22.853 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:22.864525+0000 2024-03-27T21:32:22.854 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:22.854 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:22.854 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:22.854 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:22.855 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:22.855 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:22.855 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:22.855 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:22.855 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:22.855 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:22.856 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:22.856 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:22.856 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:22.856 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.864+0000 7fa2850ca640 1 Processor -- start 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.864+0000 7fa2850ca640 1 -- start start 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.864+0000 7fa2850ca640 10 monclient: init 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient: _add_conns ranks=[1,9,3,5,0,8,2,6,7,10,4] 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa280133ea0 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:22.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2800a3400 0x7fa28013c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): picked mon.noname-a con 0x7fa2800a3400 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa28013c5d0 0x7fa28013e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): picked mon.noname-g con 0x7fa28013c5d0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2800618f0 con 0x7fa280133ea0 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2800a0b30 con 0x7fa2800a3400 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:22.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800a2a20 con 0x7fa28013c5d0 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa2850ca640 10 monclient(hunting): authenticate will time out at 965.171859s 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2800a3400 0x7fa28013c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa2800a3400 0x7fa28013c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58398/0 (socket says 172.21.15.28:58398) 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 -- 172.21.15.28:0/843481084 learned_addr learned my addr 172.21.15.28:0/843481084 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): get_auth_request con 0x7fa2800a3400 auth_method 0 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:22.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 1 --2- 172.21.15.28:0/843481084 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa28013c5d0 0x7fa28013e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): get_auth_request con 0x7fa28013c5d0 auth_method 0 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa27f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:22.870 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient(hunting): handle_auth_done global_id 34173 payload 274 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 -- 172.21.15.28:0/843481084 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa28013c5d0 msgr2=0x7fa28013e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 --2- 172.21.15.28:0/843481084 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa28013c5d0 0x7fa28013e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 -- 172.21.15.28:0/843481084 >> v1:172.21.15.63:6789/0 conn(0x7fa280133ea0 legacy=0x7fa280134280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 monclient: found mon.noname-a 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:22.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.865+0000 7fa277fff640 1 -- 172.21.15.28:0/843481084 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800a2180 con 0x7fa2800a3400 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa277fff640 1 --2- 172.21.15.28:0/843481084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2800a3400 0x7fa28013c090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa268009870 tx=0x7fa26802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58544a63aa700e1c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 1 -- 172.21.15.28:0/843481084 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa268031a30 con 0x7fa2800a3400 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: dump: 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:22.872 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:22.873 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:22.874 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:22.874 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:22.874 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:22.874 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:22.874 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: _finish_auth 0 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: _check_auth_tickets 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 1 -- 172.21.15.28:0/843481084 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa268031bb0 con 0x7fa2800a3400 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa2850ca640 5 monclient: authenticate success, global_id 34173 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa2850ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:22.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 1 -- 172.21.15.28:0/843481084 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa268031d60 con 0x7fa2800a3400 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa2850ca640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa2850ca640 4 set_mon_vals no callback set 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.866+0000 7fa27e59c640 10 monclient: dump: 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:22.876 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:22.877 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 10 monclient: shutdown 2024-03-27T21:32:22.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:22.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 -- 172.21.15.28:0/843481084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2800a3400 msgr2=0x7fa28013c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:22.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 --2- 172.21.15.28:0/843481084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2800a3400 0x7fa28013c090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa268009870 tx=0x7fa26802b860 comp rx=0 tx=0).stop 2024-03-27T21:32:22.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 -- 172.21.15.28:0/843481084 shutdown_connections 2024-03-27T21:32:22.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 --2- 172.21.15.28:0/843481084 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa28013c5d0 0x7fa28013e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:22.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 --2- 172.21.15.28:0/843481084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa2800a3400 0x7fa28013c090 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:22.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 -- 172.21.15.28:0/843481084 >> 172.21.15.28:0/843481084 conn(0x7fa2800a98f0 msgr2=0x7fa2800a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:22.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 -- 172.21.15.28:0/843481084 shutdown_connections 2024-03-27T21:32:22.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 1 -- 172.21.15.28:0/843481084 wait complete. 2024-03-27T21:32:22.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 10 monclient: build_initial_monmap 2024-03-27T21:32:22.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.867+0000 7fa2850ca640 10 monclient: monmap: 2024-03-27T21:32:22.882 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 librados: starting msgr at 2024-03-27T21:32:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 librados: starting objecter 2024-03-27T21:32:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 Processor -- start 2024-03-27T21:32:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 -- start start 2024-03-27T21:32:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 librados: setting wanted keys 2024-03-27T21:32:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 librados: calling monclient init 2024-03-27T21:32:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient: init 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient: _add_conns ranks=[1,0,2,8,6,5,4,7,3] 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2800a3400 0x7fa28012a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): picked mon.noname-f con 0x7fa2800a3400 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 0x7fa28012af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): picked mon.noname-a con 0x7fa280133ea0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 0x7fa28012b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:22.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): picked mon.noname-b con 0x7fa28013c5d0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800a1830 con 0x7fa280133ea0 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2800a1400 con 0x7fa2800a3400 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28009e450 con 0x7fa28013c5d0 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:22.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa2850ca640 10 monclient(hunting): authenticate will time out at 965.175494s 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 0x7fa28012af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa27f59e640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 0x7fa28012b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 0x7fa28012af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58408/0 (socket says 172.21.15.28:58408) 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa27f59e640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 0x7fa28012b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38484/0 (socket says 172.21.15.28:38484) 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 1 -- 172.21.15.28:0/1579470842 learned_addr learned my addr 172.21.15.28:0/1579470842 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 10 monclient(hunting): get_auth_request con 0x7fa280133ea0 auth_method 0 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:22.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa27f59e640 10 monclient(hunting): get_auth_request con 0x7fa28013c5d0 auth_method 0 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa27f59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa27f59e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa27f59e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.868+0000 7fa277fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:22.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27f59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27f59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27f59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2800a3400 0x7fa28012a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): get_auth_request con 0x7fa2800a3400 auth_method 0 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:22.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 10 monclient(hunting): handle_auth_done global_id 34182 payload 824 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 -- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 msgr2=0x7fa28012b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 0x7fa28012b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 -- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2800a3400 msgr2=0x7fa28012a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:22.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2800a3400 0x7fa28012a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:22.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:22.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 monclient: found mon.noname-a 2024-03-27T21:32:22.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:22.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:22.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 -- 172.21.15.28:0/1579470842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2680094d0 con 0x7fa280133ea0 2024-03-27T21:32:22.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27f59e640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 0x7fa28012b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa277fff640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 0x7fa28012af00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa268000c00 tx=0x7fa2680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 client.?.objecter ms_handle_connect 0x7fa280133ea0 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa268004250 con 0x7fa280133ea0 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: dump: 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:22.893 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:22.894 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: _finish_auth 0 2024-03-27T21:32:22.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: _check_auth_tickets 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26803f070 con 0x7fa280133ea0 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 5 monclient: authenticate success, global_id 34182 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 10 monclient: _renew_subs 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28009c7d0 con 0x7fa280133ea0 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:22.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa2680043d0 con 0x7fa280133ea0 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 10 client.34182.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2777fe640 10 monclient: dump: 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.897 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:22.898 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa27dd9b640 4 set_mon_vals no callback set 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 10 monclient: _renew_subs 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28009c080 con 0x7fa280133ea0 2024-03-27T21:32:22.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.869+0000 7fa2850ca640 1 librados: init done 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa268003610 con 0x7fa280133ea0 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa26003a250 0x7fa26003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2850ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2850ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2850ca640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa26806b7d0 con 0x7fa280133ea0 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 10 client.34182.objecter ms_dispatch 0x7fa280000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:22.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 3 client.34182.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 3 client.34182.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa280067320 con 0x7fa280133ea0 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.870+0000 7fa2777fe640 20 client.34182.objecter dump_active .. 0 homeless 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.871+0000 7fa27ed9d640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa26003a250 0x7fa26003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.871+0000 7fa27ed9d640 10 monclient: get_auth_request con 0x7fa26003a250 auth_method 0 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.871+0000 7fa27ed9d640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa26003a250 0x7fa26003c710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa270000f60 tx=0x7fa270009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.871+0000 7fa2777fe640 10 client.34182.objecter ms_handle_connect 0x7fa26003a250 2024-03-27T21:32:22.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.875+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa26803a970 con 0x7fa280133ea0 2024-03-27T21:32:22.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.875+0000 7fa2777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:22.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:22.875+0000 7fa2777fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:23.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.124+0000 7fa2850ca640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-03-27T21:32:23.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.124+0000 7fa2850ca640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-03-27T21:32:23.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.124+0000 7fa2850ca640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.124+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa280074b50 con 0x7fa280133ea0 2024-03-27T21:32:23.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.125+0000 7fa2777fe640 1 -- 172.21.15.28:0/1579470842 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+3159 (secure 0 0 0) 0x7fa26803a380 con 0x7fa280133ea0 2024-03-27T21:32:23.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.125+0000 7fa2777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-03-27T21:32:23.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.125+0000 7fa2777fe640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:23.114 INFO:teuthology.orchestra.run.smithi028.stdout:{"election_epoch":20,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"f","quorum_age":8,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","modified":"2024-03-27T21:29:39.649723Z","created":"2024-03-27T21:29:39.649723Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3301","nonce":0},{"type":"v1","addr":"172.21.15.28:6790","nonce":0}]},"addr":"172.21.15.28:6790/0","public_addr":"172.21.15.28:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3301","nonce":0},{"type":"v1","addr":"172.21.15.63:6790","nonce":0}]},"addr":"172.21.15.63:6790/0","public_addr":"172.21.15.63:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3302","nonce":0},{"type":"v1","addr":"172.21.15.28:6791","nonce":0}]},"addr":"172.21.15.28:6791/0","public_addr":"172.21.15.28:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3302","nonce":0},{"type":"v1","addr":"172.21.15.63:6791","nonce":0}]},"addr":"172.21.15.63:6791/0","public_addr":"172.21.15.63:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3303","nonce":0},{"type":"v1","addr":"172.21.15.28:6792","nonce":0}]},"addr":"172.21.15.28:6792/0","public_addr":"172.21.15.28:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3303","nonce":0},{"type":"v1","addr":"172.21.15.63:6792","nonce":0}]},"addr":"172.21.15.63:6792/0","public_addr":"172.21.15.63:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3304","nonce":0},{"type":"v1","addr":"172.21.15.28:6793","nonce":0}]},"addr":"172.21.15.28:6793/0","public_addr":"172.21.15.28:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-03-27T21:32:23.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 10 librados: watch_flush enter 2024-03-27T21:32:23.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 10 librados: watch_flush exit 2024-03-27T21:32:23.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 20 client.34182.objecter shutdown clearing up homeless session... 2024-03-27T21:32:23.115 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 10 client.34182.objecter successfully canceled tick 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa26003a250 msgr2=0x7fa26003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa26003a250 0x7fa26003c710 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa270000f60 tx=0x7fa270009040 comp rx=0 tx=0).stop 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 10 monclient: shutdown 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 msgr2=0x7fa28012af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 0x7fa28012af00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa268000c00 tx=0x7fa2680046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 shutdown_connections 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa26003a250 0x7fa26003c710 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa28013c5d0 0x7fa28012b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa280133ea0 0x7fa28012af00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 --2- 172.21.15.28:0/1579470842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa2800a3400 0x7fa28012a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 >> 172.21.15.28:0/1579470842 conn(0x7fa2800a98f0 msgr2=0x7fa28012dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:23.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 shutdown_connections 2024-03-27T21:32:23.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 -- 172.21.15.28:0/1579470842 wait complete. 2024-03-27T21:32:23.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.126+0000 7fa2850ca640 1 librados: shutdown 2024-03-27T21:32:23.125 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-03-27T21:32:23.125 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-27T21:32:23.134 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-27T21:32:23.134 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:32:23.234 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.246+0000 7f2f6b367640 10 monclient: get_monmap_and_config 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.246+0000 7f2f6b367640 10 monclient: build_initial_monmap 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.246+0000 7f2f6b367640 10 monclient: monmap: 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:23.246921+0000 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:23.246921+0000 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.235 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:23.236 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:23.237 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:23.237 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:23.237 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.246+0000 7f2f6b367640 1 Processor -- start 2024-03-27T21:32:23.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.246+0000 7f2f6b367640 1 -- start start 2024-03-27T21:32:23.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.246+0000 7f2f6b367640 10 monclient: init 2024-03-27T21:32:23.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient: _add_conns ranks=[5,4,8,6,1,0,2,9,3,7,10] 2024-03-27T21:32:23.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f64070df0 0x7f2f64137040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): picked mon.noname-h con 0x7f2f64070df0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2f640711d0 0x7f2f640a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): picked mon.noname-c con 0x7f2f640711d0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 0x7f2f640a33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): picked mon.noname-e con 0x7f2f640a2f70 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6406b9a0 con 0x7f2f640711d0 2024-03-27T21:32:23.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6406d140 con 0x7f2f64070df0 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6406d420 con 0x7f2f640a2f70 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f6b367640 10 monclient(hunting): authenticate will time out at 965.554092s 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 0x7f2f640a33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2f640711d0 0x7f2f640a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 0x7f2f640a33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44238/0 (socket says 172.21.15.28:44238) 2024-03-27T21:32:23.248 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 -- 172.21.15.28:0/426041337 learned_addr learned my addr 172.21.15.28:0/426041337 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): get_auth_request con 0x7f2f640a2f70 auth_method 0 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): get_auth_request con 0x7f2f640711d0 auth_method 0 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.249 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69103640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f64070df0 0x7f2f64137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69103640 10 monclient(hunting): get_auth_request con 0x7f2f64070df0 auth_method 0 2024-03-27T21:32:23.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69103640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69103640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69103640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient(hunting): handle_auth_done global_id 4580 payload 274 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 -- 172.21.15.28:0/426041337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f64070df0 msgr2=0x7f2f64137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f64070df0 0x7f2f64137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 -- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2f640711d0 msgr2=0x7f2f640a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2f640711d0 0x7f2f640a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 monclient: found mon.noname-e 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f69904640 1 -- 172.21.15.28:0/426041337 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640618f0 con 0x7f2f640a2f70 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.247+0000 7f2f68902640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2f640711d0 0x7f2f640a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f69904640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 0x7f2f640a33f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009e80 tx=0x7f2f5c02bd70 comp rx=0 tx=0).ready entity=mon.8 client_cookie=441e2b39a0d83797 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.252 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 1 -- 172.21.15.28:0/426041337 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2f5c02cb80 con 0x7f2f640a2f70 2024-03-27T21:32:23.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:23.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: dump: 2024-03-27T21:32:23.253 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.253 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.253 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.254 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 1 -- 172.21.15.28:0/426041337 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c02cd00 con 0x7f2f640a2f70 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f6b367640 5 monclient: authenticate success, global_id 4580 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f6b367640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f6b367640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 1 -- 172.21.15.28:0/426041337 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2f5c034860 con 0x7f2f640a2f70 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f6b367640 4 set_mon_vals no callback set 2024-03-27T21:32:23.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.248+0000 7f2f5bfff640 10 monclient: dump: 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.257 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.258 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 10 monclient: shutdown 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 -- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 msgr2=0x7f2f640a33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 0x7f2f640a33f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c009e80 tx=0x7f2f5c02bd70 comp rx=0 tx=0).stop 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 -- 172.21.15.28:0/426041337 shutdown_connections 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f2f640a2f70 0x7f2f640a33f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f2f640711d0 0x7f2f640a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.259 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 --2- 172.21.15.28:0/426041337 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f64070df0 0x7f2f64137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 -- 172.21.15.28:0/426041337 >> 172.21.15.28:0/426041337 conn(0x7f2f640a7810 msgr2=0x7f2f640a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 -- 172.21.15.28:0/426041337 shutdown_connections 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 1 -- 172.21.15.28:0/426041337 wait complete. 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 10 monclient: build_initial_monmap 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.249+0000 7f2f6b367640 10 monclient: monmap: 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:23.260 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:23.261 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 librados: starting msgr at 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 librados: starting objecter 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 Processor -- start 2024-03-27T21:32:23.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 -- start start 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 librados: setting wanted keys 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 librados: calling monclient init 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient: init 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient: _add_conns ranks=[7,2,5,4,3,1,8,0,6] 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f2f64070df0 0x7f2f641cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): picked mon.noname-i con 0x7f2f64070df0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 0x7f2f64135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): picked mon.noname-b con 0x7f2f640711d0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f640a2f70 0x7f2f64135950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): picked mon.noname-h con 0x7f2f640a2f70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64122810 con 0x7f2f640711d0 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f64121400 con 0x7f2f640a2f70 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f2f641cb980 con 0x7f2f64070df0 2024-03-27T21:32:23.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f6b367640 10 monclient(hunting): authenticate will time out at 965.557378s 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 0x7f2f64135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 0x7f2f64135410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38492/0 (socket says 172.21.15.28:38492) 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 1 -- 172.21.15.28:0/2881862623 learned_addr learned my addr 172.21.15.28:0/2881862623 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): get_auth_request con 0x7f2f640711d0 auth_method 0 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.250+0000 7f2f68902640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f69103640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f2f64070df0 0x7f2f641cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 10 monclient(hunting): handle_auth_done global_id 4628 payload 824 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f69904640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f640a2f70 0x7f2f64135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 -- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f2f64070df0 msgr2=0x7f2f641cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.266 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f2f64070df0 0x7f2f641cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 -- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f640a2f70 msgr2=0x7f2f64135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f640a2f70 0x7f2f64135950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 monclient: found mon.noname-b 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 -- 172.21.15.28:0/2881862623 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009400 con 0x7f2f640711d0 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f69904640 10 monclient: get_auth_request con 0x7f2f640a2f70 auth_method 0 2024-03-27T21:32:23.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f69904640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f640a2f70 0x7f2f64135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f68902640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 0x7f2f64135410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400ebb0 tx=0x7f2f5400c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 client.?.objecter ms_handle_connect 0x7f2f640711d0 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2f5400eeb0 con 0x7f2f640711d0 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: dump: 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.268 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.269 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 5 monclient: authenticate success, global_id 4628 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5400cc30 con 0x7f2f640711d0 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2f5400cda0 con 0x7f2f640711d0 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f5affd640 4 set_mon_vals no callback set 2024-03-27T21:32:23.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f59ffb640 10 monclient: dump: 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.272 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 10 monclient: _renew_subs 2024-03-27T21:32:23.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5c009b30 con 0x7f2f640711d0 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 10 client.4628.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 10 monclient: _renew_subs 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6406c350 con 0x7f2f640711d0 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.251+0000 7f2f6b367640 1 librados: init done 2024-03-27T21:32:23.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f2f54013470 con 0x7f2f640711d0 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2f4803a250 0x7f2f4803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f6b367640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f6b367640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f6b367640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f2f5404a370 con 0x7f2f640711d0 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 10 client.4628.objecter ms_dispatch 0x7f2f64000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 3 client.4628.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:23.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 3 client.4628.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f64074b30 con 0x7f2f640711d0 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f59ffb640 20 client.4628.objecter dump_active .. 0 homeless 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f69103640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2f4803a250 0x7f2f4803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.252+0000 7f2f69103640 10 monclient: get_auth_request con 0x7f2f4803a250 auth_method 0 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.253+0000 7f2f59ffb640 10 client.4628.objecter ms_handle_connect 0x7f2f4803a250 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.253+0000 7f2f69103640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2f4803a250 0x7f2f4803c710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f60006fd0 tx=0x7f2f60008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.257+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f2f54017020 con 0x7f2f640711d0 2024-03-27T21:32:23.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.257+0000 7f2f59ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.257+0000 7f2f59ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:23.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.435+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f640a46a0 con 0x7f2f4803a250 2024-03-27T21:32:23.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.438+0000 7f2f59ffb640 1 -- 172.21.15.28:0/2881862623 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+53838 (secure 0 0 0) 0x7f2f60009d60 con 0x7f2f4803a250 2024-03-27T21:32:23.426 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:32:23.427 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:32:23.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 10 librados: watch_flush enter 2024-03-27T21:32:23.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 10 librados: watch_flush exit 2024-03-27T21:32:23.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 20 client.4628.objecter shutdown clearing up homeless session... 2024-03-27T21:32:23.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 10 client.4628.objecter successfully canceled tick 2024-03-27T21:32:23.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2f4803a250 msgr2=0x7f2f4803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2f4803a250 0x7f2f4803c710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2f60006fd0 tx=0x7f2f60008040 comp rx=0 tx=0).stop 2024-03-27T21:32:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 10 monclient: shutdown 2024-03-27T21:32:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 msgr2=0x7f2f64135410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 0x7f2f64135410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400ebb0 tx=0x7f2f5400c520 comp rx=0 tx=0).stop 2024-03-27T21:32:23.431 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 shutdown_connections 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f2f4803a250 0x7f2f4803c710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f2f640a2f70 0x7f2f64135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f2f640711d0 0x7f2f64135410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 --2- 172.21.15.28:0/2881862623 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f2f64070df0 0x7f2f641cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 >> 172.21.15.28:0/2881862623 conn(0x7f2f640a7810 msgr2=0x7f2f640a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 shutdown_connections 2024-03-27T21:32:23.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 -- 172.21.15.28:0/2881862623 wait complete. 2024-03-27T21:32:23.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.440+0000 7f2f6b367640 1 librados: shutdown 2024-03-27T21:32:23.438 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-03-27T21:32:22.656255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168548,"kb_used_data":1876,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062492,"statfs":{"total":579820584960,"available":579647991808,"internally_reserved":0,"allocated":1921024,"data_stored":1313826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942270+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.942270+0000","last_peered":"2024-03-27T21:30:21.942270+0000","last_clean":"2024-03-27T21:30:21.942270+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.942270+0000","last_undegraded":"2024-03-27T21:30:21.942270+0000","last_fullsized":"2024-03-27T21:30:21.942270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.504},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.39100000000000001}]},{"osd":5,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.44800000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607579,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":675840,"data_stored":571767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28100000000000003}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36199999999999999}]}]},{"osd":5,"up_from":11,"seq":47244640283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.29699999999999999}]},{"osd":4,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.36499999999999999}]}]},{"osd":2,"up_from":11,"seq":47244640282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.316}]},{"osd":1,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.443},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.622},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.72599999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23499999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.313},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.44},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:32:23.440 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:32:23.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.551+0000 7f276c05c640 10 monclient: get_monmap_and_config 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.551+0000 7f276c05c640 10 monclient: build_initial_monmap 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.551+0000 7f276c05c640 10 monclient: monmap: 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:23.552716+0000 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:23.552716+0000 2024-03-27T21:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:23.550 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.552+0000 7f276c05c640 1 Processor -- start 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.552+0000 7f276c05c640 1 -- start start 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.552+0000 7f276c05c640 10 monclient: init 2024-03-27T21:32:23.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient: _add_conns ranks=[2,6,9,1,4,10,0,5,3,7,8] 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 0x7f276406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): picked mon.noname-b con 0x7f27640a0750 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f27640a0b30 0x7f27640a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): picked mon.noname-d con 0x7f27640a0b30 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f276413b1e0 0x7f276413b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): picked mon.noname-a con 0x7f276413b1e0 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27640a3140 con 0x7f276413b1e0 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640a1a30 con 0x7f27640a0750 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f27640a0230 con 0x7f27640a0b30 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276c05c640 10 monclient(hunting): authenticate will time out at 965.859861s 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 0x7f276406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f276413b1e0 0x7f276413b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f27640a0b30 0x7f27640a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 0x7f276406d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38498/0 (socket says 172.21.15.28:38498) 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 1 -- 172.21.15.28:0/647192502 learned_addr learned my addr 172.21.15.28:0/647192502 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): get_auth_request con 0x7f27640a0750 auth_method 0 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): get_auth_request con 0x7f276413b1e0 auth_method 0 2024-03-27T21:32:23.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): get_auth_request con 0x7f27640a0b30 auth_method 0 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient(hunting): handle_auth_done global_id 34191 payload 274 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 -- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f27640a0b30 msgr2=0x7f27640a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f27640a0b30 0x7f27640a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 -- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 msgr2=0x7f276406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 0x7f276406d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 monclient: found mon.noname-a 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f276a5f9640 1 -- 172.21.15.28:0/647192502 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27640618f0 con 0x7f276413b1e0 2024-03-27T21:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f2769df8640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 0x7f276406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.553+0000 7f27695f7640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f27640a0b30 0x7f27640a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f276a5f9640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f276413b1e0 0x7f276413b620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27540097a0 tx=0x7f275402b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f7f5845e532eb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 1 -- 172.21.15.28:0/647192502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2754030980 con 0x7f276413b1e0 2024-03-27T21:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: dump: 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.559 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.560 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 1 -- 172.21.15.28:0/647192502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275402e050 con 0x7f276413b1e0 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f276c05c640 5 monclient: authenticate success, global_id 34191 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f276c05c640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 1 -- 172.21.15.28:0/647192502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f27540313a0 con 0x7f276413b1e0 2024-03-27T21:32:23.561 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f276c05c640 4 set_mon_vals no callback set 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.554+0000 7f2768df6640 10 monclient: dump: 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.562 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.563 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 10 monclient: shutdown 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 -- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f276413b1e0 msgr2=0x7f276413b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f276413b1e0 0x7f276413b620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27540097a0 tx=0x7f275402b6f0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 -- 172.21.15.28:0/647192502 shutdown_connections 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f276413b1e0 0x7f276413b620 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f27640a0b30 0x7f27640a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 --2- 172.21.15.28:0/647192502 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f27640a0750 0x7f276406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 -- 172.21.15.28:0/647192502 >> 172.21.15.28:0/647192502 conn(0x7f27640a6170 msgr2=0x7f27640a6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 -- 172.21.15.28:0/647192502 shutdown_connections 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 -- 172.21.15.28:0/647192502 wait complete. 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 10 monclient: build_initial_monmap 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 10 monclient: monmap: 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:23.565 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:23.566 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 librados: starting msgr at 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.555+0000 7f276c05c640 1 librados: starting objecter 2024-03-27T21:32:23.567 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 Processor -- start 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 -- start start 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 librados: setting wanted keys 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 librados: calling monclient init 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient: init 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient: _add_conns ranks=[4,7,1,8,5,2,6,3,0] 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 0x7f2764139f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): picked mon.noname-c con 0x7f27640a0750 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:23.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f27640a0b30 0x7f276413a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): picked mon.noname-i con 0x7f27640a0b30 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f276413b1e0 0x7f276409d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): picked mon.noname-f con 0x7f276413b1e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276409ff30 con 0x7f276413b1e0 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2764129360 con 0x7f27640a0750 2024-03-27T21:32:23.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f27641c2c70 con 0x7f27640a0b30 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276c05c640 10 monclient(hunting): authenticate will time out at 965.863208s 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 0x7f2764139f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 0x7f2764139f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37430/0 (socket says 172.21.15.28:37430) 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 -- 172.21.15.28:0/467921821 learned_addr learned my addr 172.21.15.28:0/467921821 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): get_auth_request con 0x7f27640a0750 auth_method 0 2024-03-27T21:32:23.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276a5f9640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f276413b1e0 0x7f276409d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient(hunting): handle_auth_done global_id 34195 payload 824 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f27695f7640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f27640a0b30 0x7f276413a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 -- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f27640a0b30 msgr2=0x7f276413a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f27640a0b30 0x7f276413a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 -- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f276413b1e0 msgr2=0x7f276409d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f276413b1e0 0x7f276409d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 monclient: found mon.noname-c 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f2769df8640 1 -- 172.21.15.28:0/467921821 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009b30 con 0x7f27640a0750 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276a5f9640 10 monclient: get_auth_request con 0x7f276413b1e0 auth_method 0 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.556+0000 7f276a5f9640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f276413b1e0 0x7f276409d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f2769df8640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 0x7f2764139f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f275c00efc0 tx=0x7f275c00c490 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 client.?.objecter ms_handle_connect 0x7f27640a0750 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f275c0090d0 con 0x7f27640a0750 2024-03-27T21:32:23.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: dump: 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.574 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.575 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00f040 con 0x7f27640a0750 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 5 monclient: authenticate success, global_id 34195 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 10 monclient: _renew_subs 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:23.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2758009400 con 0x7f27640a0750 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f275c009250 con 0x7f27640a0750 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f27627fc640 10 monclient: dump: 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.577 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.578 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.578 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.578 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.578 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.578 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.578 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.579 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.579 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.579 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.579 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f2763fff640 4 set_mon_vals no callback set 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 10 client.34195.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 10 monclient: _renew_subs 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:23.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2754009400 con 0x7f27640a0750 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.557+0000 7f276c05c640 1 librados: init done 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f275c014480 con 0x7f27640a0750 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f276c05c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f276c05c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f276c05c640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2764074b30 con 0x7f27640a0750 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f275003a250 0x7f275003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f275c04a5c0 con 0x7f27640a0750 2024-03-27T21:32:23.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 10 client.34195.objecter ms_dispatch 0x7f2764000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 3 client.34195.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 3 client.34195.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 20 client.34195.objecter dump_active .. 0 homeless 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27695f7640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f275003a250 0x7f275003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27695f7640 10 monclient: get_auth_request con 0x7f275003a250 auth_method 0 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27627fc640 10 client.34195.objecter ms_handle_connect 0x7f275003a250 2024-03-27T21:32:23.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.558+0000 7f27695f7640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f275003a250 0x7f275003c710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2758009b00 tx=0x7f2758008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.563+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f275c012700 con 0x7f27640a0750 2024-03-27T21:32:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.563+0000 7f27627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.563+0000 7f27627fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:23.731 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.742+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27640a5570 con 0x7f275003a250 2024-03-27T21:32:23.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.745+0000 7f27627fc640 1 -- 172.21.15.28:0/467921821 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+53838 (secure 0 0 0) 0x7f2758010990 con 0x7f275003a250 2024-03-27T21:32:23.734 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:32:23.734 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:32:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 10 librados: watch_flush enter 2024-03-27T21:32:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 10 librados: watch_flush exit 2024-03-27T21:32:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 20 client.34195.objecter shutdown clearing up homeless session... 2024-03-27T21:32:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 10 client.34195.objecter successfully canceled tick 2024-03-27T21:32:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f275003a250 msgr2=0x7f275003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f275003a250 0x7f275003c710 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2758009b00 tx=0x7f2758008040 comp rx=0 tx=0).stop 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 10 monclient: shutdown 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 msgr2=0x7f2764139f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 0x7f2764139f10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f275c00efc0 tx=0x7f275c00c490 comp rx=0 tx=0).stop 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 shutdown_connections 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f275003a250 0x7f275003c710 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f276413b1e0 0x7f276409d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f27640a0b30 0x7f276413a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 --2- 172.21.15.28:0/467921821 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f27640a0750 0x7f2764139f10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 >> 172.21.15.28:0/467921821 conn(0x7f27640a6170 msgr2=0x7f27640a7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:23.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 shutdown_connections 2024-03-27T21:32:23.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 -- 172.21.15.28:0/467921821 wait complete. 2024-03-27T21:32:23.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.747+0000 7f276c05c640 1 librados: shutdown 2024-03-27T21:32:23.745 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-03-27T21:32:22.656255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168548,"kb_used_data":1876,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062492,"statfs":{"total":579820584960,"available":579647991808,"internally_reserved":0,"allocated":1921024,"data_stored":1313826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942270+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.942270+0000","last_peered":"2024-03-27T21:30:21.942270+0000","last_clean":"2024-03-27T21:30:21.942270+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.942270+0000","last_undegraded":"2024-03-27T21:30:21.942270+0000","last_fullsized":"2024-03-27T21:30:21.942270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.504},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.39100000000000001}]},{"osd":5,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.44800000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607579,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":675840,"data_stored":571767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28100000000000003}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36199999999999999}]}]},{"osd":5,"up_from":11,"seq":47244640283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.29699999999999999}]},{"osd":4,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.36499999999999999}]}]},{"osd":2,"up_from":11,"seq":47244640282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.316}]},{"osd":1,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.443},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.622},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.72599999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23499999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.313},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.44},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:32:23.747 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-27T21:32:23.747 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:32:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.859+0000 7fa6533ab640 10 monclient: get_monmap_and_config 2024-03-27T21:32:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.859+0000 7fa6533ab640 10 monclient: build_initial_monmap 2024-03-27T21:32:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.859+0000 7fa6533ab640 10 monclient: monmap: 2024-03-27T21:32:23.848 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:23.860310+0000 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:23.860310+0000 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:23.849 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:23.850 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 Processor -- start 2024-03-27T21:32:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 -- start start 2024-03-27T21:32:23.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient: init 2024-03-27T21:32:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient: _add_conns ranks=[0,5,3,6,7,10,8,9,1,4,2] 2024-03-27T21:32:23.862 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa64c0a0920 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c06ff10 0x7fa64c0a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): picked mon.noname-h con 0x7fa64c06ff10 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa64c0a1240 0x7fa64c13bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): picked mon.noname-g con 0x7fa64c0a1240 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64c0618f0 con 0x7fa64c0a0920 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0716a0 con 0x7fa64c0a1240 2024-03-27T21:32:23.863 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c135630 con 0x7fa64c06ff10 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa6533ab640 10 monclient(hunting): authenticate will time out at 966.167522s 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa651147640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa64c0a0920 0x7fa64c134f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54376/0 (socket says 172.21.15.28:54376) 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.860+0000 7fa651147640 1 -- 172.21.15.28:0/1805202491 learned_addr learned my addr 172.21.15.28:0/1805202491 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa64c0a1240 0x7fa64c13bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c06ff10 0x7fa64c0a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.864 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233971784 0 0) 0x7fa64c0618f0 con 0x7fa64c0a0920 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): _negotiate 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): my global_id is 34200 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa638003520 con 0x7fa64c0a0920 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): get_auth_request con 0x7fa64c06ff10 auth_method 0 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.865 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): get_auth_request con 0x7fa64c0a1240 auth_method 0 2024-03-27T21:32:23.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.866 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252193251 0 0) 0x7fa638003520 con 0x7fa64c0a0920 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c06ff10 msgr2=0x7fa64c0a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.867 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c06ff10 0x7fa64c0a0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa64c0a1240 msgr2=0x7fa64c13bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa64c0a1240 0x7fa64c13bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 monclient: found mon.noname-a-legacy 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.28:6789/0 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c0713c0 con 0x7fa64c0a0920 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.868 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (unknown 3833802671 0 0) 0x7fa6480018e0 con 0x7fa64c0a0920 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa6533ab640 5 monclient: authenticate success, global_id 34200 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa6533ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: dump: 2024-03-27T21:32:23.869 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.870 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] but i'm connected to v1:172.21.15.28:6789/0, reconnecting 2024-03-27T21:32:23.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 >> v1:172.21.15.28:6789/0 conn(0x7fa64c0a0920 legacy=0x7fa64c134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient: _add_conns ranks=[0,7,4,6,1,2,8,5,3] 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6380041c0 0x7fa6380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): picked mon.a con 0x7fa6380041c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa638004d50 0x7fa6380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): picked mon.i con 0x7fa638004d50 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa638009a60 0x7fa63800bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): picked mon.c con 0x7fa638009a60 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c0716a0 con 0x7fa6380041c0 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c135630 con 0x7fa638009a60 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800c800 con 0x7fa638004d50 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa643fff640 10 monclient(hunting): _finish_auth 0 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa6533ab640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6380041c0 0x7fa6380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa638009a60 0x7fa63800bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): get_auth_request con 0x7fa6380041c0 auth_method 0 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:23.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): get_auth_request con 0x7fa638009a60 auth_method 0 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa638004d50 0x7fa6380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): get_auth_request con 0x7fa638004d50 auth_method 0 2024-03-27T21:32:23.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa650946640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient(hunting): handle_auth_done global_id 34200 payload 293 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 -- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa638004d50 msgr2=0x7fa6380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa638004d50 0x7fa6380051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 -- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa638009a60 msgr2=0x7fa63800bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:23.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa638009a60 0x7fa63800bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 monclient: found mon.a 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 1 -- 172.21.15.28:0/1805202491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638003520 con 0x7fa6380041c0 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651147640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa638009a60 0x7fa63800bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.861+0000 7fa651948640 1 -- 172.21.15.28:0/1805202491 reap_dead start 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa651147640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6380041c0 0x7fa6380047c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa648007ec0 tx=0x7fa6380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69ccaaa850a9d4a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa648005d40 con 0x7fa6380041c0 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: dump: 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.879 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.880 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa6533ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa648007070 con 0x7fa6380041c0 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa6533ab640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 1 -- 172.21.15.28:0/1805202491 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa648007650 con 0x7fa6380041c0 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa6533ab640 4 set_mon_vals no callback set 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.862+0000 7fa643fff640 10 monclient: dump: 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.883 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 10 monclient: shutdown 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:23.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 -- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6380041c0 msgr2=0x7fa6380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6380041c0 0x7fa6380047c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa648007ec0 tx=0x7fa6380057f0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 -- 172.21.15.28:0/1805202491 shutdown_connections 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 --2- 172.21.15.28:0/1805202491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6380041c0 0x7fa6380047c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 -- 172.21.15.28:0/1805202491 >> 172.21.15.28:0/1805202491 conn(0x7fa64c0a7810 msgr2=0x7fa64c0a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 -- 172.21.15.28:0/1805202491 shutdown_connections 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.863+0000 7fa6533ab640 1 -- 172.21.15.28:0/1805202491 wait complete. 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient: build_initial_monmap 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient: monmap: 2024-03-27T21:32:23.885 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:23.886 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:23.887 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 librados: starting msgr at 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 librados: starting objecter 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 Processor -- start 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 -- start start 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 librados: setting wanted keys 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 librados: calling monclient init 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient: init 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:23.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient: _add_conns ranks=[1,5,0,8,4,3,7,2,6] 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6380041c0 0x7fa64c132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): picked mon.noname-f con 0x7fa6380041c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c1c92a0 0x7fa64c1333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): picked mon.noname-h con 0x7fa64c1c92a0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 0x7fa64c11daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): picked mon.noname-a con 0x7fa64c11d670 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c11ec40 con 0x7fa64c11d670 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c070a00 con 0x7fa6380041c0 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c1205f0 con 0x7fa64c1c92a0 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa6533ab640 10 monclient(hunting): authenticate will time out at 966.171573s 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 0x7fa64c11daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 0x7fa64c11daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58438/0 (socket says 172.21.15.28:58438) 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 1 -- 172.21.15.28:0/2707669927 learned_addr learned my addr 172.21.15.28:0/2707669927 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 10 monclient(hunting): get_auth_request con 0x7fa64c11d670 auth_method 0 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.864+0000 7fa651948640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:23.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa650946640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c1c92a0 0x7fa64c1333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651147640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6380041c0 0x7fa64c132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa650946640 10 monclient(hunting): get_auth_request con 0x7fa64c1c92a0 auth_method 0 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa650946640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa650946640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa650946640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 10 monclient(hunting): handle_auth_done global_id 34209 payload 824 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 -- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c1c92a0 msgr2=0x7fa64c1333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c1c92a0 0x7fa64c1333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 -- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6380041c0 msgr2=0x7fa64c132e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6380041c0 0x7fa64c132e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 10 monclient: _finish_hunting 0 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 monclient: found mon.noname-a 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 -- 172.21.15.28:0/2707669927 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64c070640 con 0x7fa64c11d670 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651147640 10 monclient: get_auth_request con 0x7fa6380041c0 auth_method 0 2024-03-27T21:32:23.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651147640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6380041c0 0x7fa64c132e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa651948640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 0x7fa64c11daf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0717e0 tx=0x7fa64400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 client.?.objecter ms_handle_connect 0x7fa64c11d670 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa64400e040 con 0x7fa64c11d670 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: dump: 2024-03-27T21:32:23.894 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.895 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:23.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64400f040 con 0x7fa64c11d670 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 5 monclient: authenticate success, global_id 34209 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 10 monclient: _renew_subs 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c11fd50 con 0x7fa64c11d670 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:23.897 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa64400fdf0 con 0x7fa64c11d670 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa641ffb640 10 monclient: dump: 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:23.898 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:23.899 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6437fe640 4 set_mon_vals no callback set 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 10 client.34209.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 10 monclient: _renew_subs 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c09d690 con 0x7fa64c11d670 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.865+0000 7fa6533ab640 1 librados: init done 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa644015430 con 0x7fa64c11d670 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa6533ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa6533ab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa6533ab640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63003a250 0x7fa63003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c074b10 con 0x7fa64c11d670 2024-03-27T21:32:23.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa64404a390 con 0x7fa64c11d670 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 10 client.34209.objecter ms_dispatch 0x7fa64c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 3 client.34209.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 3 client.34209.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa641ffb640 20 client.34209.objecter dump_active .. 0 homeless 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa651147640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63003a250 0x7fa63003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.866+0000 7fa651147640 10 monclient: get_auth_request con 0x7fa63003a250 auth_method 0 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.867+0000 7fa641ffb640 10 client.34209.objecter ms_handle_connect 0x7fa63003a250 2024-03-27T21:32:23.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.867+0000 7fa651147640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63003a250 0x7fa63003c710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa648034000 tx=0x7fa648007000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.871+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa6440232a0 con 0x7fa64c11d670 2024-03-27T21:32:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.871+0000 7fa641ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:23.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:23.871+0000 7fa641ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:24.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.045+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa64c120270 con 0x7fa63003a250 2024-03-27T21:32:24.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.048+0000 7fa641ffb640 1 -- 172.21.15.28:0/2707669927 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+53838 (secure 0 0 0) 0x7fa64c120270 con 0x7fa63003a250 2024-03-27T21:32:24.036 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:32:24.037 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:32:24.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 10 librados: watch_flush enter 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 10 librados: watch_flush exit 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 20 client.34209.objecter shutdown clearing up homeless session... 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 10 client.34209.objecter successfully canceled tick 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63003a250 msgr2=0x7fa63003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63003a250 0x7fa63003c710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa648034000 tx=0x7fa648007000 comp rx=0 tx=0).stop 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 10 monclient: shutdown 2024-03-27T21:32:24.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 msgr2=0x7fa64c11daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 0x7fa64c11daf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa64c0717e0 tx=0x7fa64400f580 comp rx=0 tx=0).stop 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 shutdown_connections 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa63003a250 0x7fa63003c710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fa64c1c92a0 0x7fa64c1333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa64c11d670 0x7fa64c11daf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 --2- 172.21.15.28:0/2707669927 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa6380041c0 0x7fa64c132e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 >> 172.21.15.28:0/2707669927 conn(0x7fa64c0a7810 msgr2=0x7fa64c0a3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:24.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 shutdown_connections 2024-03-27T21:32:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 -- 172.21.15.28:0/2707669927 wait complete. 2024-03-27T21:32:24.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.050+0000 7fa6533ab640 1 librados: shutdown 2024-03-27T21:32:24.049 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-03-27T21:32:22.656255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168548,"kb_used_data":1876,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062492,"statfs":{"total":579820584960,"available":579647991808,"internally_reserved":0,"allocated":1921024,"data_stored":1313826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002353"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.936928+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:21.936928+0000","last_peered":"2024-03-27T21:30:21.936928+0000","last_clean":"2024-03-27T21:30:21.936928+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:21.936928+0000","last_undegraded":"2024-03-27T21:30:21.936928+0000","last_fullsized":"2024-03-27T21:30:21.936928+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942284+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:21.942284+0000","last_peered":"2024-03-27T21:30:21.942284+0000","last_clean":"2024-03-27T21:30:21.942284+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:21.942284+0000","last_undegraded":"2024-03-27T21:30:21.942284+0000","last_fullsized":"2024-03-27T21:30:21.942284+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942270+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.942270+0000","last_peered":"2024-03-27T21:30:21.942270+0000","last_clean":"2024-03-27T21:30:21.942270+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.942270+0000","last_undegraded":"2024-03-27T21:30:21.942270+0000","last_fullsized":"2024-03-27T21:30:21.942270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607580,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.504},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.48699999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47299999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.39100000000000001}]},{"osd":5,"last update":"Wed Mar 27 21:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.44800000000000001}]}]},{"osd":3,"up_from":12,"seq":51539607579,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":675840,"data_stored":571767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.42999999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.317},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.28100000000000003}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36199999999999999}]}]},{"osd":5,"up_from":11,"seq":47244640283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.51100000000000001}]},{"osd":1,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.29699999999999999}]},{"osd":4,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.36499999999999999}]}]},{"osd":2,"up_from":11,"seq":47244640282,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.316}]},{"osd":1,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.34000000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.46899999999999997}]},{"osd":4,"last update":"Wed Mar 27 21:31:18 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Mar 27 21:31:17 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.51400000000000001}]}]},{"osd":1,"up_from":11,"seq":47244640283,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.443},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Mar 27 21:31:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.622},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.72599999999999998}]}]},{"osd":0,"up_from":11,"seq":47244640282,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.23499999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.313},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.30199999999999999}]},{"osd":3,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.44},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45800000000000002}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.40600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:32:24.050 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T21:32:24.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.161+0000 7f96e81ec640 10 monclient: get_monmap_and_config 2024-03-27T21:32:24.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.161+0000 7f96e81ec640 10 monclient: build_initial_monmap 2024-03-27T21:32:24.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.161+0000 7f96e81ec640 10 monclient: monmap: 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:24.162658+0000 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:24.162658+0000 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:24.151 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:24.152 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:24.153 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.162+0000 7f96e81ec640 1 Processor -- start 2024-03-27T21:32:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.162+0000 7f96e81ec640 1 -- start start 2024-03-27T21:32:24.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.162+0000 7f96e81ec640 10 monclient: init 2024-03-27T21:32:24.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient: _add_conns ranks=[2,4,0,5,6,9,1,8,3,7,10] 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e01370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): picked mon.noname-b con 0x7f96e0136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f96e00a3d70 0x7f96e0137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): picked mon.noname-c con 0x7f96e00a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f96e01339e0 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:24.162 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00618f0 con 0x7f96e01339e0 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00a25b0 con 0x7f96e0136d00 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0137b60 con 0x7f96e00a3d70 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e81ec640 10 monclient(hunting): authenticate will time out at 966.469832s 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e01370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f96e00a3d70 0x7f96e0137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:24.163 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e6789640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f96e01339e0 0x7f96e0133e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54390/0 (socket says 172.21.15.28:54390) 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e6789640 1 -- 172.21.15.28:0/2527300160 learned_addr learned my addr 172.21.15.28:0/2527300160 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): get_auth_request con 0x7f96e00a3d70 auth_method 0 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): get_auth_request con 0x7f96e0136d00 auth_method 0 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:24.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient(hunting): handle_auth_done global_id 34204 payload 274 2024-03-27T21:32:24.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e4f86640 1 -- 172.21.15.28:0/2527300160 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400163396 0 0) 0x7f96e00618f0 con 0x7f96e01339e0 2024-03-27T21:32:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 1 -- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 msgr2=0x7f96e01370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 1 --2- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e01370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 1 -- 172.21.15.28:0/2527300160 >> v1:172.21.15.28:6789/0 conn(0x7f96e01339e0 legacy=0x7f96e0133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient: _finish_hunting 0 2024-03-27T21:32:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 1 monclient: found mon.noname-c 2024-03-27T21:32:24.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5787640 1 -- 172.21.15.28:0/2527300160 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00a13f0 con 0x7f96e00a3d70 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e5f88640 1 --2- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e01370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.163+0000 7f96e4f86640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e5787640 1 --2- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f96e00a3d70 0x7f96e0137620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097d0 tx=0x7f96d402b790 comp rx=0 tx=0).ready entity=mon.4 client_cookie=dcf43c1a595e624b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 1 -- 172.21.15.28:0/2527300160 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f96d4031960 con 0x7f96e00a3d70 2024-03-27T21:32:24.167 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: dump: 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:24.168 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:24.169 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: _finish_auth 0 2024-03-27T21:32:24.170 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: _check_auth_tickets 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 1 -- 172.21.15.28:0/2527300160 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d4031ae0 con 0x7f96e00a3d70 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 5 monclient: authenticate success, global_id 34204 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 1 -- 172.21.15.28:0/2527300160 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f96d4031c50 con 0x7f96e00a3d70 2024-03-27T21:32:24.171 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 4 set_mon_vals no callback set 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e4f86640 10 monclient: dump: 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:24.172 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:24.173 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 10 monclient: shutdown 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 1 -- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f96e00a3d70 msgr2=0x7f96e0137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.164+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f96e00a3d70 0x7f96e0137620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097d0 tx=0x7f96d402b790 comp rx=0 tx=0).stop 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 -- 172.21.15.28:0/2527300160 shutdown_connections 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f96e00a3d70 0x7f96e0137620 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.174 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2527300160 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e01370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 -- 172.21.15.28:0/2527300160 >> 172.21.15.28:0/2527300160 conn(0x7f96e00a9430 msgr2=0x7f96e00a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 -- 172.21.15.28:0/2527300160 shutdown_connections 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 -- 172.21.15.28:0/2527300160 wait complete. 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 10 monclient: build_initial_monmap 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 10 monclient: monmap: 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:24.175 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:24.176 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 librados: starting msgr at 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.165+0000 7f96e81ec640 1 librados: starting objecter 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 Processor -- start 2024-03-27T21:32:24.177 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 -- start start 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 librados: setting wanted keys 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 librados: calling monclient init 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient: init 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient: _add_conns ranks=[3,1,2,4,8,6,7,5,0] 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f96e00a3d70 0x7f96e01cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): picked mon.noname-g con 0x7f96e00a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:24.178 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96e01339e0 0x7f96e0132c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): picked mon.noname-f con 0x7f96e01339e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e009c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): picked mon.noname-b con 0x7f96e0136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00a11e0 con 0x7f96e01339e0 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:24.179 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e009f290 con 0x7f96e0136d00 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e009e410 con 0x7f96e00a3d70 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e81ec640 10 monclient(hunting): authenticate will time out at 966.473270s 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e009c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e009c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38512/0 (socket says 172.21.15.28:38512) 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 -- 172.21.15.28:0/2891112554 learned_addr learned my addr 172.21.15.28:0/2891112554 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:24.180 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): get_auth_request con 0x7f96e0136d00 auth_method 0 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient(hunting): handle_auth_done global_id 4655 payload 824 2024-03-27T21:32:24.181 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e5f88640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f96e00a3d70 0x7f96e01cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e5787640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96e01339e0 0x7f96e0132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 -- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f96e00a3d70 msgr2=0x7f96e01cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f96e00a3d70 0x7f96e01cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 -- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96e01339e0 msgr2=0x7f96e0132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96e01339e0 0x7f96e0132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient: _finish_hunting 0 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 monclient: found mon.noname-b 2024-03-27T21:32:24.182 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.166+0000 7f96e6789640 1 -- 172.21.15.28:0/2891112554 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8009400 con 0x7f96e0136d00 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e6789640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e009c950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c800 tx=0x7f96d000ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 client.?.objecter ms_handle_connect 0x7f96e0136d00 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f96d000a640 con 0x7f96e0136d00 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:24.183 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: dump: 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:24.184 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:24.185 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 5 monclient: authenticate success, global_id 4655 2024-03-27T21:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000a7e0 con 0x7f96e0136d00 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f96d000ae00 con 0x7f96e0136d00 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 10 monclient: _renew_subs 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d4009400 con 0x7f96e0136d00 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:24.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96dffff640 4 set_mon_vals no callback set 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 10 client.4655.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96de7fc640 10 monclient: dump: 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:24.189 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:24.190 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 10 monclient: _renew_subs 2024-03-27T21:32:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:24.190 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e0120040 con 0x7f96e0136d00 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.167+0000 7f96e81ec640 1 librados: init done 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f96d000a990 con 0x7f96e0136d00 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e81ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e81ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e81ec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f96cc03a250 0x7f96cc03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00a1ad0 con 0x7f96e0136d00 2024-03-27T21:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f96d0049470 con 0x7f96e0136d00 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 10 client.4655.objecter ms_dispatch 0x7f96e0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 3 client.4655.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 3 client.4655.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 20 client.4655.objecter dump_active .. 0 homeless 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e5f88640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f96cc03a250 0x7f96cc03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e5f88640 10 monclient: get_auth_request con 0x7f96cc03a250 auth_method 0 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96de7fc640 10 client.4655.objecter ms_handle_connect 0x7f96cc03a250 2024-03-27T21:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.168+0000 7f96e5f88640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f96cc03a250 0x7f96cc03c710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009ae0 tx=0x7f96d8008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.172+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f96d0010b80 con 0x7f96e0136d00 2024-03-27T21:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.172+0000 7f96de7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.172+0000 7f96de7fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96e81ec640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:32:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96e81ec640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:32:24.340 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96e81ec640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:24.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e00672e0 con 0x7f96e0136d00 2024-03-27T21:32:24.341 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96de7fc640 1 -- 172.21.15.28:0/2891112554 <== mon.2 v2:172.21.15.28:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11794 (secure 0 0 0) 0x7f96d0011c80 con 0x7f96e0136d00 2024-03-27T21:32:24.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96de7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-03-27T21:32:24.342 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.352+0000 7f96de7fc640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:24.343 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:32:24.343 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":15,"fsid":"4104f5c5-b145-4d95-98f1-cb5df7cc2f83","created":"2024-03-27T21:30:09.584796+0000","modified":"2024-03-27T21:30:21.931135+0000","last_up_change":"2024-03-27T21:30:18.879901+0000","last_in_change":"2024-03-27T21:30:11.304411+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T21:30:18.680135+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-27T21:30:19.526407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"37060d25-81fc-4070-99eb-bbe68095b643","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6801","nonce":33278},{"type":"v1","addr":"172.21.15.28:6803","nonce":33278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6805","nonce":33278},{"type":"v1","addr":"172.21.15.28:6807","nonce":33278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":33278},{"type":"v1","addr":"172.21.15.28:6815","nonce":33278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":33278},{"type":"v1","addr":"172.21.15.28:6811","nonce":33278}]},"public_addr":"172.21.15.28:6803/33278","cluster_addr":"172.21.15.28:6807/33278","heartbeat_back_addr":"172.21.15.28:6815/33278","heartbeat_front_addr":"172.21.15.28:6811/33278","state":["exists","up"]},{"osd":1,"uuid":"461efe32-03d3-4689-8ae7-d205f89a38d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":33279},{"type":"v1","addr":"172.21.15.28:6802","nonce":33279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":33279},{"type":"v1","addr":"172.21.15.28:6806","nonce":33279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":33279},{"type":"v1","addr":"172.21.15.28:6814","nonce":33279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6808","nonce":33279},{"type":"v1","addr":"172.21.15.28:6810","nonce":33279}]},"public_addr":"172.21.15.28:6802/33279","cluster_addr":"172.21.15.28:6806/33279","heartbeat_back_addr":"172.21.15.28:6814/33279","heartbeat_front_addr":"172.21.15.28:6810/33279","state":["exists","up"]},{"osd":2,"uuid":"4bd58f9d-27f7-4792-8e8b-453d689eae46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":33280},{"type":"v1","addr":"172.21.15.28:6817","nonce":33280}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":33280},{"type":"v1","addr":"172.21.15.28:6819","nonce":33280}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":33280},{"type":"v1","addr":"172.21.15.28:6823","nonce":33280}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6820","nonce":33280},{"type":"v1","addr":"172.21.15.28:6821","nonce":33280}]},"public_addr":"172.21.15.28:6817/33280","cluster_addr":"172.21.15.28:6819/33280","heartbeat_back_addr":"172.21.15.28:6823/33280","heartbeat_front_addr":"172.21.15.28:6821/33280","state":["exists","up"]},{"osd":3,"uuid":"b15adb32-5d9e-4bc8-9258-a46cfd3c8a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":33504},{"type":"v1","addr":"172.21.15.63:6805","nonce":33504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":33504},{"type":"v1","addr":"172.21.15.63:6810","nonce":33504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":33504},{"type":"v1","addr":"172.21.15.63:6815","nonce":33504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":33504},{"type":"v1","addr":"172.21.15.63:6813","nonce":33504}]},"public_addr":"172.21.15.63:6805/33504","cluster_addr":"172.21.15.63:6810/33504","heartbeat_back_addr":"172.21.15.63:6815/33504","heartbeat_front_addr":"172.21.15.63:6813/33504","state":["exists","up"]},{"osd":4,"uuid":"0b12f436-1c7e-425d-9ee7-23f2ead1f828","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":33505},{"type":"v1","addr":"172.21.15.63:6817","nonce":33505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":33505},{"type":"v1","addr":"172.21.15.63:6819","nonce":33505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":33505},{"type":"v1","addr":"172.21.15.63:6823","nonce":33505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":33505},{"type":"v1","addr":"172.21.15.63:6821","nonce":33505}]},"public_addr":"172.21.15.63:6817/33505","cluster_addr":"172.21.15.63:6819/33505","heartbeat_back_addr":"172.21.15.63:6823/33505","heartbeat_front_addr":"172.21.15.63:6821/33505","state":["exists","up"]},{"osd":5,"uuid":"51eb5d2f-ca66-4d9c-b8c4-b1b6c0a71a93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":33506},{"type":"v1","addr":"172.21.15.63:6801","nonce":33506}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":33506},{"type":"v1","addr":"172.21.15.63:6804","nonce":33506}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6809","nonce":33506},{"type":"v1","addr":"172.21.15.63:6811","nonce":33506}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":33506},{"type":"v1","addr":"172.21.15.63:6808","nonce":33506}]},"public_addr":"172.21.15.63:6801/33506","cluster_addr":"172.21.15.63:6804/33506","heartbeat_back_addr":"172.21.15.63:6811/33506","heartbeat_front_addr":"172.21.15.63:6808/33506","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.360569+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.424079+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.458359+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.423025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.452402+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T21:30:16.398176+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T21:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 10 librados: watch_flush enter 2024-03-27T21:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 10 librados: watch_flush exit 2024-03-27T21:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 20 client.4655.objecter shutdown clearing up homeless session... 2024-03-27T21:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 10 client.4655.objecter successfully canceled tick 2024-03-27T21:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f96cc03a250 msgr2=0x7f96cc03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f96cc03a250 0x7f96cc03c710 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009ae0 tx=0x7f96d8008040 comp rx=0 tx=0).stop 2024-03-27T21:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 10 monclient: shutdown 2024-03-27T21:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 msgr2=0x7f96e009c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e009c950 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c800 tx=0x7f96d000ccc0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 shutdown_connections 2024-03-27T21:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f96cc03a250 0x7f96cc03c710 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f96e0136d00 0x7f96e009c950 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96e01339e0 0x7f96e0132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 --2- 172.21.15.28:0/2891112554 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f96e00a3d70 0x7f96e01cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 >> 172.21.15.28:0/2891112554 conn(0x7f96e00a9430 msgr2=0x7f96e00a4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 shutdown_connections 2024-03-27T21:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 -- 172.21.15.28:0/2891112554 wait complete. 2024-03-27T21:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:24.354+0000 7f96e81ec640 1 librados: shutdown 2024-03-27T21:32:25.354 INFO:tasks.ceph:Scrubbing osd.0 2024-03-27T21:32:25.355 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-27T21:32:25.473 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.485+0000 7f371b7a9640 10 monclient: get_monmap_and_config 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.485+0000 7f371b7a9640 10 monclient: build_initial_monmap 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.485+0000 7f371b7a9640 10 monclient: monmap: 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:25.486193+0000 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:25.486193+0000 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:25.474 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:25.475 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:25.476 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.476 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.485+0000 7f371b7a9640 1 Processor -- start 2024-03-27T21:32:25.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 -- start start 2024-03-27T21:32:25.486 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient: init 2024-03-27T21:32:25.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:25.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient: _add_conns ranks=[3,4,8,10,9,7,1,2,0,5,6] 2024-03-27T21:32:25.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3714136d00 0x7f37141370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): picked mon.noname-g con 0x7f3714136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:25.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 0x7f3714137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.487 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): picked mon.noname-c con 0x7f37140a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 0x7f3714133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): picked mon.noname-e con 0x7f37141339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37140a25b0 con 0x7f3714136d00 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3714137b60 con 0x7f37140a3d70 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.488 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f37140a13f0 con 0x7f37141339e0 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f371b7a9640 10 monclient(hunting): authenticate will time out at 967.793398s 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 0x7f3714133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 0x7f3714137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 0x7f3714137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37448/0 (socket says 172.21.15.28:37448) 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 0x7f3714133e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44254/0 (socket says 172.21.15.28:44254) 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 1 -- 172.21.15.28:0/3244653527 learned_addr learned my addr 172.21.15.28:0/3244653527 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 10 monclient(hunting): get_auth_request con 0x7f37140a3d70 auth_method 0 2024-03-27T21:32:25.489 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): get_auth_request con 0x7f37141339e0 auth_method 0 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.490 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3719d46640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.486+0000 7f3718d44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3718d44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719545640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3714136d00 0x7f37141370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719545640 10 monclient(hunting): get_auth_request con 0x7f3714136d00 auth_method 0 2024-03-27T21:32:25.491 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719545640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719545640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719545640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 10 monclient(hunting): handle_auth_done global_id 4589 payload 274 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 -- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 msgr2=0x7f3714137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 0x7f3714137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 -- 172.21.15.28:0/3244653527 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3714136d00 msgr2=0x7f37141370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3714136d00 0x7f37141370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.492 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 10 monclient: _finish_hunting 0 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 monclient: found mon.noname-e 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 -- 172.21.15.28:0/3244653527 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37140618f0 con 0x7f37141339e0 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3718d44640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 0x7f3714137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719545640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3714136d00 0x7f37141370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.487+0000 7f3719d46640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 0x7f3714133e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3704009dc0 tx=0x7f370402bcc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=984304e34ee23bfd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.493 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 1 -- 172.21.15.28:0/3244653527 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f370402cce0 con 0x7f37141339e0 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: dump: 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.494 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.495 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 1 -- 172.21.15.28:0/3244653527 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370402ce60 con 0x7f37141339e0 2024-03-27T21:32:25.496 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 5 monclient: authenticate success, global_id 4589 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 1 -- 172.21.15.28:0/3244653527 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f37040327b0 con 0x7f37141339e0 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f3713fff640 10 monclient: dump: 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.497 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.498 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 4 set_mon_vals no callback set 2024-03-27T21:32:25.499 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 10 monclient: shutdown 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 -- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 msgr2=0x7f3714133e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 0x7f3714133e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3704009dc0 tx=0x7f370402bcc0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 -- 172.21.15.28:0/3244653527 shutdown_connections 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f37141339e0 0x7f3714133e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37140a3d70 0x7f3714137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 --2- 172.21.15.28:0/3244653527 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3714136d00 0x7f37141370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 -- 172.21.15.28:0/3244653527 >> 172.21.15.28:0/3244653527 conn(0x7f37140a9430 msgr2=0x7f37140a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 -- 172.21.15.28:0/3244653527 shutdown_connections 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.488+0000 7f371b7a9640 1 -- 172.21.15.28:0/3244653527 wait complete. 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 10 monclient: build_initial_monmap 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 10 monclient: monmap: 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:25.501 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:25.502 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 1 librados: starting msgr at 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 1 librados: starting objecter 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 1 Processor -- start 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 1 -- start start 2024-03-27T21:32:25.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 1 librados: setting wanted keys 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 1 librados: calling monclient init 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.489+0000 7f371b7a9640 10 monclient: init 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient: _add_conns ranks=[0,4,2,7,6,5,1,8,3] 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37140a3d70 0x7f37141cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): picked mon.noname-a con 0x7f37140a3d70 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37141339e0 0x7f3714132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): picked mon.noname-c con 0x7f37141339e0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 0x7f3714132ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): picked mon.noname-b con 0x7f3714136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714133530 con 0x7f37140a3d70 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3714120490 con 0x7f3714136d00 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f371411fc60 con 0x7f37141339e0 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f371b7a9640 10 monclient(hunting): authenticate will time out at 967.796888s 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37140a3d70 0x7f37141cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37141339e0 0x7f3714132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37140a3d70 0x7f37141cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58446/0 (socket says 172.21.15.28:58446) 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 1 -- 172.21.15.28:0/2510140599 learned_addr learned my addr 172.21.15.28:0/2510140599 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:25.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): get_auth_request con 0x7f37141339e0 auth_method 0 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): get_auth_request con 0x7f37140a3d70 auth_method 0 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719d46640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 0x7f3714132ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719d46640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 msgr2=0x7f3714132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719d46640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 msgr2=0x7f3714132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719d46640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 0x7f3714132ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719d46640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 0x7f3714132ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3719545640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient(hunting): handle_auth_done global_id 34222 payload 824 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 msgr2=0x7f3714132ff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3714136d00 0x7f3714132ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37140a3d70 msgr2=0x7f37141cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37140a3d70 0x7f37141cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient: _finish_hunting 0 2024-03-27T21:32:25.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 monclient: found mon.noname-c 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 -- 172.21.15.28:0/2510140599 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080094d0 con 0x7f37141339e0 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3718d44640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37141339e0 0x7f3714132ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f370800e9e0 tx=0x7f370800eea0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 client.?.objecter ms_handle_connect 0x7f37141339e0 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f370800ce40 con 0x7f37141339e0 2024-03-27T21:32:25.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 monclient: dump: 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.511 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.512 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.490+0000 7f3711ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 5 monclient: authenticate success, global_id 34222 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708013470 con 0x7f37141339e0 2024-03-27T21:32:25.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f3711ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3708013a50 con 0x7f37141339e0 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 10 monclient: _renew_subs 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3704009a70 con 0x7f37141339e0 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f3711ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f37137fe640 4 set_mon_vals no callback set 2024-03-27T21:32:25.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f3711ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f3711ffb640 10 monclient: dump: 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.515 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 10 client.34222.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 10 monclient: _renew_subs 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37141201b0 con 0x7f37141339e0 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.491+0000 7f371b7a9640 1 librados: init done 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f3708013bb0 con 0x7f37141339e0 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f371b7a9640 10 client.34222.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f371b7a9640 15 client.34222.objecter _session_command_op_assign -1 1 2024-03-27T21:32:25.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f371b7a9640 20 client.34222.objecter _get_session osd=-1 returning homeless 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f371b7a9640 10 client.34222.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f371b7a9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37140a3020 con 0x7f37141339e0 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f370003a250 0x7f370003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f370804a330 con 0x7f37141339e0 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 10 client.34222.objecter ms_dispatch 0x7f3714000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 3 client.34222.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:25.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 3 client.34222.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 10 client.34222.objecter checking command 1 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f3700040060 0x7f3700042480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 20 client.34222.objecter _get_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 15 client.34222.objecter _session_command_op_remove -1 1 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 20 client.34222.objecter _get_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 20 client.34222.objecter get_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.519 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 15 client.34222.objecter _session_command_op_assign 0 1 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 4 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 10 client.34222.objecter _send_command 1 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 --> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3700042b30 con 0x7f3700040060 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 20 client.34222.objecter dump_active .. 0 homeless 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3708013e60 con 0x7f37141339e0 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3719d46640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f3700040060 0x7f3700042480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3719d46640 10 monclient: get_auth_request con 0x7f3700040060 auth_method 0 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3719545640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f370003a250 0x7f370003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3719545640 10 monclient: get_auth_request con 0x7f370003a250 auth_method 0 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3711ffb640 10 client.34222.objecter ms_handle_connect 0x7f3700040060 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.492+0000 7f3719d46640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f3700040060 0x7f3700042480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3711ffb640 10 client.34222.objecter ms_handle_connect 0x7f370003a250 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3719545640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f370003a250 0x7f370003c710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f370c006d40 tx=0x7f370c008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== osd.0 v2:172.21.15.28:6801/33278 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3700042b30 con 0x7f3700040060 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3711ffb640 10 client.34222.objecter ms_dispatch 0x7f3714000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:32:25.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3711ffb640 10 client.34222.objecter _finish_command 1 = system:0 2024-03-27T21:32:25.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3711ffb640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 4 2024-03-27T21:32:25.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.493+0000 7f3711ffb640 15 client.34222.objecter _session_command_op_remove 0 1 2024-03-27T21:32:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 client.34222.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-03-27T21:32:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 15 client.34222.objecter _session_command_op_assign -1 2 2024-03-27T21:32:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter _get_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter _get_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 15 client.34222.objecter _session_command_op_remove -1 2 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter get_session s=0x7f370003f990 osd=0 3 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 15 client.34222.objecter _session_command_op_assign 0 2 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 4 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 client.34222.objecter _send_command 2 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 --> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37140a2240 con 0x7f3700040060 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f3711ffb640 1 -- 172.21.15.28:0/2510140599 <== osd.0 v2:172.21.15.28:6801/33278 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3704009450 con 0x7f3700040060 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f3711ffb640 10 client.34222.objecter ms_dispatch 0x7f3714000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:32:25.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f3711ffb640 10 client.34222.objecter _finish_command 2 = system:0 2024-03-27T21:32:25.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f3711ffb640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 4 2024-03-27T21:32:25.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f3711ffb640 15 client.34222.objecter _session_command_op_remove 0 2 2024-03-27T21:32:25.525 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:25.525 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T21:32:25.525 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 librados: watch_flush enter 2024-03-27T21:32:25.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 librados: watch_flush exit 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 client.34222.objecter close_session for osd.0 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f3700040060 msgr2=0x7f3700042480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:6801/33278,v1:172.21.15.28:6803/33278] conn(0x7f3700040060 0x7f3700042480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter put_session s=0x7f370003f990 osd=0 1 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 client.34222.objecter shutdown clearing up homeless session... 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 client.34222.objecter successfully canceled tick 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f370003a250 msgr2=0x7f370003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f370003a250 0x7f370003c710 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f370c006d40 tx=0x7f370c008040 comp rx=0 tx=0).stop 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 10 monclient: shutdown 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37141339e0 msgr2=0x7f3714132ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 --2- 172.21.15.28:0/2510140599 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f37141339e0 0x7f3714132ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f370800e9e0 tx=0x7f370800eea0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f3719d46640 1 -- 172.21.15.28:0/2510140599 reap_dead start 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 shutdown_connections 2024-03-27T21:32:25.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 >> 172.21.15.28:0/2510140599 conn(0x7f37140a9430 msgr2=0x7f3714136550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 shutdown_connections 2024-03-27T21:32:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 -- 172.21.15.28:0/2510140599 wait complete. 2024-03-27T21:32:25.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.506+0000 7f371b7a9640 1 librados: shutdown 2024-03-27T21:32:25.530 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-27T21:32:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.644+0000 7f91137dd640 10 monclient: get_monmap_and_config 2024-03-27T21:32:25.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.644+0000 7f91137dd640 10 monclient: build_initial_monmap 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.644+0000 7f91137dd640 10 monclient: monmap: 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:25.645260+0000 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:25.645260+0000 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.633 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:25.634 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:25.635 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:25.635 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 Processor -- start 2024-03-27T21:32:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 -- start start 2024-03-27T21:32:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient: init 2024-03-27T21:32:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:25.644 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient: _add_conns ranks=[4,0,10,7,5,6,8,2,3,1,9] 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f910c0a0920 0x7f910c134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): picked mon.noname-c con 0x7f910c0a0920 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f910c135460 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f910c06ff10 0x7f910c13bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): picked mon.noname-f con 0x7f910c06ff10 addr v2:172.21.15.63:3300/0 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0618f0 con 0x7f910c135460 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c0716a0 con 0x7f910c06ff10 2024-03-27T21:32:25.645 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0713c0 con 0x7f910c0a0920 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f91137dd640 10 monclient(hunting): authenticate will time out at 967.952497s 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9111579640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f910c0a0920 0x7f910c134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9110d78640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f910c135460 0x7f910c0a0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54394/0 (socket says 172.21.15.28:54394) 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9110d78640 1 -- 172.21.15.28:0/3076964956 learned_addr learned my addr 172.21.15.28:0/3076964956 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9111579640 10 monclient(hunting): get_auth_request con 0x7f910c0a0920 auth_method 0 2024-03-27T21:32:25.646 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9111579640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9111579640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.645+0000 7f9111579640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111d7a640 1 --2- 172.21.15.28:0/3076964956 >> v2:172.21.15.63:3300/0 conn(0x7f910c06ff10 0x7f910c13bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111d7a640 10 monclient(hunting): get_auth_request con 0x7f910c06ff10 auth_method 0 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111d7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.647 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111d7a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111d7a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9103fff640 1 -- 172.21.15.28:0/3076964956 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669803391 0 0) 0x7f910c0618f0 con 0x7f910c135460 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9103fff640 10 monclient(hunting): _negotiate 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9103fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9103fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9103fff640 10 monclient(hunting): my global_id is 34236 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9103fff640 1 -- 172.21.15.28:0/3076964956 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f8003520 con 0x7f910c135460 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 10 monclient(hunting): handle_auth_done global_id 34231 payload 274 2024-03-27T21:32:25.648 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 1 -- 172.21.15.28:0/3076964956 >> v2:172.21.15.63:3300/0 conn(0x7f910c06ff10 msgr2=0x7f910c13bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 1 --2- 172.21.15.28:0/3076964956 >> v2:172.21.15.63:3300/0 conn(0x7f910c06ff10 0x7f910c13bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 1 -- 172.21.15.28:0/3076964956 >> v1:172.21.15.28:6789/0 conn(0x7f910c135460 legacy=0x7f910c0a0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 10 monclient: _finish_hunting 0 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 1 monclient: found mon.noname-c 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 1 -- 172.21.15.28:0/3076964956 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0a1410 con 0x7f910c0a0920 2024-03-27T21:32:25.649 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.646+0000 7f9111579640 1 --2- 172.21.15.28:0/3076964956 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f910c0a0920 0x7f910c134f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91080097a0 tx=0x7f910802b7a0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=d5528596e43a4df4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 1 -- 172.21.15.28:0/3076964956 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f910802f050 con 0x7f910c0a0920 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: dump: 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.650 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.651 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 1 -- 172.21.15.28:0/3076964956 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9108031970 con 0x7f910c0a0920 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 5 monclient: authenticate success, global_id 34231 2024-03-27T21:32:25.652 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 1 -- 172.21.15.28:0/3076964956 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9108032390 con 0x7f910c0a0920 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 4 set_mon_vals no callback set 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f9103fff640 10 monclient: dump: 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.653 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.654 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 10 monclient: shutdown 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:25.655 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 -- 172.21.15.28:0/3076964956 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f910c0a0920 msgr2=0x7f910c134f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 --2- 172.21.15.28:0/3076964956 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f910c0a0920 0x7f910c134f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91080097a0 tx=0x7f910802b7a0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 -- 172.21.15.28:0/3076964956 shutdown_connections 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 --2- 172.21.15.28:0/3076964956 >> v2:172.21.15.63:3300/0 conn(0x7f910c06ff10 0x7f910c13bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 --2- 172.21.15.28:0/3076964956 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f910c0a0920 0x7f910c134f20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 -- 172.21.15.28:0/3076964956 >> 172.21.15.28:0/3076964956 conn(0x7f910c0a7810 msgr2=0x7f910c0a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 -- 172.21.15.28:0/3076964956 shutdown_connections 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.647+0000 7f91137dd640 1 -- 172.21.15.28:0/3076964956 wait complete. 2024-03-27T21:32:25.656 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 10 monclient: build_initial_monmap 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 10 monclient: monmap: 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:25.657 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.658 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 1 librados: starting msgr at 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 1 librados: starting objecter 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 1 Processor -- start 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 1 -- start start 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 1 librados: setting wanted keys 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 1 librados: calling monclient init 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.648+0000 7f91137dd640 10 monclient: init 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:25.659 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient: _add_conns ranks=[3,2,7,1,0,5,4,8,6] 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f910c06ff10 0x7f910c12a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): picked mon.noname-g con 0x7f910c06ff10 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 0x7f910c12af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): picked mon.noname-b con 0x7f910c0a0920 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f910c1304e0 0x7f910c130960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): picked mon.noname-i con 0x7f910c1304e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c09b5c0 con 0x7f910c0a0920 2024-03-27T21:32:25.660 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c099a90 con 0x7f910c06ff10 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f910c070640 con 0x7f910c1304e0 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient(hunting): authenticate will time out at 967.955846s 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 0x7f910c12af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 0x7f910c12af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38536/0 (socket says 172.21.15.28:38536) 2024-03-27T21:32:25.661 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 -- 172.21.15.28:0/1346743704 learned_addr learned my addr 172.21.15.28:0/1346743704 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): get_auth_request con 0x7f910c0a0920 auth_method 0 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f910c06ff10 0x7f910c12a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.662 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f910c1304e0 0x7f910c130960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): get_auth_request con 0x7f910c06ff10 auth_method 0 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): get_auth_request con 0x7f910c1304e0 auth_method 0 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.663 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111579640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9111d7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient(hunting): handle_auth_done global_id 4664 payload 824 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 -- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f910c1304e0 msgr2=0x7f910c130960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.664 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f910c1304e0 0x7f910c130960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 -- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f910c06ff10 msgr2=0x7f910c12a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f910c06ff10 0x7f910c12a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient: _finish_hunting 0 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 monclient: found mon.noname-b 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 -- 172.21.15.28:0/1346743704 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9108009400 con 0x7f910c0a0920 2024-03-27T21:32:25.665 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9110d78640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 0x7f910c12af20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c3c0 tx=0x7f90fc00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 client.?.objecter ms_handle_connect 0x7f910c0a0920 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90fc007540 con 0x7f910c0a0920 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: dump: 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.666 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.667 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:25.668 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 5 monclient: authenticate success, global_id 4664 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc007700 con 0x7f910c0a0920 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f90fc005ba0 con 0x7f910c0a0920 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91037fe640 4 set_mon_vals no callback set 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f9101ffb640 10 monclient: dump: 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.669 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.670 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient: _renew_subs 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.649+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c09a9d0 con 0x7f910c0a0920 2024-03-27T21:32:25.671 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.650+0000 7f91137dd640 10 client.4664.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.650+0000 7f91137dd640 10 monclient: _renew_subs 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.650+0000 7f91137dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.650+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c131e70 con 0x7f910c0a0920 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.650+0000 7f91137dd640 1 librados: init done 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.650+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f90fc005d00 con 0x7f910c0a0920 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f90f003a280 0x7f90f003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f90fc049240 con 0x7f910c0a0920 2024-03-27T21:32:25.672 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 10 client.4664.objecter ms_dispatch 0x7f910c000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 3 client.4664.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 3 client.4664.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f91137dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f91137dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f91137dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 20 client.4664.objecter dump_active .. 0 homeless 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c067350 con 0x7f910c0a0920 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9111579640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f90f003a280 0x7f90f003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.673 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9111579640 10 monclient: get_auth_request con 0x7f90f003a280 auth_method 0 2024-03-27T21:32:25.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9101ffb640 10 client.4664.objecter ms_handle_connect 0x7f90f003a280 2024-03-27T21:32:25.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.651+0000 7f9111579640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f90f003a280 0x7f90f003c740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9108035000 tx=0x7f9108008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.656+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f90fc017080 con 0x7f910c0a0920 2024-03-27T21:32:25.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.656+0000 7f9101ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:25.674 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.656+0000 7f9101ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:25.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.838+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f910c074b10 con 0x7f90f003a280 2024-03-27T21:32:25.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.838+0000 7f9101ffb640 1 -- 172.21.15.28:0/1346743704 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f910c074b10 con 0x7f90f003a280 2024-03-27T21:32:25.827 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 0 to deep-scrub 2024-03-27T21:32:25.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.840+0000 7f91137dd640 10 librados: watch_flush enter 2024-03-27T21:32:25.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.840+0000 7f91137dd640 10 librados: watch_flush exit 2024-03-27T21:32:25.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.840+0000 7f91137dd640 20 client.4664.objecter shutdown clearing up homeless session... 2024-03-27T21:32:25.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.840+0000 7f91137dd640 10 client.4664.objecter successfully canceled tick 2024-03-27T21:32:25.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f90f003a280 msgr2=0x7f90f003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f90f003a280 0x7f90f003c740 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9108035000 tx=0x7f9108008030 comp rx=0 tx=0).stop 2024-03-27T21:32:25.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 10 monclient: shutdown 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 msgr2=0x7f910c12af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 0x7f910c12af20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f90fc00c3c0 tx=0x7f90fc00c880 comp rx=0 tx=0).stop 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 shutdown_connections 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f90f003a280 0x7f90f003c740 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f910c1304e0 0x7f910c130960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f910c0a0920 0x7f910c12af20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 --2- 172.21.15.28:0/1346743704 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f910c06ff10 0x7f910c12a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 >> 172.21.15.28:0/1346743704 conn(0x7f910c0a7810 msgr2=0x7f910c09f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:25.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 shutdown_connections 2024-03-27T21:32:25.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 -- 172.21.15.28:0/1346743704 wait complete. 2024-03-27T21:32:25.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.841+0000 7f91137dd640 1 librados: shutdown 2024-03-27T21:32:25.839 INFO:tasks.ceph:Scrubbing osd.1 2024-03-27T21:32:25.839 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-27T21:32:25.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.955+0000 7fa4b3c82640 10 monclient: get_monmap_and_config 2024-03-27T21:32:25.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.955+0000 7fa4b3c82640 10 monclient: build_initial_monmap 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.955+0000 7fa4b3c82640 10 monclient: monmap: 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:25.956086+0000 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:25.956086+0000 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:25.944 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:25.945 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:25.946 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.955+0000 7fa4b3c82640 1 Processor -- start 2024-03-27T21:32:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 -- start start 2024-03-27T21:32:25.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient: init 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient: _add_conns ranks=[2,7,8,3,6,0,10,9,1,5,4] 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 0x7fa4ac1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): picked mon.noname-b con 0x7fa4ac136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa4ac0a3d70 0x7fa4ac137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): picked mon.noname-i con 0x7fa4ac0a3d70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:25.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac1339e0 0x7fa4ac133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): picked mon.noname-e con 0x7fa4ac1339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0a25b0 con 0x7fa4ac136d00 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac137b60 con 0x7fa4ac0a3d70 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac0a13f0 con 0x7fa4ac1339e0 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:25.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b3c82640 10 monclient(hunting): authenticate will time out at 968.263241s 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 0x7fa4ac1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac1339e0 0x7fa4ac133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 0x7fa4ac1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38548/0 (socket says 172.21.15.28:38548) 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 1 -- 172.21.15.28:0/2585447342 learned_addr learned my addr 172.21.15.28:0/2585447342 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): get_auth_request con 0x7fa4ac136d00 auth_method 0 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): get_auth_request con 0x7fa4ac1339e0 auth_method 0 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b1a1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b121d640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa4ac0a3d70 0x7fa4ac137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient(hunting): handle_auth_done global_id 4598 payload 274 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 -- 172.21.15.28:0/2585447342 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa4ac0a3d70 msgr2=0x7fa4ac137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa4ac0a3d70 0x7fa4ac137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 -- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 msgr2=0x7fa4ac1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 0x7fa4ac1370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.960 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient: _finish_hunting 0 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 monclient: found mon.noname-e 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.956+0000 7fa4b221f640 1 -- 172.21.15.28:0/2585447342 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0618f0 con 0x7fa4ac1339e0 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b121d640 10 monclient: get_auth_request con 0x7fa4ac0a3d70 auth_method 0 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b121d640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa4ac0a3d70 0x7fa4ac137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b1a1e640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 0x7fa4ac1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:25.961 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b221f640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac1339e0 0x7fa4ac133e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097d0 tx=0x7fa49c02b6e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a4dc42d95de31405 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 1 -- 172.21.15.28:0/2585447342 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa49c030980 con 0x7fa4ac1339e0 2024-03-27T21:32:25.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:25.962 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: dump: 2024-03-27T21:32:25.962 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.962 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.963 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: _finish_auth 0 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: _check_auth_tickets 2024-03-27T21:32:25.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:25.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b3c82640 5 monclient: authenticate success, global_id 4598 2024-03-27T21:32:25.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b3c82640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:25.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 1 -- 172.21.15.28:0/2585447342 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c02e050 con 0x7fa4ac1339e0 2024-03-27T21:32:25.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:25.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b3c82640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b3c82640 4 set_mon_vals no callback set 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 1 -- 172.21.15.28:0/2585447342 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa49c0313a0 con 0x7fa4ac1339e0 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.957+0000 7fa4b0a1c640 10 monclient: dump: 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.966 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.967 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.967 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.967 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.967 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.967 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.967 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 10 monclient: shutdown 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac1339e0 msgr2=0x7fa4ac133e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac1339e0 0x7fa4ac133e60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097d0 tx=0x7fa49c02b6e0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2585447342 shutdown_connections 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac1339e0 0x7fa4ac133e60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fa4ac0a3d70 0x7fa4ac137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2585447342 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7fa4ac136d00 0x7fa4ac1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2585447342 >> 172.21.15.28:0/2585447342 conn(0x7fa4ac0a9430 msgr2=0x7fa4ac0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:25.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2585447342 shutdown_connections 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.958+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2585447342 wait complete. 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient: build_initial_monmap 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient: monmap: 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:25.970 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:25.971 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 librados: starting msgr at 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 librados: starting objecter 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 Processor -- start 2024-03-27T21:32:25.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 -- start start 2024-03-27T21:32:25.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 librados: setting wanted keys 2024-03-27T21:32:25.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 librados: calling monclient init 2024-03-27T21:32:25.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient: init 2024-03-27T21:32:25.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:25.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient: _add_conns ranks=[3,6,8,5,4,2,7,1,0] 2024-03-27T21:32:25.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa4ac0a3d70 0x7fa4ac1cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): picked mon.noname-g con 0x7fa4ac0a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4ac1339e0 0x7fa4ac132a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): picked mon.noname-d con 0x7fa4ac1339e0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac136d00 0x7fa4ac132f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): picked mon.noname-e con 0x7fa4ac136d00 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac1cb900 con 0x7fa4ac0a3d70 2024-03-27T21:32:25.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac09eea0 con 0x7fa4ac1339e0 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac09f250 con 0x7fa4ac136d00 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b3c82640 10 monclient(hunting): authenticate will time out at 968.266582s 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b221f640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac136d00 0x7fa4ac132f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b121d640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4ac1339e0 0x7fa4ac132a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.959+0000 7fa4b221f640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac136d00 0x7fa4ac132f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3304/0 says I am v2:172.21.15.28:44260/0 (socket says 172.21.15.28:44260) 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 -- 172.21.15.28:0/2822113581 learned_addr learned my addr 172.21.15.28:0/2822113581 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): get_auth_request con 0x7fa4ac136d00 auth_method 0 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): get_auth_request con 0x7fa4ac1339e0 auth_method 0 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.976 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa4ac0a3d70 0x7fa4ac1cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): get_auth_request con 0x7fa4ac0a3d70 auth_method 0 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.977 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b1a1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient(hunting): handle_auth_done global_id 4607 payload 824 2024-03-27T21:32:25.978 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 -- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4ac1339e0 msgr2=0x7fa4ac132a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4ac1339e0 0x7fa4ac132a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 -- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa4ac0a3d70 msgr2=0x7fa4ac1cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa4ac0a3d70 0x7fa4ac1cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient: _finish_hunting 0 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 monclient: found mon.noname-e 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:25.979 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 -- 172.21.15.28:0/2822113581 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a4009b30 con 0x7fa4ac136d00 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b121d640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fa4ac1339e0 0x7fa4ac132a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b221f640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac136d00 0x7fa4ac132f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0096f0 tx=0x7fa49c0046c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 client.?.objecter ms_handle_connect 0x7fa4ac136d00 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa49c006e10 con 0x7fa4ac136d00 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: dump: 2024-03-27T21:32:25.980 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.981 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:25.982 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c003e20 con 0x7fa4ac136d00 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 5 monclient: authenticate success, global_id 4607 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 10 monclient: _renew_subs 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c009400 con 0x7fa4ac136d00 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:25.983 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa49c030df0 con 0x7fa4ac136d00 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4aa7fc640 10 monclient: dump: 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:25.984 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:25.985 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4abfff640 4 set_mon_vals no callback set 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 10 client.4607.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 10 monclient: _renew_subs 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac11fb60 con 0x7fa4ac136d00 2024-03-27T21:32:25.986 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.960+0000 7fa4b3c82640 1 librados: init done 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b3c82640 10 client.4607.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b3c82640 15 client.4607.objecter _session_command_op_assign -1 1 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b3c82640 20 client.4607.objecter _get_session osd=-1 returning homeless 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b3c82640 10 client.4607.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b3c82640 10 monclient: _send_mon_message to mon.e at v2:172.21.15.28:3304/0 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa4ac0a3020 con 0x7fa4ac136d00 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== mon.8 v2:172.21.15.28:3304/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa49c030510 con 0x7fa4ac136d00 2024-03-27T21:32:25.987 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa49803a250 0x7fa49803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== mon.8 v2:172.21.15.28:3304/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa49c06be40 con 0x7fa4ac136d00 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 10 client.4607.objecter ms_dispatch 0x7fa4ac000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 3 client.4607.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 3 client.4607.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 10 client.4607.objecter checking command 1 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fa498040060 0x7fa498042480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 20 client.4607.objecter _get_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.988 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 15 client.4607.objecter _session_command_op_remove -1 1 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 20 client.4607.objecter _get_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 20 client.4607.objecter get_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 15 client.4607.objecter _session_command_op_assign 1 1 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 4 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 10 client.4607.objecter _send_command 1 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 --> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa498042b30 con 0x7fa498040060 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 20 client.4607.objecter dump_active .. 0 homeless 2024-03-27T21:32:25.989 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== mon.8 v2:172.21.15.28:3304/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa49c06e4d0 con 0x7fa4ac136d00 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4aa7fc640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b1a1e640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa49803a250 0x7fa49803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b1a1e640 10 monclient: get_auth_request con 0x7fa49803a250 auth_method 0 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b121d640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fa498040060 0x7fa498042480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.961+0000 7fa4b121d640 10 monclient: get_auth_request con 0x7fa498040060 auth_method 0 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4b121d640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fa498040060 0x7fa498042480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 10 client.4607.objecter ms_handle_connect 0x7fa498040060 2024-03-27T21:32:25.990 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 10 client.4607.objecter ms_handle_connect 0x7fa49803a250 2024-03-27T21:32:25.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4b1a1e640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa49803a250 0x7fa49803c710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40072c0 tx=0x7fa4a400b040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:25.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== osd.1 v2:172.21.15.28:6800/33279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fa498042b30 con 0x7fa498040060 2024-03-27T21:32:25.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 10 client.4607.objecter ms_dispatch 0x7fa4ac000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:32:25.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 10 client.4607.objecter _finish_command 1 = system:0 2024-03-27T21:32:25.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 4 2024-03-27T21:32:25.991 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.962+0000 7fa4aa7fc640 15 client.4607.objecter _session_command_op_remove 1 1 2024-03-27T21:32:25.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 client.4607.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-03-27T21:32:25.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 15 client.4607.objecter _session_command_op_assign -1 2 2024-03-27T21:32:25.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter _get_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.992 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter _get_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 15 client.4607.objecter _session_command_op_remove -1 2 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter get_session s=0x7fa49803f990 osd=1 3 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 15 client.4607.objecter _session_command_op_assign 1 2 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 4 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 client.4607.objecter _send_command 2 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 --> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa4ac0a2240 con 0x7fa498040060 2024-03-27T21:32:25.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4aa7fc640 1 -- 172.21.15.28:0/2822113581 <== osd.1 v2:172.21.15.28:6800/33279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa4a000c040 con 0x7fa498040060 2024-03-27T21:32:25.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4aa7fc640 10 client.4607.objecter ms_dispatch 0x7fa4ac000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:32:25.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4aa7fc640 10 client.4607.objecter _finish_command 2 = system:0 2024-03-27T21:32:25.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4aa7fc640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 4 2024-03-27T21:32:25.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4aa7fc640 15 client.4607.objecter _session_command_op_remove 1 2 2024-03-27T21:32:25.994 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:25.994 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T21:32:25.995 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:25.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 librados: watch_flush enter 2024-03-27T21:32:25.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 librados: watch_flush exit 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 client.4607.objecter close_session for osd.1 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fa498040060 msgr2=0x7fa498042480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:6800/33279,v1:172.21.15.28:6802/33279] conn(0x7fa498040060 0x7fa498042480 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter put_session s=0x7fa49803f990 osd=1 1 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 client.4607.objecter shutdown clearing up homeless session... 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 client.4607.objecter successfully canceled tick 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa49803a250 msgr2=0x7fa49803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa49803a250 0x7fa49803c710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40072c0 tx=0x7fa4a400b040 comp rx=0 tx=0).stop 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 10 monclient: shutdown 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac136d00 msgr2=0x7fa4ac132f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 --2- 172.21.15.28:0/2822113581 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa4ac136d00 0x7fa4ac132f80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0096f0 tx=0x7fa49c0046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b221f640 1 -- 172.21.15.28:0/2822113581 reap_dead start 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 shutdown_connections 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 >> 172.21.15.28:0/2822113581 conn(0x7fa4ac0a9430 msgr2=0x7fa4ac0662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:25.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 shutdown_connections 2024-03-27T21:32:25.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.975+0000 7fa4b3c82640 1 -- 172.21.15.28:0/2822113581 wait complete. 2024-03-27T21:32:25.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:25.976+0000 7fa4b3c82640 1 librados: shutdown 2024-03-27T21:32:25.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-27T21:32:26.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.111+0000 7faa03f92640 10 monclient: get_monmap_and_config 2024-03-27T21:32:26.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.111+0000 7faa03f92640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.108 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.111+0000 7faa03f92640 10 monclient: monmap: 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:26.112425+0000 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:26.112425+0000 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:26.109 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:26.110 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 Processor -- start 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 -- start start 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient: init 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient: _add_conns ranks=[3,0,9,7,10,1,5,8,2,4,6] 2024-03-27T21:32:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa9fc136d00 0x7fa9fc1370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): picked mon.noname-g con 0x7fa9fc136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa9fc0a3d70 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa9fc137620 0x7fa9fc1340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): picked mon.noname-a con 0x7fa9fc137620 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9fc0618f0 con 0x7fa9fc0a3d70 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9fc0a25b0 con 0x7fa9fc137620 2024-03-27T21:32:26.112 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0a13f0 con 0x7fa9fc136d00 2024-03-27T21:32:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa03f92640 10 monclient(hunting): authenticate will time out at 968.419563s 2024-03-27T21:32:26.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa0252f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa9fc137620 0x7fa9fc1340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.114 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa0152d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa9fc0a3d70 0x7fa9fc1339e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54396/0 (socket says 172.21.15.28:54396) 2024-03-27T21:32:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa0152d640 1 -- 172.21.15.28:0/1180674395 learned_addr learned my addr 172.21.15.28:0/1180674395 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa0252f640 10 monclient(hunting): get_auth_request con 0x7fa9fc137620 auth_method 0 2024-03-27T21:32:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.112+0000 7faa0252f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.116 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa01d2e640 1 --2- 172.21.15.28:0/1180674395 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa9fc136d00 0x7fa9fc1370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient(hunting): handle_auth_done global_id 34245 payload 274 2024-03-27T21:32:26.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 1 -- 172.21.15.28:0/1180674395 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa9fc136d00 msgr2=0x7fa9fc1370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 1 --2- 172.21.15.28:0/1180674395 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa9fc136d00 0x7fa9fc1370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 1 -- 172.21.15.28:0/1180674395 >> v1:172.21.15.28:6789/0 conn(0x7fa9fc0a3d70 legacy=0x7fa9fc1339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 1 monclient: found mon.noname-a 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa00d2c640 1 -- 172.21.15.28:0/1180674395 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634394160 0 0) 0x7fa9fc0618f0 con 0x7fa9fc0a3d70 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 1 -- 172.21.15.28:0/1180674395 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc0a1f60 con 0x7fa9fc137620 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa00d2c640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.113+0000 7faa0252f640 1 --2- 172.21.15.28:0/1180674395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9fc137620 0x7fa9fc1340f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009d90 tx=0x7fa9f402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e75fee3afb2bc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.119 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 1 -- 172.21.15.28:0/1180674395 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa9f402cda0 con 0x7fa9fc137620 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: dump: 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.120 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.121 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.122 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 5 monclient: authenticate success, global_id 34245 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 1 -- 172.21.15.28:0/1180674395 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f4032340 con 0x7fa9fc137620 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 1 -- 172.21.15.28:0/1180674395 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa9f4032920 con 0x7fa9fc137620 2024-03-27T21:32:26.123 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 4 set_mon_vals no callback set 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa00d2c640 10 monclient: dump: 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.124 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.125 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 10 monclient: shutdown 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 -- 172.21.15.28:0/1180674395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9fc137620 msgr2=0x7fa9fc1340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 --2- 172.21.15.28:0/1180674395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9fc137620 0x7fa9fc1340f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009d90 tx=0x7fa9f402bd80 comp rx=0 tx=0).stop 2024-03-27T21:32:26.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 -- 172.21.15.28:0/1180674395 shutdown_connections 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 --2- 172.21.15.28:0/1180674395 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa9fc137620 0x7fa9fc1340f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 --2- 172.21.15.28:0/1180674395 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fa9fc136d00 0x7fa9fc1370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 -- 172.21.15.28:0/1180674395 >> 172.21.15.28:0/1180674395 conn(0x7fa9fc0a9430 msgr2=0x7fa9fc0a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 -- 172.21.15.28:0/1180674395 shutdown_connections 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.114+0000 7faa03f92640 1 -- 172.21.15.28:0/1180674395 wait complete. 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 10 monclient: monmap: 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.127 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.128 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 1 librados: starting msgr at 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 1 librados: starting objecter 2024-03-27T21:32:26.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 1 Processor -- start 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 1 -- start start 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 1 librados: setting wanted keys 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 1 librados: calling monclient init 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.115+0000 7faa03f92640 10 monclient: init 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient: _add_conns ranks=[1,4,8,2,7,6,0,5,3] 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9fc0a3d70 0x7fa9fc1cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): picked mon.noname-f con 0x7fa9fc0a3d70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:26.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 0x7fa9fc134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): picked mon.noname-c con 0x7fa9fc136d00 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa9fc137620 0x7fa9fc134640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): picked mon.noname-e con 0x7fa9fc137620 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc134b80 con 0x7fa9fc0a3d70 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc1cbc60 con 0x7fa9fc136d00 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc121ac0 con 0x7fa9fc137620 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient(hunting): authenticate will time out at 968.422815s 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 0x7fa9fc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa9fc137620 0x7fa9fc134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 0x7fa9fc134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37466/0 (socket says 172.21.15.28:37466) 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 -- 172.21.15.28:0/2330766464 learned_addr learned my addr 172.21.15.28:0/2330766464 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): get_auth_request con 0x7fa9fc136d00 auth_method 0 2024-03-27T21:32:26.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): get_auth_request con 0x7fa9fc137620 auth_method 0 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9fc0a3d70 0x7fa9fc1cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): get_auth_request con 0x7fa9fc0a3d70 auth_method 0 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa01d2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient(hunting): handle_auth_done global_id 34240 payload 824 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 -- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa9fc137620 msgr2=0x7fa9fc134640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa9fc137620 0x7fa9fc134640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 -- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9fc0a3d70 msgr2=0x7fa9fc1cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9fc0a3d70 0x7fa9fc1cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 monclient: found mon.noname-c 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.28:3302/0 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 -- 172.21.15.28:0/2330766464 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4009a70 con 0x7fa9fc136d00 2024-03-27T21:32:26.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0252f640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa9fc137620 0x7fa9fc134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa0152d640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 0x7fa9fc134100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c490 tx=0x7fa9ec00c950 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 client.?.objecter ms_handle_connect 0x7fa9fc136d00 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mon.4 v2:172.21.15.28:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa9ec0047e0 con 0x7fa9fc136d00 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: dump: 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.137 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.138 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mon.4 v2:172.21.15.28:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ec004960 con 0x7fa9fc136d00 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mon.4 v2:172.21.15.28:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa9ec011360 con 0x7fa9fc136d00 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 5 monclient: authenticate success, global_id 34240 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f3fff640 4 set_mon_vals no callback set 2024-03-27T21:32:26.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7fa9f27fc640 10 monclient: dump: 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.141 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient: _renew_subs 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.116+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc0a1630 con 0x7fa9fc136d00 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 10 client.34240.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 10 monclient: _renew_subs 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc09f8c0 con 0x7fa9fc136d00 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 1 librados: init done 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mon.4 v2:172.21.15.28:3302/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fa9ec004ad0 con 0x7fa9fc136d00 2024-03-27T21:32:26.143 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.28:3302/0 2024-03-27T21:32:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc0670d0 con 0x7fa9fc136d00 2024-03-27T21:32:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.117+0000 7fa9f27fc640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa9e003a280 0x7fa9e003c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mon.4 v2:172.21.15.28:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fa9ec0494b0 con 0x7fa9fc136d00 2024-03-27T21:32:26.144 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7fa9f27fc640 10 client.34240.objecter ms_dispatch 0x7fa9fc000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7fa9f27fc640 3 client.34240.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7fa9f27fc640 3 client.34240.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7fa9f27fc640 20 client.34240.objecter dump_active .. 0 homeless 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7faa01d2e640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa9e003a280 0x7fa9e003c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7faa01d2e640 10 monclient: get_auth_request con 0x7fa9e003a280 auth_method 0 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7fa9f27fc640 10 client.34240.objecter ms_handle_connect 0x7fa9e003a280 2024-03-27T21:32:26.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.118+0000 7faa01d2e640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa9e003a280 0x7fa9e003c740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800aac0 tx=0x7fa9f8008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.122+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mon.4 v2:172.21.15.28:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7fa9ec0108f0 con 0x7fa9fc136d00 2024-03-27T21:32:26.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.122+0000 7fa9f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.122+0000 7fa9f27fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:26.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.300+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9fc0a0b80 con 0x7fa9e003a280 2024-03-27T21:32:26.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.301+0000 7fa9f27fc640 1 -- 172.21.15.28:0/2330766464 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9fc0a0b80 con 0x7fa9e003a280 2024-03-27T21:32:26.289 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 1 to deep-scrub 2024-03-27T21:32:26.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 10 librados: watch_flush enter 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 10 librados: watch_flush exit 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 20 client.34240.objecter shutdown clearing up homeless session... 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 10 client.34240.objecter successfully canceled tick 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa9e003a280 msgr2=0x7fa9e003c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa9e003a280 0x7fa9e003c740 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800aac0 tx=0x7fa9f8008040 comp rx=0 tx=0).stop 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 10 monclient: shutdown 2024-03-27T21:32:26.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 msgr2=0x7fa9fc134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 0x7fa9fc134100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00c490 tx=0x7fa9ec00c950 comp rx=0 tx=0).stop 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 shutdown_connections 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fa9e003a280 0x7fa9e003c740 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fa9fc137620 0x7fa9fc134640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fa9fc136d00 0x7fa9fc134100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 --2- 172.21.15.28:0/2330766464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa9fc0a3d70 0x7fa9fc1cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.293 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 >> 172.21.15.28:0/2330766464 conn(0x7fa9fc0a9430 msgr2=0x7fa9fc134f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 shutdown_connections 2024-03-27T21:32:26.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 -- 172.21.15.28:0/2330766464 wait complete. 2024-03-27T21:32:26.294 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.303+0000 7faa03f92640 1 librados: shutdown 2024-03-27T21:32:26.301 INFO:tasks.ceph:Scrubbing osd.2 2024-03-27T21:32:26.302 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-27T21:32:26.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.418+0000 7fb3e9b18640 10 monclient: get_monmap_and_config 2024-03-27T21:32:26.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.418+0000 7fb3e9b18640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.418+0000 7fb3e9b18640 10 monclient: monmap: 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:26.419319+0000 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:26.419319+0000 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.407 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.408 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:26.409 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:26.409 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 Processor -- start 2024-03-27T21:32:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 -- start start 2024-03-27T21:32:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient: init 2024-03-27T21:32:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient: _add_conns ranks=[4,9,8,10,0,3,1,2,7,6,5] 2024-03-27T21:32:26.419 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 0x7fb3e40a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): picked mon.noname-c con 0x7fb3e409fc80 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3e409f480 0x7fb3e4069c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): picked mon.noname-a con 0x7fb3e409f480 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e406a1c0 0x7fb3e406a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): picked mon.noname-e con 0x7fb3e406a1c0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e409faf0 con 0x7fb3e409f480 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.420 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e409e770 con 0x7fb3e409fc80 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e409e1b0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e9b18640 10 monclient(hunting): authenticate will time out at 968.726506s 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 0x7fb3e40a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3e409f480 0x7fb3e4069c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e3fff640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e406a1c0 0x7fb3e406a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 0x7fb3e40a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37482/0 (socket says 172.21.15.28:37482) 2024-03-27T21:32:26.421 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb3e409f480 0x7fb3e4069c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58472/0 (socket says 172.21.15.28:58472) 2024-03-27T21:32:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 1 -- 172.21.15.28:0/2991849108 learned_addr learned my addr 172.21.15.28:0/2991849108 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 10 monclient(hunting): get_auth_request con 0x7fb3e409fc80 auth_method 0 2024-03-27T21:32:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.422 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e3fff640 10 monclient(hunting): get_auth_request con 0x7fb3e406a1c0 auth_method 0 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.419+0000 7fb3e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): get_auth_request con 0x7fb3e409f480 auth_method 0 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.423 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_done global_id 4625 payload 274 2024-03-27T21:32:26.424 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 -- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 msgr2=0x7fb3e40a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 --2- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 0x7fb3e40a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 -- 172.21.15.28:0/2991849108 >> v2:172.21.15.28:3300/0 conn(0x7fb3e409f480 msgr2=0x7fb3e4069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 --2- 172.21.15.28:0/2991849108 >> v2:172.21.15.28:3300/0 conn(0x7fb3e409f480 0x7fb3e4069c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 monclient: found mon.noname-e 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.425 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 10 monclient: _send_mon_message to mon.noname-e at v2:172.21.15.28:3304/0 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 -- 172.21.15.28:0/2991849108 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e40618f0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e37fe640 1 --2- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 0x7fb3e40a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.420+0000 7fb3e3fff640 1 --2- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e406a1c0 0x7fb3e406a650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009d90 tx=0x7fb3dc02bce0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=70c6b9664a52c70e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 1 -- 172.21.15.28:0/2991849108 <== mon.8 v2:172.21.15.28:3304/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb3dc02cd00 con 0x7fb3e406a1c0 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: dump: 2024-03-27T21:32:26.426 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.427 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.428 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 1 -- 172.21.15.28:0/2991849108 <== mon.8 v2:172.21.15.28:3304/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc02ce80 con 0x7fb3e406a1c0 2024-03-27T21:32:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 5 monclient: authenticate success, global_id 4625 2024-03-27T21:32:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.429 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 1 -- 172.21.15.28:0/2991849108 <== mon.8 v2:172.21.15.28:3304/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb3dc0327b0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 4 set_mon_vals no callback set 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e27fc640 10 monclient: dump: 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.430 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.431 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 10 monclient: shutdown 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 -- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e406a1c0 msgr2=0x7fb3e406a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.432 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e406a1c0 0x7fb3e406a650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc009d90 tx=0x7fb3dc02bce0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 -- 172.21.15.28:0/2991849108 shutdown_connections 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e406a1c0 0x7fb3e406a650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/2991849108 >> v2:172.21.15.28:3300/0 conn(0x7fb3e409f480 0x7fb3e4069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/2991849108 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fb3e409fc80 0x7fb3e40a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 -- 172.21.15.28:0/2991849108 >> 172.21.15.28:0/2991849108 conn(0x7fb3e406ad90 msgr2=0x7fb3e406b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 -- 172.21.15.28:0/2991849108 shutdown_connections 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.421+0000 7fb3e9b18640 1 -- 172.21.15.28:0/2991849108 wait complete. 2024-03-27T21:32:26.433 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 10 monclient: monmap: 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:26.434 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.435 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 1 librados: starting msgr at 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 1 librados: starting objecter 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 1 Processor -- start 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 1 -- start start 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 1 librados: setting wanted keys 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 1 librados: calling monclient init 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.422+0000 7fb3e9b18640 10 monclient: init 2024-03-27T21:32:26.436 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient: _add_conns ranks=[0,1,8,6,2,4,3,7,5] 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3e406a1c0 0x7fb3e41cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): picked mon.noname-a con 0x7fb3e406a1c0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e409f480 0x7fb3e41bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): picked mon.noname-f con 0x7fb3e409f480 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e409fc80 0x7fb3e41bc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): picked mon.noname-e con 0x7fb3e409fc80 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e41a9360 con 0x7fb3e406a1c0 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e41a95b0 con 0x7fb3e409f480 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e4071800 con 0x7fb3e409fc80 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.438 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e9b18640 10 monclient(hunting): authenticate will time out at 968.730030s 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3e406a1c0 0x7fb3e41cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3e406a1c0 0x7fb3e41cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58486/0 (socket says 172.21.15.28:58486) 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 -- 172.21.15.28:0/3781900842 learned_addr learned my addr 172.21.15.28:0/3781900842 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): get_auth_request con 0x7fb3e406a1c0 auth_method 0 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e409fc80 0x7fb3e41bc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): get_auth_request con 0x7fb3e409fc80 auth_method 0 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e409f480 0x7fb3e41bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): get_auth_request con 0x7fb3e409f480 auth_method 0 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.441 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient(hunting): handle_auth_done global_id 34272 payload 824 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 -- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e409fc80 msgr2=0x7fb3e41bc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7fb3e409fc80 0x7fb3e41bc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 -- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e409f480 msgr2=0x7fb3e41bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb3e409f480 0x7fb3e41bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 monclient: found mon.noname-a 2024-03-27T21:32:26.442 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 -- 172.21.15.28:0/3781900842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40094d0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3e37fe640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3e406a1c0 0x7fb3e41cb710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400e9e0 tx=0x7fb3d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3cbfff640 10 client.?.objecter ms_handle_connect 0x7fb3e406a1c0 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3cbfff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb3d400cde0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3cbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3cbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:26.443 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.423+0000 7fb3cbfff640 10 monclient: dump: 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.444 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.445 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4013470 con 0x7fb3e406a1c0 2024-03-27T21:32:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 5 monclient: authenticate success, global_id 34272 2024-03-27T21:32:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 monclient: _renew_subs 2024-03-27T21:32:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:26.446 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc009a70 con 0x7fb3e406a1c0 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb3d4013a50 con 0x7fb3e406a1c0 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 10 monclient: dump: 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.447 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.448 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 client.34272.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 monclient: _renew_subs 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:26.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e41bc670 con 0x7fb3e406a1c0 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 1 librados: init done 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e1ffb640 4 set_mon_vals no callback set 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 client.34272.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 15 client.34272.objecter _session_command_op_assign -1 1 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 20 client.34272.objecter _get_session osd=-1 returning homeless 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 client.34272.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fb3d4013bb0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.450 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb3e40a2410 con 0x7fb3e406a1c0 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.424+0000 7fb3cbfff640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb3d003a180 0x7fb3d003c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fb3d404a3e0 con 0x7fb3e406a1c0 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 10 client.34272.objecter ms_dispatch 0x7fb3e4000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 3 client.34272.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 3 client.34272.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 10 client.34272.objecter checking command 1 2024-03-27T21:32:26.451 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fb3d003ff90 0x7fb3d00423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 20 client.34272.objecter _get_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 15 client.34272.objecter _session_command_op_remove -1 1 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 20 client.34272.objecter _get_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 20 client.34272.objecter get_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 15 client.34272.objecter _session_command_op_assign 2 1 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 4 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 10 client.34272.objecter _send_command 1 2024-03-27T21:32:26.452 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 --> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3d0042a60 con 0x7fb3d003ff90 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 20 client.34272.objecter dump_active .. 0 homeless 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3d404c940 con 0x7fb3e406a1c0 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3e2ffd640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb3d003a180 0x7fb3d003c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3e2ffd640 10 monclient: get_auth_request con 0x7fb3d003a180 auth_method 0 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3e3fff640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fb3d003ff90 0x7fb3d00423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3e3fff640 10 monclient: get_auth_request con 0x7fb3d003ff90 auth_method 0 2024-03-27T21:32:26.453 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 10 client.34272.objecter ms_handle_connect 0x7fb3d003ff90 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3e3fff640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fb3d003ff90 0x7fb3d00423b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3cbfff640 10 client.34272.objecter ms_handle_connect 0x7fb3d003a180 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.425+0000 7fb3e2ffd640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb3d003a180 0x7fb3d003c640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009b40 tx=0x7fb3d8009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.426+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== osd.2 v2:172.21.15.28:6816/33280 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fb3d0042a60 con 0x7fb3d003ff90 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.426+0000 7fb3cbfff640 10 client.34272.objecter ms_dispatch 0x7fb3e4000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.426+0000 7fb3cbfff640 10 client.34272.objecter _finish_command 1 = system:0 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.426+0000 7fb3cbfff640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 4 2024-03-27T21:32:26.454 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.426+0000 7fb3cbfff640 15 client.34272.objecter _session_command_op_remove 2 1 2024-03-27T21:32:26.455 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 10 client.34272.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 15 client.34272.objecter _session_command_op_assign -1 2 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 20 client.34272.objecter _get_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 20 client.34272.objecter _get_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 15 client.34272.objecter _session_command_op_remove -1 2 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 20 client.34272.objecter get_session s=0x7fb3d003f8c0 osd=2 3 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 15 client.34272.objecter _session_command_op_assign 2 2 2024-03-27T21:32:26.456 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 4 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 10 client.34272.objecter _send_command 2 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 --> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb3e406bbd0 con 0x7fb3d003ff90 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3cbfff640 1 -- 172.21.15.28:0/3781900842 <== osd.2 v2:172.21.15.28:6816/33280 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb3dc003990 con 0x7fb3d003ff90 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3cbfff640 10 client.34272.objecter ms_dispatch 0x7fb3e4000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3cbfff640 10 client.34272.objecter _finish_command 2 = system:0 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3cbfff640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 4 2024-03-27T21:32:26.457 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.438+0000 7fb3cbfff640 15 client.34272.objecter _session_command_op_remove 2 2 2024-03-27T21:32:26.458 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:26.458 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T21:32:26.458 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:26.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 10 librados: watch_flush enter 2024-03-27T21:32:26.460 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 10 librados: watch_flush exit 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 10 client.34272.objecter close_session for osd.2 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fb3d003ff90 msgr2=0x7fb3d00423b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:6816/33280,v1:172.21.15.28:6817/33280] conn(0x7fb3d003ff90 0x7fb3d00423b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 20 client.34272.objecter put_session s=0x7fb3d003f8c0 osd=2 1 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 20 client.34272.objecter shutdown clearing up homeless session... 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 10 client.34272.objecter successfully canceled tick 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb3d003a180 msgr2=0x7fb3d003c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.461 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fb3d003a180 0x7fb3d003c640 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8009b40 tx=0x7fb3d8009190 comp rx=0 tx=0).stop 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 10 monclient: shutdown 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3e406a1c0 msgr2=0x7fb3e41cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 --2- 172.21.15.28:0/3781900842 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb3e406a1c0 0x7fb3e41cb710 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400e9e0 tx=0x7fb3d400eea0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e3fff640 1 -- 172.21.15.28:0/3781900842 reap_dead start 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 shutdown_connections 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 >> 172.21.15.28:0/3781900842 conn(0x7fb3e406ad90 msgr2=0x7fb3e40a5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.462 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 shutdown_connections 2024-03-27T21:32:26.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 -- 172.21.15.28:0/3781900842 wait complete. 2024-03-27T21:32:26.463 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.439+0000 7fb3e9b18640 1 librados: shutdown 2024-03-27T21:32:26.463 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-27T21:32:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.576+0000 7f7ece677640 10 monclient: get_monmap_and_config 2024-03-27T21:32:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.576+0000 7f7ece677640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.576+0000 7f7ece677640 10 monclient: monmap: 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:26.577362+0000 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:26.577362+0000 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.566 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.567 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.567 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:26.567 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:26.567 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 1 Processor -- start 2024-03-27T21:32:26.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 1 -- start start 2024-03-27T21:32:26.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient: init 2024-03-27T21:32:26.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.578 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient: _add_conns ranks=[0,3,1,4,6,2,7,10,9,8,5] 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7ec80a19b0 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7ec809dbb0 0x7f7ec8138c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient(hunting): picked mon.noname-g con 0x7f7ec809dbb0 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f7ec809e030 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec80618f0 con 0x7f7ec80a19b0 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec809f8d0 con 0x7f7ec809e030 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80a1d90 con 0x7f7ec809dbb0 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ece677640 10 monclient(hunting): authenticate will time out at 968.884503s 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ec7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7ec80a19b0 0x7f7ec809d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54400/0 (socket says 172.21.15.28:54400) 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.577+0000 7f7ec7fff640 1 -- 172.21.15.28:0/1424490324 learned_addr learned my addr 172.21.15.28:0/1424490324 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7ec809dbb0 0x7f7ec8138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): get_auth_request con 0x7f7ec809dbb0 auth_method 0 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212855826 0 0) 0x7f7ec80618f0 con 0x7f7ec80a19b0 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _negotiate 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): my global_id is 34281 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb0005730 con 0x7f7ec80a19b0 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.1 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124487002 0 0) 0x7f7ec809f8d0 con 0x7f7ec809e030 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _negotiate 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): my global_id is 4798 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec80618f0 con 0x7f7ec809e030 2024-03-27T21:32:26.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3099921071 0 0) 0x7f7eb0005730 con 0x7f7ec80a19b0 2024-03-27T21:32:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7ec809dbb0 msgr2=0x7f7ec8138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7ec809dbb0 0x7f7ec8138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 >> v1:172.21.15.63:6789/0 conn(0x7f7ec809e030 legacy=0x7f7ec813b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 monclient: found mon.noname-a-legacy 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.28:6789/0 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec806bbe0 con 0x7f7ec80a19b0 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ece677640 5 monclient: authenticate success, global_id 34281 2024-03-27T21:32:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (unknown 3833802671 0 0) 0x7f7eb80018e0 con 0x7f7ec80a19b0 2024-03-27T21:32:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ece677640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-03-27T21:32:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: dump: 2024-03-27T21:32:26.586 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.587 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.588 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.589 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] but i'm connected to v1:172.21.15.28:6789/0, reconnecting 2024-03-27T21:32:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 >> v1:172.21.15.28:6789/0 conn(0x7f7ec80a19b0 legacy=0x7f7ec809d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient: _add_conns ranks=[6,2,8,4,0,7,5,3,1] 2024-03-27T21:32:26.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7eb0006590 0x7f7eb00069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): picked mon.d con 0x7f7eb0006590 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7eb00070e0 0x7f7eb000bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): picked mon.b con 0x7f7eb00070e0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7eb000c0c0 0x7f7eb000e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): picked mon.e con 0x7f7eb000c0c0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:26.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec80a1d90 con 0x7f7eb00070e0 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb000eb80 con 0x7f7eb0006590 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb000ecf0 con 0x7f7eb000c0c0 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec6ffd640 10 monclient(hunting): _finish_auth 0 2024-03-27T21:32:26.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ece677640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f7ec809dbb0 0x7f7ec8138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7eb0006590 0x7f7eb00069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): get_auth_request con 0x7f7eb0006590 auth_method 0 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7eb000c0c0 0x7f7eb000e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): get_auth_request con 0x7f7eb000c0c0 auth_method 0 2024-03-27T21:32:26.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7eb00070e0 0x7f7eb000bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): get_auth_request con 0x7f7eb00070e0 auth_method 0 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:26.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient(hunting): handle_auth_done global_id 34281 payload 293 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 -- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7eb000c0c0 msgr2=0x7f7eb000e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7eb000c0c0 0x7f7eb000e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 -- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7eb00070e0 msgr2=0x7f7eb000bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7eb00070e0 0x7f7eb000bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 monclient: found mon.d 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 1 -- 172.21.15.28:0/1424490324 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0005730 con 0x7f7eb0006590 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7ec7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f7eb000c0c0 0x7f7eb000e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:26.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.578+0000 7f7eccc14640 1 -- 172.21.15.28:0/1424490324 reap_dead start 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7eb0006590 0x7f7eb00069d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007d60 tx=0x7f7eb0007a00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=dd322e889e5501fc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7eb8005e00 con 0x7f7eb0006590 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: dump: 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.597 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.598 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ece677640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8007070 con 0x7f7eb0006590 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ece677640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:26.599 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 1 -- 172.21.15.28:0/1424490324 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7eb8007650 con 0x7f7eb0006590 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ece677640 4 set_mon_vals no callback set 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.579+0000 7f7ec6ffd640 10 monclient: dump: 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.600 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.601 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.601 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.601 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.601 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.601 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.601 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.602 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 10 monclient: shutdown 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 -- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7eb0006590 msgr2=0x7f7eb00069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7eb0006590 0x7f7eb00069d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8007d60 tx=0x7f7eb0007a00 comp rx=0 tx=0).stop 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 -- 172.21.15.28:0/1424490324 shutdown_connections 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 --2- 172.21.15.28:0/1424490324 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f7eb0006590 0x7f7eb00069d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 -- 172.21.15.28:0/1424490324 >> 172.21.15.28:0/1424490324 conn(0x7f7ec806ad90 msgr2=0x7f7ec806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 -- 172.21.15.28:0/1424490324 shutdown_connections 2024-03-27T21:32:26.603 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 1 -- 172.21.15.28:0/1424490324 wait complete. 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.580+0000 7f7ece677640 10 monclient: monmap: 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.604 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.605 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 librados: starting msgr at 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 librados: starting objecter 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 Processor -- start 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 -- start start 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 librados: setting wanted keys 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 librados: calling monclient init 2024-03-27T21:32:26.606 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient: init 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient: _add_conns ranks=[7,4,2,0,8,5,6,1,3] 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7ec8133ac0 0x7f7ec81c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): picked mon.noname-i con 0x7f7ec8133ac0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ec8133ea0 0x7f7ec811d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): picked mon.noname-c con 0x7f7ec8133ea0 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 0x7f7ec811da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): picked mon.noname-b con 0x7f7ec81342a0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:26.607 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec811fc80 con 0x7f7ec81342a0 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec809e8e0 con 0x7f7ec8133ea0 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec809e520 con 0x7f7ec8133ac0 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.581+0000 7f7ece677640 10 monclient(hunting): authenticate will time out at 968.888619s 2024-03-27T21:32:26.608 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 0x7f7ec811da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ec8133ea0 0x7f7ec811d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 0x7f7ec811da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38556/0 (socket says 172.21.15.28:38556) 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 -- 172.21.15.28:0/873721093 learned_addr learned my addr 172.21.15.28:0/873721093 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): get_auth_request con 0x7f7ec81342a0 auth_method 0 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.609 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): get_auth_request con 0x7f7ec8133ea0 auth_method 0 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.610 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7ec8133ac0 0x7f7ec81c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec7fff640 10 monclient(hunting): get_auth_request con 0x7f7ec8133ac0 auth_method 0 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient(hunting): handle_auth_done global_id 4682 payload 824 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 -- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7ec8133ac0 msgr2=0x7f7ec81c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.611 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7ec8133ac0 0x7f7ec81c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 -- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ec8133ea0 msgr2=0x7f7ec811d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ec8133ea0 0x7f7ec811d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 monclient: found mon.noname-b 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:26.612 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 -- 172.21.15.28:0/873721093 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec81211a0 con 0x7f7ec81342a0 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7eccc14640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 0x7f7ec811da10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ec809e7e0 tx=0x7f7ec000d520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 client.?.objecter ms_handle_connect 0x7f7ec81342a0 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7ec0003970 con 0x7f7ec81342a0 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: dump: 2024-03-27T21:32:26.613 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.614 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.615 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 5 monclient: authenticate success, global_id 4682 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0003af0 con 0x7f7ec81342a0 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7ec0003c60 con 0x7f7ec81342a0 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 10 monclient: _renew_subs 2024-03-27T21:32:26.616 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec811fa00 con 0x7f7ec81342a0 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec67fc640 4 set_mon_vals no callback set 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 10 client.4682.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ec4ff9640 10 monclient: dump: 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.617 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.618 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 10 monclient: _renew_subs 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec811df50 con 0x7f7ec81342a0 2024-03-27T21:32:26.619 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.582+0000 7f7ece677640 1 librados: init done 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mon.2 v2:172.21.15.28:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f7ec000db20 con 0x7f7ec81342a0 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7eb403a250 0x7f7eb403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ece677640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ece677640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ece677640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.28:3301/0 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec80a50e0 con 0x7f7ec81342a0 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mon.2 v2:172.21.15.28:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f7ec004a190 con 0x7f7ec81342a0 2024-03-27T21:32:26.620 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 10 client.4682.objecter ms_dispatch 0x7f7ec8000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:26.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 3 client.4682.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:26.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 3 client.4682.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:26.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.583+0000 7f7ec4ff9640 20 client.4682.objecter dump_active .. 0 homeless 2024-03-27T21:32:26.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.584+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7eb403a250 0x7f7eb403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.584+0000 7f7ec7fff640 10 monclient: get_auth_request con 0x7f7eb403a250 auth_method 0 2024-03-27T21:32:26.621 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.584+0000 7f7ec4ff9640 10 client.4682.objecter ms_handle_connect 0x7f7eb403a250 2024-03-27T21:32:26.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.584+0000 7f7ec7fff640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7eb403a250 0x7f7eb403c710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8001eb0 tx=0x7f7eb8007000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.588+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mon.2 v2:172.21.15.28:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7ec0001be0 con 0x7f7ec81342a0 2024-03-27T21:32:26.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.588+0000 7f7ec4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.588+0000 7f7ec4ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:26.758 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.770+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ec809f5f0 con 0x7f7eb403a250 2024-03-27T21:32:26.759 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.771+0000 7f7ec4ff9640 1 -- 172.21.15.28:0/873721093 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7eb8005990 con 0x7f7eb403a250 2024-03-27T21:32:26.759 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 2 to deep-scrub 2024-03-27T21:32:26.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.772+0000 7f7ece677640 10 librados: watch_flush enter 2024-03-27T21:32:26.761 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.772+0000 7f7ece677640 10 librados: watch_flush exit 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 20 client.4682.objecter shutdown clearing up homeless session... 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 10 client.4682.objecter successfully canceled tick 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7eb403a250 msgr2=0x7f7eb403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7eb403a250 0x7f7eb403c710 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8001eb0 tx=0x7f7eb8007000 comp rx=0 tx=0).stop 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 10 monclient: shutdown 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 msgr2=0x7f7ec811da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.762 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 0x7f7ec811da10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7ec809e7e0 tx=0x7f7ec000d520 comp rx=0 tx=0).stop 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 shutdown_connections 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f7eb403a250 0x7f7eb403c710 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f7ec81342a0 0x7f7ec811da10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7ec8133ea0 0x7f7ec811d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 --2- 172.21.15.28:0/873721093 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7ec8133ac0 0x7f7ec81c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 >> 172.21.15.28:0/873721093 conn(0x7f7ec806ad90 msgr2=0x7f7ec80a3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.763 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 shutdown_connections 2024-03-27T21:32:26.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 -- 172.21.15.28:0/873721093 wait complete. 2024-03-27T21:32:26.764 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.773+0000 7f7ece677640 1 librados: shutdown 2024-03-27T21:32:26.772 INFO:tasks.ceph:Scrubbing osd.3 2024-03-27T21:32:26.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-27T21:32:26.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.889+0000 7f0aa682f640 10 monclient: get_monmap_and_config 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.889+0000 7f0aa682f640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.889+0000 7f0aa682f640 10 monclient: monmap: 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:26.890288+0000 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:26.890288+0000 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.878 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.879 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:26.880 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:26.880 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 Processor -- start 2024-03-27T21:32:26.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 -- start start 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient: init 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient: _add_conns ranks=[6,7,10,5,1,2,4,9,0,3,8] 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 0x7f0aa01370b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): picked mon.noname-d con 0x7f0aa0133b20 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0aa006bcd0 0x7f0aa0133f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): picked mon.noname-i con 0x7f0aa006bcd0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:26.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0aa00a2a30 0x7f0aa00a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): picked mon.noname-f con 0x7f0aa00a2a30 addr v2:172.21.15.63:3300/0 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa006c250 con 0x7f0aa00a2a30 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa006c730 con 0x7f0aa0133b20 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa01375f0 con 0x7f0aa006bcd0 2024-03-27T21:32:26.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa682f640 10 monclient(hunting): authenticate will time out at 969.197422s 2024-03-27T21:32:26.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 0x7f0aa01370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 0x7f0aa01370b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45172/0 (socket says 172.21.15.28:45172) 2024-03-27T21:32:26.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 1 -- 172.21.15.28:0/3200197156 learned_addr learned my addr 172.21.15.28:0/3200197156 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:26.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): get_auth_request con 0x7f0aa0133b20 auth_method 0 2024-03-27T21:32:26.892 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0a9f7fe640 1 --2- 172.21.15.28:0/3200197156 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0aa006bcd0 0x7f0aa0133f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.890+0000 7f0aa4dcc640 1 --2- 172.21.15.28:0/3200197156 >> v2:172.21.15.63:3300/0 conn(0x7f0aa00a2a30 0x7f0aa00a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.893 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9f7fe640 10 monclient(hunting): get_auth_request con 0x7f0aa006bcd0 auth_method 0 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0aa4dcc640 10 monclient(hunting): get_auth_request con 0x7f0aa00a2a30 auth_method 0 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0aa4dcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0aa4dcc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.894 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0aa4dcc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_done global_id 4596 payload 274 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 -- 172.21.15.28:0/3200197156 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0aa006bcd0 msgr2=0x7f0aa0133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 --2- 172.21.15.28:0/3200197156 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0aa006bcd0 0x7f0aa0133f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 -- 172.21.15.28:0/3200197156 >> v2:172.21.15.63:3300/0 conn(0x7f0aa00a2a30 msgr2=0x7f0aa00a2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 --2- 172.21.15.28:0/3200197156 >> v2:172.21.15.63:3300/0 conn(0x7f0aa00a2a30 0x7f0aa00a2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 monclient: found mon.noname-d 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 -- 172.21.15.28:0/3200197156 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00618f0 con 0x7f0aa0133b20 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9ffff640 1 --2- 172.21.15.28:0/3200197156 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 0x7f0aa01370b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009870 tx=0x7f0a9002b7c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=4427ad510129d8ec server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9effd640 1 -- 172.21.15.28:0/3200197156 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a90031990 con 0x7f0aa0133b20 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.891+0000 7f0a9effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: dump: 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.896 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.897 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 5 monclient: authenticate success, global_id 4596 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 1 -- 172.21.15.28:0/3200197156 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90031b10 con 0x7f0aa0133b20 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 1 -- 172.21.15.28:0/3200197156 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a90031cc0 con 0x7f0aa0133b20 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 4 set_mon_vals no callback set 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.899 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0a9effd640 10 monclient: dump: 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.900 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.901 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 10 monclient: shutdown 2024-03-27T21:32:26.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 -- 172.21.15.28:0/3200197156 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 msgr2=0x7f0aa01370b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 --2- 172.21.15.28:0/3200197156 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 0x7f0aa01370b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a90009870 tx=0x7f0a9002b7c0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 -- 172.21.15.28:0/3200197156 shutdown_connections 2024-03-27T21:32:26.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 --2- 172.21.15.28:0/3200197156 >> v2:172.21.15.63:3300/0 conn(0x7f0aa00a2a30 0x7f0aa00a2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 --2- 172.21.15.28:0/3200197156 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0aa006bcd0 0x7f0aa0133f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 --2- 172.21.15.28:0/3200197156 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa0133b20 0x7f0aa01370b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 -- 172.21.15.28:0/3200197156 >> 172.21.15.28:0/3200197156 conn(0x7f0aa00a7870 msgr2=0x7f0aa00a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 -- 172.21.15.28:0/3200197156 shutdown_connections 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.892+0000 7f0aa682f640 1 -- 172.21.15.28:0/3200197156 wait complete. 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 10 monclient: build_initial_monmap 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 10 monclient: monmap: 2024-03-27T21:32:26.903 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:26.904 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 1 librados: starting msgr at 2024-03-27T21:32:26.905 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 1 librados: starting objecter 2024-03-27T21:32:26.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 1 Processor -- start 2024-03-27T21:32:26.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 1 -- start start 2024-03-27T21:32:26.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 1 librados: setting wanted keys 2024-03-27T21:32:26.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 1 librados: calling monclient init 2024-03-27T21:32:26.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.893+0000 7f0aa682f640 10 monclient: init 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient: _add_conns ranks=[2,6,0,1,8,5,4,3,7] 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0aa006bcd0 0x7f0aa00a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): picked mon.noname-b con 0x7f0aa006bcd0 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa00a2a30 0x7f0aa0132c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): picked mon.noname-d con 0x7f0aa00a2a30 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:26.907 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa0133b20 0x7f0aa0133150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): picked mon.noname-a con 0x7f0aa0133b20 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa011fd30 con 0x7f0aa0133b20 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0133690 con 0x7f0aa006bcd0 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa006c400 con 0x7f0aa00a2a30 2024-03-27T21:32:26.908 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient(hunting): authenticate will time out at 969.200829s 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa00a2a30 0x7f0aa0132c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0aa006bcd0 0x7f0aa00a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa0133b20 0x7f0aa0133150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa00a2a30 0x7f0aa0132c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45182/0 (socket says 172.21.15.28:45182) 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 -- 172.21.15.28:0/1793901481 learned_addr learned my addr 172.21.15.28:0/1793901481 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): get_auth_request con 0x7f0aa00a2a30 auth_method 0 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.909 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): get_auth_request con 0x7f0aa006bcd0 auth_method 0 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): get_auth_request con 0x7f0aa0133b20 auth_method 0 2024-03-27T21:32:26.910 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.911 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:26.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:26.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:26.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient(hunting): handle_auth_done global_id 4605 payload 824 2024-03-27T21:32:26.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 -- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0aa006bcd0 msgr2=0x7f0aa00a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.912 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0aa006bcd0 0x7f0aa00a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 -- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa0133b20 msgr2=0x7f0aa0133150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa0133b20 0x7f0aa0133150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 monclient: found mon.noname-d 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 -- 172.21.15.28:0/1793901481 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900094d0 con 0x7f0aa00a2a30 2024-03-27T21:32:26.913 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9ffff640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0aa006bcd0 0x7f0aa00a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa4dcc640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa0133b20 0x7f0aa0133150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9f7fe640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa00a2a30 0x7f0aa0132c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d7d0 tx=0x7f0a9400dc90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 client.?.objecter ms_handle_connect 0x7f0aa00a2a30 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a940044a0 con 0x7f0aa00a2a30 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: dump: 2024-03-27T21:32:26.914 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.915 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: _finish_auth 0 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: _check_auth_tickets 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 5 monclient: authenticate success, global_id 4605 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9400b6c0 con 0x7f0aa00a2a30 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient: _renew_subs 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa006c950 con 0x7f0aa00a2a30 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:26.917 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a9400bca0 con 0x7f0aa00a2a30 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9e7fc640 4 set_mon_vals no callback set 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0a9cff9640 10 monclient: dump: 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:26.918 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:26.919 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.894+0000 7f0aa682f640 10 monclient: _renew_subs 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa00a0fd0 con 0x7f0aa00a2a30 2024-03-27T21:32:26.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 1 librados: init done 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 10 client.4605.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 15 client.4605.objecter _session_command_op_assign -1 1 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 20 client.4605.objecter _get_session osd=-1 returning homeless 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0aa00a4610 con 0x7f0aa00a2a30 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f0a9400b830 con 0x7f0aa00a2a30 2024-03-27T21:32:26.921 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0a9cff9640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a8c03a250 0x7f0a8c03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f0a9404a360 con 0x7f0aa00a2a30 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0a9cff9640 10 client.4605.objecter ms_dispatch 0x7f0aa0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0a9cff9640 3 client.4605.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.895+0000 7f0a9cff9640 3 client.4605.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 10 client.4605.objecter checking command 1 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7f0a8c040060 0x7f0a8c042480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 20 client.4605.objecter _get_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 15 client.4605.objecter _session_command_op_remove -1 1 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 20 client.4605.objecter _get_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 20 client.4605.objecter get_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 15 client.4605.objecter _session_command_op_assign 3 1 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 4 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 10 client.4605.objecter _send_command 1 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 --> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a8c042b30 con 0x7f0a8c040060 2024-03-27T21:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 20 client.4605.objecter dump_active .. 0 homeless 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a9404c9f0 con 0x7f0aa00a2a30 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9ffff640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a8c03a250 0x7f0a8c03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9ffff640 10 monclient: get_auth_request con 0x7f0a8c03a250 auth_method 0 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0aa4dcc640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7f0a8c040060 0x7f0a8c042480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0aa4dcc640 10 monclient: get_auth_request con 0x7f0a8c040060 auth_method 0 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 10 client.4605.objecter ms_handle_connect 0x7f0a8c040060 2024-03-27T21:32:26.924 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0aa4dcc640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7f0a8c040060 0x7f0a8c042480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9cff9640 10 client.4605.objecter ms_handle_connect 0x7f0a8c03a250 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.896+0000 7f0a9ffff640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a8c03a250 0x7f0a8c03c710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a90035000 tx=0x7f0a90030000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.897+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== osd.3 v2:172.21.15.63:6802/33504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f0a8c042b30 con 0x7f0a8c040060 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.897+0000 7f0a9cff9640 10 client.4605.objecter ms_dispatch 0x7f0aa0000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.897+0000 7f0a9cff9640 10 client.4605.objecter _finish_command 1 = system:0 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.897+0000 7f0a9cff9640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 4 2024-03-27T21:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.897+0000 7f0a9cff9640 15 client.4605.objecter _session_command_op_remove 3 1 2024-03-27T21:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 10 client.4605.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-03-27T21:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 15 client.4605.objecter _session_command_op_assign -1 2 2024-03-27T21:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 20 client.4605.objecter _get_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 20 client.4605.objecter _get_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 15 client.4605.objecter _session_command_op_remove -1 2 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 20 client.4605.objecter get_session s=0x7f0a8c03f990 osd=3 3 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 15 client.4605.objecter _session_command_op_assign 3 2 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 4 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 10 client.4605.objecter _send_command 2 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.909+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 --> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0aa0120250 con 0x7f0a8c040060 2024-03-27T21:32:26.927 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.910+0000 7f0a9cff9640 1 -- 172.21.15.28:0/1793901481 <== osd.3 v2:172.21.15.63:6802/33504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0a98007820 con 0x7f0a8c040060 2024-03-27T21:32:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.910+0000 7f0a9cff9640 10 client.4605.objecter ms_dispatch 0x7f0aa0000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:32:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.910+0000 7f0a9cff9640 10 client.4605.objecter _finish_command 2 = system:0 2024-03-27T21:32:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.910+0000 7f0a9cff9640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 4 2024-03-27T21:32:26.928 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.910+0000 7f0a9cff9640 15 client.4605.objecter _session_command_op_remove 3 2 2024-03-27T21:32:26.928 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:26.928 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T21:32:26.929 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:26.930 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 10 librados: watch_flush enter 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 10 librados: watch_flush exit 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 10 client.4605.objecter close_session for osd.3 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7f0a8c040060 msgr2=0x7f0a8c042480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6802/33504,v1:172.21.15.63:6805/33504] conn(0x7f0a8c040060 0x7f0a8c042480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 20 client.4605.objecter put_session s=0x7f0a8c03f990 osd=3 1 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 20 client.4605.objecter shutdown clearing up homeless session... 2024-03-27T21:32:26.931 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 10 client.4605.objecter successfully canceled tick 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a8c03a250 msgr2=0x7f0a8c03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a8c03a250 0x7f0a8c03c710 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a90035000 tx=0x7f0a90030000 comp rx=0 tx=0).stop 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 10 monclient: shutdown 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa00a2a30 msgr2=0x7f0aa0132c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 --2- 172.21.15.28:0/1793901481 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f0aa00a2a30 0x7f0aa0132c10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d7d0 tx=0x7f0a9400dc90 comp rx=0 tx=0).stop 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa4dcc640 1 -- 172.21.15.28:0/1793901481 reap_dead start 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 shutdown_connections 2024-03-27T21:32:26.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 >> 172.21.15.28:0/1793901481 conn(0x7f0aa00a7870 msgr2=0x7f0aa00662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:26.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 shutdown_connections 2024-03-27T21:32:26.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 -- 172.21.15.28:0/1793901481 wait complete. 2024-03-27T21:32:26.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:26.911+0000 7f0aa682f640 1 librados: shutdown 2024-03-27T21:32:26.933 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-27T21:32:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.046+0000 7f799cc99640 10 monclient: get_monmap_and_config 2024-03-27T21:32:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.046+0000 7f799cc99640 10 monclient: build_initial_monmap 2024-03-27T21:32:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.046+0000 7f799cc99640 10 monclient: monmap: 2024-03-27T21:32:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.043 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:27.046815+0000 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:27.046815+0000 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:27.044 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.046+0000 7f799cc99640 1 Processor -- start 2024-03-27T21:32:27.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.046+0000 7f799cc99640 1 -- start start 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.046+0000 7f799cc99640 10 monclient: init 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient: _add_conns ranks=[0,10,7,3,6,8,1,4,2,5,9] 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f7998069c80 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7998071560 0x7f799813be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): picked mon.noname-f con 0x7f7998071560 addr v2:172.21.15.63:3300/0 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f799813c370 0x7f799813e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): picked mon.noname-i con 0x7f799813c370 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79980618f0 con 0x7f7998069c80 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799809ece0 con 0x7f7998071560 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f799809eb30 con 0x7f799813c370 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799cc99640 10 monclient(hunting): authenticate will time out at 969.353809s 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7998069c80 0x7f7998070e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54412/0 (socket says 172.21.15.28:54412) 2024-03-27T21:32:27.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f799659c640 1 -- 172.21.15.28:0/1892603123 learned_addr learned my addr 172.21.15.28:0/1892603123 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 1 --2- 172.21.15.28:0/1892603123 >> v2:172.21.15.63:3300/0 conn(0x7f7998071560 0x7f799813be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 1 --2- 172.21.15.28:0/1892603123 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f799813c370 0x7f799813e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): get_auth_request con 0x7f799813c370 auth_method 0 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): get_auth_request con 0x7f7998071560 auth_method 0 2024-03-27T21:32:27.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7995d9b640 1 -- 172.21.15.28:0/1892603123 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2555897427 0 0) 0x7f79980618f0 con 0x7f7998069c80 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7995d9b640 10 monclient(hunting): _negotiate 2024-03-27T21:32:27.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7995d9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7995d9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7995d9b640 10 monclient(hunting): my global_id is 34299 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7995d9b640 1 -- 172.21.15.28:0/1892603123 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7984003520 con 0x7f7998069c80 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f798dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient(hunting): handle_auth_done global_id 4669 payload 274 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 1 -- 172.21.15.28:0/1892603123 >> v2:172.21.15.63:3300/0 conn(0x7f7998071560 msgr2=0x7f799813be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:27.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 1 --2- 172.21.15.28:0/1892603123 >> v2:172.21.15.63:3300/0 conn(0x7f7998071560 0x7f799813be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 1 -- 172.21.15.28:0/1892603123 >> v1:172.21.15.28:6789/0 conn(0x7f7998069c80 legacy=0x7f7998070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 1 monclient: found mon.noname-i 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.047+0000 7f7996d9d640 1 -- 172.21.15.28:0/1892603123 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799806a090 con 0x7f799813c370 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7996d9d640 1 --2- 172.21.15.28:0/1892603123 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f799813c370 0x7f799813e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7990009d90 tx=0x7f799002bd80 comp rx=0 tx=0).ready entity=mon.7 client_cookie=4f305a56223576af server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 1 -- 172.21.15.28:0/1892603123 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f799002cda0 con 0x7f799813c370 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: dump: 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.052 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.053 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: _finish_auth 0 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: _check_auth_tickets 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f799cc99640 5 monclient: authenticate success, global_id 4669 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 1 -- 172.21.15.28:0/1892603123 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990032340 con 0x7f799813c370 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f799cc99640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:27.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f799cc99640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 1 -- 172.21.15.28:0/1892603123 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7990032960 con 0x7f799813c370 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f799cc99640 4 set_mon_vals no callback set 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.048+0000 7f7995d9b640 10 monclient: dump: 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.055 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.056 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 10 monclient: shutdown 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 -- 172.21.15.28:0/1892603123 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f799813c370 msgr2=0x7f799813e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 --2- 172.21.15.28:0/1892603123 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f799813c370 0x7f799813e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7990009d90 tx=0x7f799002bd80 comp rx=0 tx=0).stop 2024-03-27T21:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 -- 172.21.15.28:0/1892603123 shutdown_connections 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 --2- 172.21.15.28:0/1892603123 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f799813c370 0x7f799813e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 --2- 172.21.15.28:0/1892603123 >> v2:172.21.15.63:3300/0 conn(0x7f7998071560 0x7f799813be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 -- 172.21.15.28:0/1892603123 >> 172.21.15.28:0/1892603123 conn(0x7f799806a510 msgr2=0x7f799806a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 -- 172.21.15.28:0/1892603123 shutdown_connections 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 1 -- 172.21.15.28:0/1892603123 wait complete. 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 10 monclient: build_initial_monmap 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.049+0000 7f799cc99640 10 monclient: monmap: 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 librados: starting msgr at 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 librados: starting objecter 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 Processor -- start 2024-03-27T21:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 -- start start 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 librados: setting wanted keys 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 librados: calling monclient init 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient: init 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient: _add_conns ranks=[4,7,6,8,2,3,0,5,1] 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7998069c80 0x7f799812cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): picked mon.noname-c con 0x7f7998069c80 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7998071560 0x7f7998127ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): picked mon.noname-i con 0x7f7998071560 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 0x7f7998128430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): picked mon.noname-d con 0x7f799813c370 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7998133180 con 0x7f7998069c80 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f7998132260 con 0x7f799813c370 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f79981339c0 con 0x7f7998071560 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799cc99640 10 monclient(hunting): authenticate will time out at 969.357516s 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 0x7f7998128430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 0x7f7998128430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45192/0 (socket says 172.21.15.28:45192) 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799659c640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7998069c80 0x7f799812cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 1 -- 172.21.15.28:0/4216082912 learned_addr learned my addr 172.21.15.28:0/4216082912 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 10 monclient(hunting): get_auth_request con 0x7f799813c370 auth_method 0 2024-03-27T21:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f7996d9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799659c640 10 monclient(hunting): get_auth_request con 0x7f7998069c80 auth_method 0 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799659c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.050+0000 7f799659c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798dd9b640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7998071560 0x7f7998127ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798dd9b640 10 monclient(hunting): get_auth_request con 0x7f7998071560 auth_method 0 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798dd9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 10 monclient(hunting): handle_auth_done global_id 4614 payload 824 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 -- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7998071560 msgr2=0x7f7998127ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7998071560 0x7f7998127ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 -- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7998069c80 msgr2=0x7f799812cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7998069c80 0x7f799812cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 monclient: found mon.noname-d 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 -- 172.21.15.28:0/4216082912 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990009a70 con 0x7f799813c370 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799659c640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7998069c80 0x7f799812cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798dd9b640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7998071560 0x7f7998127ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f7996d9d640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 0x7f7998128430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7990037040 tx=0x7f7990004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 client.?.objecter ms_handle_connect 0x7f799813c370 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f799002cdb0 con 0x7f799813c370 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: dump: 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: _finish_auth 0 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: _check_auth_tickets 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990009450 con 0x7f799813c370 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 5 monclient: authenticate success, global_id 4614 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 10 monclient: _renew_subs 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7998133ca0 con 0x7f799813c370 2024-03-27T21:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f79900046c0 con 0x7f799813c370 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 10 client.4614.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799559a640 4 set_mon_vals no callback set 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f798f7fe640 10 monclient: dump: 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 10 monclient: _renew_subs 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799812da20 con 0x7f799813c370 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.051+0000 7f799cc99640 1 librados: init done 2024-03-27T21:32:27.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f7990004250 con 0x7f799813c370 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f799cc99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f797803a250 0x7f797803c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f799cc99640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f799cc99640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7998074b30 con 0x7f799813c370 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f799006c9d0 con 0x7f799813c370 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 10 client.4614.objecter ms_dispatch 0x7f7998000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:27.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 3 client.4614.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:27.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 3 client.4614.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:27.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f798f7fe640 20 client.4614.objecter dump_active .. 0 homeless 2024-03-27T21:32:27.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f799659c640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f797803a250 0x7f797803c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.052+0000 7f799659c640 10 monclient: get_auth_request con 0x7f797803a250 auth_method 0 2024-03-27T21:32:27.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.053+0000 7f799659c640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f797803a250 0x7f797803c710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7988005880 tx=0x7f7988009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.053+0000 7f798f7fe640 10 client.4614.objecter ms_handle_connect 0x7f797803a250 2024-03-27T21:32:27.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.058+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f7990044020 con 0x7f799813c370 2024-03-27T21:32:27.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.058+0000 7f798f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.058+0000 7f798f7fe640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:27.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.235+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f799809f810 con 0x7f797803a250 2024-03-27T21:32:27.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.236+0000 7f798f7fe640 1 -- 172.21.15.28:0/4216082912 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7988001800 con 0x7f797803a250 2024-03-27T21:32:27.226 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 3 to deep-scrub 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 10 librados: watch_flush enter 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 10 librados: watch_flush exit 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 20 client.4614.objecter shutdown clearing up homeless session... 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 10 client.4614.objecter successfully canceled tick 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f797803a250 msgr2=0x7f797803c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f797803a250 0x7f797803c710 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7988005880 tx=0x7f7988009040 comp rx=0 tx=0).stop 2024-03-27T21:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 10 monclient: shutdown 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 msgr2=0x7f7998128430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 0x7f7998128430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7990037040 tx=0x7f7990004a40 comp rx=0 tx=0).stop 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 shutdown_connections 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f797803a250 0x7f797803c710 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f799813c370 0x7f7998128430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f7998071560 0x7f7998127ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 --2- 172.21.15.28:0/4216082912 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f7998069c80 0x7f799812cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.238+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 >> 172.21.15.28:0/4216082912 conn(0x7f799806a510 msgr2=0x7f79980a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:27.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.239+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 shutdown_connections 2024-03-27T21:32:27.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.239+0000 7f799cc99640 1 -- 172.21.15.28:0/4216082912 wait complete. 2024-03-27T21:32:27.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.239+0000 7f799cc99640 1 librados: shutdown 2024-03-27T21:32:27.238 INFO:tasks.ceph:Scrubbing osd.4 2024-03-27T21:32:27.238 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-27T21:32:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.360+0000 7fead8270640 10 monclient: get_monmap_and_config 2024-03-27T21:32:27.349 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.360+0000 7fead8270640 10 monclient: build_initial_monmap 2024-03-27T21:32:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.360+0000 7fead8270640 10 monclient: monmap: 2024-03-27T21:32:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:27.361371+0000 2024-03-27T21:32:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:27.361371+0000 2024-03-27T21:32:27.350 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:27.351 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.352 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 Processor -- start 2024-03-27T21:32:27.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 -- start start 2024-03-27T21:32:27.353 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient: init 2024-03-27T21:32:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient: _add_conns ranks=[5,3,7,2,6,1,4,10,0,9,8] 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 0x7fead01370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): picked mon.noname-h con 0x7fead0136d00 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fead00a3d70 0x7fead0137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): picked mon.noname-g con 0x7fead00a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead01339e0 0x7fead0133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.365 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): picked mon.noname-i con 0x7fead01339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00a25b0 con 0x7fead00a3d70 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fead0137b60 con 0x7fead0136d00 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fead00a13f0 con 0x7fead01339e0 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.366 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.361+0000 7fead8270640 10 monclient(hunting): authenticate will time out at 969.668516s 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 0x7fead01370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead01339e0 0x7fead0133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fead00a3d70 0x7fead0137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 0x7fead01370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.28:42288/0 (socket says 172.21.15.28:42288) 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead01339e0 0x7fead0133e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3303/0 says I am v2:172.21.15.28:49120/0 (socket says 172.21.15.28:49120) 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 -- 172.21.15.28:0/3622003019 learned_addr learned my addr 172.21.15.28:0/3622003019 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): get_auth_request con 0x7fead0136d00 auth_method 0 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): get_auth_request con 0x7fead00a3d70 auth_method 0 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.368 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): get_auth_request con 0x7fead01339e0 auth_method 0 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.369 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead580b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead680d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient(hunting): handle_auth_done global_id 4586 payload 274 2024-03-27T21:32:27.370 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 -- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead01339e0 msgr2=0x7fead0133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead01339e0 0x7fead0133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 -- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fead00a3d70 msgr2=0x7fead0137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fead00a3d70 0x7fead0137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 monclient: found mon.noname-h 2024-03-27T21:32:27.371 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 10 monclient: _send_mon_message to mon.noname-h at v2:172.21.15.63:3302/0 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.362+0000 7fead600c640 1 -- 172.21.15.28:0/3622003019 --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00618f0 con 0x7fead0136d00 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead600c640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 0x7fead01370e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feacc0098a0 tx=0x7feacc02b7a0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=ae3e8549dc4a2550 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 1 -- 172.21.15.28:0/3622003019 <== mon.5 v2:172.21.15.63:3302/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7feacc02f050 con 0x7fead0136d00 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-03-27T21:32:27.372 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: dump: 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.373 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.374 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: _finish_auth 0 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: _check_auth_tickets 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 1 -- 172.21.15.28:0/3622003019 <== mon.5 v2:172.21.15.63:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc031970 con 0x7fead0136d00 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:27.375 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 1 -- 172.21.15.28:0/3622003019 <== mon.5 v2:172.21.15.63:3302/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7feacc032390 con 0x7fead0136d00 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 5 monclient: authenticate success, global_id 4586 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 4 set_mon_vals no callback set 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead500a640 10 monclient: dump: 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.376 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.377 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.378 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 10 monclient: shutdown 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 1 -- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 msgr2=0x7fead01370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.363+0000 7fead8270640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 0x7fead01370e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feacc0098a0 tx=0x7feacc02b7a0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 -- 172.21.15.28:0/3622003019 shutdown_connections 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead01339e0 0x7fead0133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7fead00a3d70 0x7fead0137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 --2- 172.21.15.28:0/3622003019 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead0136d00 0x7fead01370e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 -- 172.21.15.28:0/3622003019 >> 172.21.15.28:0/3622003019 conn(0x7fead00a9430 msgr2=0x7fead00a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 -- 172.21.15.28:0/3622003019 shutdown_connections 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 -- 172.21.15.28:0/3622003019 wait complete. 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 10 monclient: build_initial_monmap 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 10 monclient: monmap: 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:27.380 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:27.381 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 librados: starting msgr at 2024-03-27T21:32:27.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.364+0000 7fead8270640 1 librados: starting objecter 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 Processor -- start 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 -- start start 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 librados: setting wanted keys 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 librados: calling monclient init 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient: init 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient: _add_conns ranks=[5,1,7,2,6,0,4,3,8] 2024-03-27T21:32:27.383 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead00a3d70 0x7fead01cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): picked mon.noname-h con 0x7fead00a3d70 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fead01339e0 0x7fead0132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): picked mon.noname-f con 0x7fead01339e0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead0136d00 0x7fead0133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): picked mon.noname-i con 0x7fead0136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead01202b0 con 0x7fead01339e0 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.384 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fead01cb830 con 0x7fead00a3d70 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fead00a16a0 con 0x7fead0136d00 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead8270640 10 monclient(hunting): authenticate will time out at 969.672249s 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fead01339e0 0x7fead0132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead0136d00 0x7fead0133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead00a3d70 0x7fead01cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fead01339e0 0x7fead0132bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.28:40532/0 (socket says 172.21.15.28:40532) 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 1 -- 172.21.15.28:0/1876129346 learned_addr learned my addr 172.21.15.28:0/1876129346 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): get_auth_request con 0x7fead01339e0 auth_method 0 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): get_auth_request con 0x7fead0136d00 auth_method 0 2024-03-27T21:32:27.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): get_auth_request con 0x7fead00a3d70 auth_method 0 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead580b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead600c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.365+0000 7fead680d640 10 monclient(hunting): handle_auth_done global_id 4696 payload 824 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 -- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead00a3d70 msgr2=0x7fead01cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7fead00a3d70 0x7fead01cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 -- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fead01339e0 msgr2=0x7fead0132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fead01339e0 0x7fead0132bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 monclient: found mon.noname-i 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 -- 172.21.15.28:0/1876129346 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0094d0 con 0x7fead0136d00 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead680d640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead0136d00 0x7fead0133110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feac800efc0 tx=0x7feac800c490 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 client.?.objecter ms_handle_connect 0x7fead0136d00 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7feac8009b10 con 0x7fead0136d00 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:32:27.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: dump: 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.391 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 5 monclient: authenticate success, global_id 4696 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac800f040 con 0x7fead0136d00 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 10 monclient: _renew_subs 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:32:27.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead011ffd0 con 0x7fead0136d00 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7feac8014d60 con 0x7fead0136d00 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead4809640 4 set_mon_vals no callback set 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 10 client.4696.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7feac6ffd640 10 monclient: dump: 2024-03-27T21:32:27.394 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.395 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.395 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.395 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.397 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.398 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.398 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.398 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.398 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.398 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.398 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.399 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.399 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.399 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.399 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.399 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 10 monclient: _renew_subs 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead009e520 con 0x7fead0136d00 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.366+0000 7fead8270640 1 librados: init done 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== mon.7 v2:172.21.15.63:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7feac800cd30 con 0x7fead0136d00 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead8270640 10 client.4696.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead8270640 15 client.4696.objecter _session_command_op_assign -1 1 2024-03-27T21:32:27.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead8270640 20 client.4696.objecter _get_session osd=-1 returning homeless 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead8270640 10 client.4696.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead8270640 10 monclient: _send_mon_message to mon.i at v2:172.21.15.63:3303/0 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fead00a3020 con 0x7fead0136d00 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7feab403a250 0x7feab403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== mon.7 v2:172.21.15.63:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7feac804ae10 con 0x7fead0136d00 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 10 client.4696.objecter ms_dispatch 0x7fead0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:27.401 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 3 client.4696.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 3 client.4696.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 10 client.4696.objecter checking command 1 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7feab4040060 0x7feab4042480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 20 client.4696.objecter _get_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 15 client.4696.objecter _session_command_op_remove -1 1 2024-03-27T21:32:27.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 20 client.4696.objecter _get_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 20 client.4696.objecter get_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 15 client.4696.objecter _session_command_op_assign 4 1 2024-03-27T21:32:27.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 4 2024-03-27T21:32:27.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 10 client.4696.objecter _send_command 1 2024-03-27T21:32:27.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 --> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feab4042b30 con 0x7feab4040060 2024-03-27T21:32:27.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 20 client.4696.objecter dump_active .. 0 homeless 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== mon.7 v2:172.21.15.63:3303/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac8014480 con 0x7fead0136d00 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7feac6ffd640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead600c640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7feab403a250 0x7feab403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead600c640 10 monclient: get_auth_request con 0x7feab403a250 auth_method 0 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead580b640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7feab4040060 0x7feab4042480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.367+0000 7fead580b640 10 monclient: get_auth_request con 0x7feab4040060 auth_method 0 2024-03-27T21:32:27.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.368+0000 7feac6ffd640 10 client.4696.objecter ms_handle_connect 0x7feab403a250 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.368+0000 7fead600c640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7feab403a250 0x7feab403c710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feacc035000 tx=0x7feacc008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.368+0000 7feac6ffd640 10 client.4696.objecter ms_handle_connect 0x7feab4040060 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.368+0000 7fead580b640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7feab4040060 0x7feab4042480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.369+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== osd.4 v2:172.21.15.63:6816/33505 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7feab4042b30 con 0x7feab4040060 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.369+0000 7feac6ffd640 10 client.4696.objecter ms_dispatch 0x7fead0000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.369+0000 7feac6ffd640 10 client.4696.objecter _finish_command 1 = system:0 2024-03-27T21:32:27.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.369+0000 7feac6ffd640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 4 2024-03-27T21:32:27.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.369+0000 7feac6ffd640 15 client.4696.objecter _session_command_op_remove 4 1 2024-03-27T21:32:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 10 client.4696.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-03-27T21:32:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 15 client.4696.objecter _session_command_op_assign -1 2 2024-03-27T21:32:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 20 client.4696.objecter _get_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 20 client.4696.objecter _get_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 15 client.4696.objecter _session_command_op_remove -1 2 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 20 client.4696.objecter get_session s=0x7feab403f990 osd=4 3 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 15 client.4696.objecter _session_command_op_assign 4 2 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 4 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 10 client.4696.objecter _send_command 2 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 --> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fead00a2240 con 0x7feab4040060 2024-03-27T21:32:27.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7feac6ffd640 1 -- 172.21.15.28:0/1876129346 <== osd.4 v2:172.21.15.63:6816/33505 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7feac0009950 con 0x7feab4040060 2024-03-27T21:32:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7feac6ffd640 10 client.4696.objecter ms_dispatch 0x7fead0000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:32:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.381+0000 7feac6ffd640 10 client.4696.objecter _finish_command 2 = system:0 2024-03-27T21:32:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7feac6ffd640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 4 2024-03-27T21:32:27.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7feac6ffd640 15 client.4696.objecter _session_command_op_remove 4 2 2024-03-27T21:32:27.410 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:27.410 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T21:32:27.410 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:27.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 10 librados: watch_flush enter 2024-03-27T21:32:27.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 10 librados: watch_flush exit 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 10 client.4696.objecter close_session for osd.4 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7feab4040060 msgr2=0x7feab4042480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6816/33505,v1:172.21.15.63:6817/33505] conn(0x7feab4040060 0x7feab4042480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 20 client.4696.objecter put_session s=0x7feab403f990 osd=4 1 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 20 client.4696.objecter shutdown clearing up homeless session... 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 10 client.4696.objecter successfully canceled tick 2024-03-27T21:32:27.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7feab403a250 msgr2=0x7feab403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7feab403a250 0x7feab403c710 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feacc035000 tx=0x7feacc008030 comp rx=0 tx=0).stop 2024-03-27T21:32:27.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 10 monclient: shutdown 2024-03-27T21:32:27.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:27.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead0136d00 msgr2=0x7fead0133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 --2- 172.21.15.28:0/1876129346 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fead0136d00 0x7fead0133110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feac800efc0 tx=0x7feac800c490 comp rx=0 tx=0).stop 2024-03-27T21:32:27.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead680d640 1 -- 172.21.15.28:0/1876129346 reap_dead start 2024-03-27T21:32:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 shutdown_connections 2024-03-27T21:32:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 >> 172.21.15.28:0/1876129346 conn(0x7fead00a9430 msgr2=0x7fead01349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 shutdown_connections 2024-03-27T21:32:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 -- 172.21.15.28:0/1876129346 wait complete. 2024-03-27T21:32:27.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.382+0000 7fead8270640 1 librados: shutdown 2024-03-27T21:32:27.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-27T21:32:27.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.534+0000 7f3d7fe1c640 10 monclient: get_monmap_and_config 2024-03-27T21:32:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.534+0000 7f3d7fe1c640 10 monclient: build_initial_monmap 2024-03-27T21:32:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.534+0000 7f3d7fe1c640 10 monclient: monmap: 2024-03-27T21:32:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:27.535270+0000 2024-03-27T21:32:27.523 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:27.535270+0000 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:27.524 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:27.525 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:27.525 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 Processor -- start 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 -- start start 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient: init 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient: _add_conns ranks=[6,2,7,1,5,10,4,3,8,9,0] 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 0x7f3d78134f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): picked mon.noname-d con 0x7f3d780a0920 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3d78135460 0x7f3d780a0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): picked mon.noname-b con 0x7f3d78135460 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f3d7806ff10 0x7f3d780a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): picked mon.noname-i con 0x7f3d7806ff10 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780716a0 con 0x7f3d78135460 2024-03-27T21:32:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780713c0 con 0x7f3d780a0920 2024-03-27T21:32:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f3d780a46c0 con 0x7f3d7806ff10 2024-03-27T21:32:27.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7fe1c640 10 monclient(hunting): authenticate will time out at 969.842406s 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 0x7f3d78134f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 0x7f3d78134f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45200/0 (socket says 172.21.15.28:45200) 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3d78135460 0x7f3d780a0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/2817169047 learned_addr learned my addr 172.21.15.28:0/2817169047 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 10 monclient(hunting): get_auth_request con 0x7f3d780a0920 auth_method 0 2024-03-27T21:32:27.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): get_auth_request con 0x7f3d78135460 auth_method 0 2024-03-27T21:32:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.538 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.535+0000 7f3d7e3b9640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f3d7806ff10 0x7f3d780a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7e3b9640 10 monclient(hunting): get_auth_request con 0x7f3d7806ff10 auth_method 0 2024-03-27T21:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7e3b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7e3b9640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7e3b9640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_done global_id 4700 payload 274 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 -- 172.21.15.28:0/2817169047 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f3d7806ff10 msgr2=0x7f3d780a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f3d7806ff10 0x7f3d780a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 -- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 msgr2=0x7f3d78134f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 0x7f3d78134f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 monclient: found mon.noname-b 2024-03-27T21:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 -- 172.21.15.28:0/2817169047 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780618f0 con 0x7f3d78135460 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 0x7f3d78134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.536+0000 7f3d7d3b7640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3d78135460 0x7f3d780a0d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0097d0 tx=0x7f3d6c02b6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4775438ea978c296 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 1 -- 172.21.15.28:0/2817169047 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d6c030980 con 0x7f3d78135460 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: dump: 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.542 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.543 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: _finish_auth 0 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: _check_auth_tickets 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 5 monclient: authenticate success, global_id 4700 2024-03-27T21:32:27.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 1 -- 172.21.15.28:0/2817169047 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c02e050 con 0x7f3d78135460 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 4 set_mon_vals no callback set 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 1 -- 172.21.15.28:0/2817169047 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d6c0313a0 con 0x7f3d78135460 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:27.545 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7cbb6640 10 monclient: dump: 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.546 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.547 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 10 monclient: shutdown 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3d78135460 msgr2=0x7f3d780a0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3d78135460 0x7f3d780a0d00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0097d0 tx=0x7f3d6c02b6d0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/2817169047 shutdown_connections 2024-03-27T21:32:27.548 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f3d7806ff10 0x7f3d780a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f3d78135460 0x7f3d780a0d00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/2817169047 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d780a0920 0x7f3d78134f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/2817169047 >> 172.21.15.28:0/2817169047 conn(0x7f3d780a7810 msgr2=0x7f3d780a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/2817169047 shutdown_connections 2024-03-27T21:32:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.537+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/2817169047 wait complete. 2024-03-27T21:32:27.549 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 10 monclient: build_initial_monmap 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 10 monclient: monmap: 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:27.550 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:27.551 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:27.552 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 1 librados: starting msgr at 2024-03-27T21:32:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 1 librados: starting objecter 2024-03-27T21:32:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 1 Processor -- start 2024-03-27T21:32:27.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 1 -- start start 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 1 librados: setting wanted keys 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 1 librados: calling monclient init 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.538+0000 7f3d7fe1c640 10 monclient: init 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient: _add_conns ranks=[6,8,4,3,5,2,1,0,7] 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.553 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): picked mon.noname-d con 0x7f3d7806ff10 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:27.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f3d780a0920 0x7f3d7809cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): picked mon.noname-e con 0x7f3d780a0920 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:27.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f3d7809d510 0x7f3d781bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): picked mon.noname-c con 0x7f3d7809d510 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:27.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7809d970 con 0x7f3d7809d510 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f3d78070a00 con 0x7f3d7806ff10 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7809a7d0 con 0x7f3d780a0920 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7fe1c640 10 monclient(hunting): authenticate will time out at 969.845893s 2024-03-27T21:32:27.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45204/0 (socket says 172.21.15.28:45204) 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f3d780a0920 0x7f3d7809cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f3d7809d510 0x7f3d781bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 learned_addr learned my addr 172.21.15.28:0/1358978978 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): get_auth_request con 0x7f3d7806ff10 auth_method 0 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): get_auth_request con 0x7f3d7809d510 auth_method 0 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): get_auth_request con 0x7f3d780a0920 auth_method 0 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7d3b7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_done global_id 4632 payload 824 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f3d780a0920 msgr2=0x7f3d7809cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f3d780a0920 0x7f3d7809cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f3d7809d510 msgr2=0x7f3d781bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f3d7809d510 0x7f3d781bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.559 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 monclient: found mon.noname-d 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70009b30 con 0x7f3d7806ff10 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7e3b9640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f3d7809d510 0x7f3d781bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 msgr2=0x7f3d781cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 msgr2=0x7f3d781cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 secure :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000efc0 tx=0x7f3d7000c490 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T21:32:27.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.539+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T21:32:27.732 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient: get_auth_request con 0x7f3d7806ff10 auth_method 0 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 0 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 msgr2=0x7f3d781cb3e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f3d7806ff10 0x7f3d781cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.733 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: _add_conns ranks=[0,1,3,5,7,2] 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d640035d0 0x7f3d64005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): picked mon.noname-a con 0x7f3d640035d0 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d640065c0 0x7f3d64008a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): picked mon.noname-f con 0x7f3d640065c0 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3d64009630 0x7f3d6400baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): picked mon.noname-g con 0x7f3d64009630 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.734 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6400c6e0 con 0x7f3d640035d0 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6400c820 con 0x7f3d640065c0 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6400c9e0 con 0x7f3d64009630 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d640035d0 0x7f3d64005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): get_auth_request con 0x7f3d640035d0 auth_method 0 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:27.735 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): _init_auth already have auth, reseting 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient(hunting): handle_auth_done global_id 4632 payload 293 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3d64009630 msgr2=0x7f3d6400baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f3d64009630 0x7f3d6400baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d640065c0 msgr2=0x7f3d64008a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.736 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3d640065c0 0x7f3d64008a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient: _finish_hunting 0 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 monclient: found mon.noname-a 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6400cc60 con 0x7f3d640035d0 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7e3b9640 1 -- 172.21.15.28:0/1358978978 reap_dead start 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7dbb8640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d640035d0 0x7f3d64005a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d78070b40 tx=0x7f3d7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.737 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 client.?.objecter ms_handle_connect 0x7f3d640035d0 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d70019070 con 0x7f3d640035d0 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: dump: 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.738 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.739 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7000f040 con 0x7f3d640035d0 2024-03-27T21:32:27.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.740+0000 7f3d7fe1c640 5 monclient: authenticate success, global_id 4632 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 10 monclient: _renew_subs 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c009400 con 0x7f3d640035d0 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d767fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f3d70009250 con 0x7f3d640035d0 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 10 client.4632.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:27.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d77fff640 4 set_mon_vals no callback set 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d767fc640 10 monclient: dump: 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:27.742 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:27.743 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 10 monclient: _renew_subs 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7809a210 con 0x7f3d640035d0 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 1 librados: init done 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f3d7001e460 con 0x7f3d640035d0 2024-03-27T21:32:27.744 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.741+0000 7f3d7fe1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d7fe1c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d7fe1c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7806cf60 con 0x7f3d640035d0 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f3d6403ea20 0x7f3d64040ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f3d7004a440 con 0x7f3d640035d0 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 10 client.4632.objecter ms_dispatch 0x7f3d78000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 3 client.4632.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:27.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 3 client.4632.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 20 client.4632.objecter dump_active .. 0 homeless 2024-03-27T21:32:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d7d3b7640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f3d6403ea20 0x7f3d64040ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d7d3b7640 10 monclient: get_auth_request con 0x7f3d6403ea20 auth_method 0 2024-03-27T21:32:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d767fc640 10 client.4632.objecter ms_handle_connect 0x7f3d6403ea20 2024-03-27T21:32:27.746 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.742+0000 7f3d7d3b7640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f3d6403ea20 0x7f3d64040ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c034000 tx=0x7f3d6c02f000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:27.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.746+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f3d700090b0 con 0x7f3d640035d0 2024-03-27T21:32:27.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.746+0000 7f3d767fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:27.747 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.746+0000 7f3d767fc640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:27.915 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.927+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d780a1450 con 0x7f3d6403ea20 2024-03-27T21:32:27.916 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.928+0000 7f3d767fc640 1 -- 172.21.15.28:0/1358978978 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3d6c004210 con 0x7f3d6403ea20 2024-03-27T21:32:27.916 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 4 to deep-scrub 2024-03-27T21:32:27.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.929+0000 7f3d7fe1c640 10 librados: watch_flush enter 2024-03-27T21:32:27.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.929+0000 7f3d7fe1c640 10 librados: watch_flush exit 2024-03-27T21:32:27.918 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.929+0000 7f3d7fe1c640 20 client.4632.objecter shutdown clearing up homeless session... 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.929+0000 7f3d7fe1c640 10 client.4632.objecter successfully canceled tick 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f3d6403ea20 msgr2=0x7f3d64040ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f3d6403ea20 0x7f3d64040ee0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c034000 tx=0x7f3d6c02f000 comp rx=0 tx=0).stop 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 10 monclient: shutdown 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d640035d0 msgr2=0x7f3d64005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:27.919 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d640035d0 0x7f3d64005a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3d78070b40 tx=0x7f3d7000b040 comp rx=0 tx=0).stop 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 shutdown_connections 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f3d6403ea20 0x7f3d64040ee0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 --2- 172.21.15.28:0/1358978978 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d640035d0 0x7f3d64005a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 >> 172.21.15.28:0/1358978978 conn(0x7f3d780a7810 msgr2=0x7f3d780a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 shutdown_connections 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 -- 172.21.15.28:0/1358978978 wait complete. 2024-03-27T21:32:27.920 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:27.930+0000 7f3d7fe1c640 1 librados: shutdown 2024-03-27T21:32:27.928 INFO:tasks.ceph:Scrubbing osd.5 2024-03-27T21:32:27.928 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-27T21:32:28.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.043+0000 7fcaa6210640 10 monclient: get_monmap_and_config 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.043+0000 7fcaa6210640 10 monclient: build_initial_monmap 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.043+0000 7fcaa6210640 10 monclient: monmap: 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:28.044577+0000 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:28.044577+0000 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:28.032 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:28.033 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:28.034 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:28.034 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.044+0000 7fcaa6210640 1 Processor -- start 2024-03-27T21:32:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.044+0000 7fcaa6210640 1 -- start start 2024-03-27T21:32:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.044+0000 7fcaa6210640 10 monclient: init 2024-03-27T21:32:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.044+0000 7fcaa6210640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.044+0000 7fcaa6210640 10 monclient: _add_conns ranks=[9,4,1,7,3,10,8,6,5,2,0] 2024-03-27T21:32:28.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.044+0000 7fcaa6210640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcaa0136d00 0x7fcaa01370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): picked mon.noname-a con 0x7fcaa0136d00 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fcaa00a3d70 0x7fcaa0137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): picked mon.noname-c con 0x7fcaa00a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcaa01339e0 addr v1:172.21.15.63:6789/0 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa00618f0 con 0x7fcaa01339e0 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00a25b0 con 0x7fcaa0136d00 2024-03-27T21:32:28.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0137b60 con 0x7fcaa00a3d70 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fcaa6210640 10 monclient(hunting): authenticate will time out at 970.351800s 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcaa0136d00 0x7fcaa01370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fcaa00a3d70 0x7fcaa0137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcaa0136d00 0x7fcaa01370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:58500/0 (socket says 172.21.15.28:58500) 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fcaa00a3d70 0x7fcaa0137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3302/0 says I am v2:172.21.15.28:37520/0 (socket says 172.21.15.28:37520) 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 -- 172.21.15.28:0/2960246413 learned_addr learned my addr 172.21.15.28:0/2960246413 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:28.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): get_auth_request con 0x7fcaa0136d00 auth_method 0 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): get_auth_request con 0x7fcaa00a3d70 auth_method 0 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient(hunting): handle_auth_done global_id 34308 payload 274 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 -- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fcaa00a3d70 msgr2=0x7fcaa0137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 --2- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fcaa00a3d70 0x7fcaa0137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 -- 172.21.15.28:0/2960246413 >> v1:172.21.15.63:6789/0 conn(0x7fcaa01339e0 legacy=0x7fcaa0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 monclient: found mon.noname-a 2024-03-27T21:32:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.045+0000 7fca9f7fe640 1 -- 172.21.15.28:0/2960246413 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa00a13f0 con 0x7fcaa0136d00 2024-03-27T21:32:28.050 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9f7fe640 1 --2- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaa0136d00 0x7fcaa01370e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca90009870 tx=0x7fca9002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6cd391f3bb9a35 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 1 -- 172.21.15.28:0/2960246413 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca900319b0 con 0x7fcaa0136d00 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: dump: 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.051 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.052 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: _finish_auth 0 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: _check_auth_tickets 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 5 monclient: authenticate success, global_id 34308 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 1 -- 172.21.15.28:0/2960246413 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca90031b30 con 0x7fcaa0136d00 2024-03-27T21:32:28.053 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 4 set_mon_vals no callback set 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 1 -- 172.21.15.28:0/2960246413 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca90031ce0 con 0x7fcaa0136d00 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fca9e7fc640 10 monclient: dump: 2024-03-27T21:32:28.054 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.055 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 10 monclient: shutdown 2024-03-27T21:32:28.056 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 -- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaa0136d00 msgr2=0x7fcaa01370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 --2- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaa0136d00 0x7fcaa01370e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fca90009870 tx=0x7fca9002b7e0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 -- 172.21.15.28:0/2960246413 shutdown_connections 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 --2- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7fcaa00a3d70 0x7fcaa0137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 --2- 172.21.15.28:0/2960246413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcaa0136d00 0x7fcaa01370e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 -- 172.21.15.28:0/2960246413 >> 172.21.15.28:0/2960246413 conn(0x7fcaa00a9430 msgr2=0x7fcaa00a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 -- 172.21.15.28:0/2960246413 shutdown_connections 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.046+0000 7fcaa6210640 1 -- 172.21.15.28:0/2960246413 wait complete. 2024-03-27T21:32:28.057 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.047+0000 7fcaa6210640 10 monclient: build_initial_monmap 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.047+0000 7fcaa6210640 10 monclient: monmap: 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:28.058 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:28.059 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.047+0000 7fcaa6210640 1 librados: starting msgr at 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.047+0000 7fcaa6210640 1 librados: starting objecter 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.047+0000 7fcaa6210640 1 Processor -- start 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 -- start start 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 librados: setting wanted keys 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 librados: calling monclient init 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient: init 2024-03-27T21:32:28.060 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient: _add_conns ranks=[1,7,6,4,5,2,8,0,3] 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcaa00a3d70 0x7fcaa01cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): picked mon.noname-f con 0x7fcaa00a3d70 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fcaa01339e0 0x7fcaa0132e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): picked mon.noname-i con 0x7fcaa01339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcaa0136d00 0x7fcaa01c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): picked mon.noname-d con 0x7fcaa0136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:28.061 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa009e670 con 0x7fcaa00a3d70 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00a11e0 con 0x7fcaa0136d00 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa0120300 con 0x7fcaa01339e0 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fcaa6210640 10 monclient(hunting): authenticate will time out at 970.355218s 2024-03-27T21:32:28.062 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcaa0136d00 0x7fcaa01c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcaa0136d00 0x7fcaa01c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45222/0 (socket says 172.21.15.28:45222) 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 -- 172.21.15.28:0/3016657110 learned_addr learned my addr 172.21.15.28:0/3016657110 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): get_auth_request con 0x7fcaa0136d00 auth_method 0 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.063 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9f7fe640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcaa00a3d70 0x7fcaa01cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9effd640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fcaa01339e0 0x7fcaa0132e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9f7fe640 10 monclient(hunting): get_auth_request con 0x7fcaa00a3d70 auth_method 0 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9effd640 10 monclient(hunting): get_auth_request con 0x7fcaa01339e0 auth_method 0 2024-03-27T21:32:28.064 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9effd640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9effd640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient(hunting): handle_auth_done global_id 4641 payload 824 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 -- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fcaa01339e0 msgr2=0x7fcaa0132e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7fcaa01339e0 0x7fcaa0132e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 -- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcaa00a3d70 msgr2=0x7fcaa01cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcaa00a3d70 0x7fcaa01cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.065 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 monclient: found mon.noname-d 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.048+0000 7fca9ffff640 1 -- 172.21.15.28:0/3016657110 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900094d0 con 0x7fcaa0136d00 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca9ffff640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcaa0136d00 0x7fcaa01c8120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c780 tx=0x7fca9800cc40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 client.?.objecter ms_handle_connect 0x7fcaa0136d00 2024-03-27T21:32:28.066 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca9800ce30 con 0x7fcaa0136d00 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: dump: 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.067 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.068 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:28.069 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 5 monclient: authenticate success, global_id 4641 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98004d80 con 0x7fcaa0136d00 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 10 monclient: _renew_subs 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa00a1630 con 0x7fcaa0136d00 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7fca9800acc0 con 0x7fcaa0136d00 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:28.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 10 client.4641.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca9dffb640 4 set_mon_vals no callback set 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fca87fff640 10 monclient: dump: 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.071 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.072 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 10 monclient: _renew_subs 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa0120830 con 0x7fcaa0136d00 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.049+0000 7fcaa6210640 1 librados: init done 2024-03-27T21:32:28.073 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fcaa6210640 10 client.4641.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fcaa6210640 15 client.4641.objecter _session_command_op_assign -1 1 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fcaa6210640 20 client.4641.objecter _get_session osd=-1 returning homeless 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fcaa6210640 10 client.4641.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fcaa6210640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcaa00a3020 con 0x7fcaa0136d00 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7fca9800a850 con 0x7fcaa0136d00 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fca8c03a280 0x7fca8c03c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7fca9804a080 con 0x7fcaa0136d00 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 10 client.4641.objecter ms_dispatch 0x7fcaa0000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 3 client.4641.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 3 client.4641.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 10 client.4641.objecter checking command 1 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7fca8c040090 0x7fca8c0424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 20 client.4641.objecter _get_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 15 client.4641.objecter _session_command_op_remove -1 1 2024-03-27T21:32:28.075 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 20 client.4641.objecter _get_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 20 client.4641.objecter get_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 15 client.4641.objecter _session_command_op_assign 5 1 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 4 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 10 client.4641.objecter _send_command 1 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 --> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca8c042b60 con 0x7fca8c040090 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 20 client.4641.objecter dump_active .. 0 homeless 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9804c710 con 0x7fcaa0136d00 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca87fff640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-03-27T21:32:28.076 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca9f7fe640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fca8c03a280 0x7fca8c03c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca9f7fe640 10 monclient: get_auth_request con 0x7fca8c03a280 auth_method 0 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca9effd640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7fca8c040090 0x7fca8c0424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.050+0000 7fca9effd640 10 monclient: get_auth_request con 0x7fca8c040090 auth_method 0 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 10 client.4641.objecter ms_handle_connect 0x7fca8c03a280 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca9f7fe640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fca8c03a280 0x7fca8c03c740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca90035000 tx=0x7fca90008030 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 10 client.4641.objecter ms_handle_connect 0x7fca8c040090 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca9effd640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7fca8c040090 0x7fca8c0424b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== osd.5 v2:172.21.15.63:6800/33506 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fca8c042b60 con 0x7fca8c040090 2024-03-27T21:32:28.077 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 10 client.4641.objecter ms_dispatch 0x7fcaa0000b90 command_reply(tid 1: 0 ) v1 2024-03-27T21:32:28.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 10 client.4641.objecter _finish_command 1 = system:0 2024-03-27T21:32:28.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 4 2024-03-27T21:32:28.078 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.051+0000 7fca87fff640 15 client.4641.objecter _session_command_op_remove 5 1 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 10 client.4641.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 15 client.4641.objecter _session_command_op_assign -1 2 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 20 client.4641.objecter _get_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 20 client.4641.objecter _get_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 15 client.4641.objecter _session_command_op_remove -1 2 2024-03-27T21:32:28.079 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 20 client.4641.objecter get_session s=0x7fca8c03f9c0 osd=5 3 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 15 client.4641.objecter _session_command_op_assign 5 2 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 4 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 10 client.4641.objecter _send_command 2 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 --> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcaa00a2240 con 0x7fca8c040090 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fca87fff640 1 -- 172.21.15.28:0/3016657110 <== osd.5 v2:172.21.15.63:6800/33506 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fca94009820 con 0x7fca8c040090 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fca87fff640 10 client.4641.objecter ms_dispatch 0x7fcaa0000b90 command_reply(tid 2: 0 ) v1 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fca87fff640 10 client.4641.objecter _finish_command 2 = system:0 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fca87fff640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 4 2024-03-27T21:32:28.080 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.064+0000 7fca87fff640 15 client.4641.objecter _session_command_op_remove 5 2 2024-03-27T21:32:28.081 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-27T21:32:28.081 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T21:32:28.081 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-27T21:32:28.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 10 librados: watch_flush enter 2024-03-27T21:32:28.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 10 librados: watch_flush exit 2024-03-27T21:32:28.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 10 client.4641.objecter close_session for osd.5 2024-03-27T21:32:28.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7fca8c040090 msgr2=0x7fca8c0424b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.083 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6800/33506,v1:172.21.15.63:6801/33506] conn(0x7fca8c040090 0x7fca8c0424b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 20 client.4641.objecter put_session s=0x7fca8c03f9c0 osd=5 1 2024-03-27T21:32:28.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 20 client.4641.objecter shutdown clearing up homeless session... 2024-03-27T21:32:28.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 10 client.4641.objecter successfully canceled tick 2024-03-27T21:32:28.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fca8c03a280 msgr2=0x7fca8c03c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7fca8c03a280 0x7fca8c03c740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca90035000 tx=0x7fca90008030 comp rx=0 tx=0).stop 2024-03-27T21:32:28.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 10 monclient: shutdown 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcaa0136d00 msgr2=0x7fcaa01c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 --2- 172.21.15.28:0/3016657110 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7fcaa0136d00 0x7fcaa01c8120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fca9800c780 tx=0x7fca9800cc40 comp rx=0 tx=0).stop 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fca9ffff640 1 -- 172.21.15.28:0/3016657110 reap_dead start 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 shutdown_connections 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 >> 172.21.15.28:0/3016657110 conn(0x7fcaa00a9430 msgr2=0x7fcaa01349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 shutdown_connections 2024-03-27T21:32:28.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 -- 172.21.15.28:0/3016657110 wait complete. 2024-03-27T21:32:28.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.065+0000 7fcaa6210640 1 librados: shutdown 2024-03-27T21:32:28.086 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-27T21:32:28.186 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.198+0000 7f4c0491b640 10 monclient: get_monmap_and_config 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.198+0000 7f4c0491b640 10 monclient: build_initial_monmap 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.198+0000 7f4c0491b640 10 monclient: monmap: 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:28.199269+0000 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:28.199269+0000 2024-03-27T21:32:28.187 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:28.188 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:28.189 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:28.190 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 Processor -- start 2024-03-27T21:32:28.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 -- start start 2024-03-27T21:32:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient: init 2024-03-27T21:32:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient: _add_conns ranks=[0,3,7,2,4,9,1,5,8,10,6] 2024-03-27T21:32:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4c00136d00 addr v1:172.21.15.28:6789/0 2024-03-27T21:32:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c000a3d70 0x7f4c0013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): picked mon.noname-g con 0x7f4c000a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c001377f0 0x7f4c0013e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): picked mon.noname-i con 0x7f4c001377f0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c000618f0 con 0x7f4c00136d00 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000a25b0 con 0x7f4c000a3d70 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000a13f0 con 0x7f4c001377f0 2024-03-27T21:32:28.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4c0491b640 10 monclient(hunting): authenticate will time out at 970.506388s 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfe59c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4c00136d00 0x7f4c001370e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:54416/0 (socket says 172.21.15.28:54416) 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfe59c640 1 -- 172.21.15.28:0/2517567236 learned_addr learned my addr 172.21.15.28:0/2517567236 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfed9d640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c001377f0 0x7f4c0013e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfed9d640 10 monclient(hunting): get_auth_request con 0x7f4c001377f0 auth_method 0 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.199+0000 7f4bfed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c000a3d70 0x7f4c0013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request con 0x7f4c000a3d70 auth_method 0 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfdd9b640 1 -- 172.21.15.28:0/2517567236 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114078642 0 0) 0x7f4c000618f0 con 0x7f4c00136d00 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfdd9b640 10 monclient(hunting): _negotiate 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfdd9b640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfdd9b640 10 monclient(hunting): my global_id is 34317 2024-03-27T21:32:28.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfdd9b640 1 -- 172.21.15.28:0/2517567236 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bec003520 con 0x7f4c00136d00 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_done global_id 4723 payload 274 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 1 -- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c000a3d70 msgr2=0x7f4c0013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c000a3d70 0x7f4c0013c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 1 -- 172.21.15.28:0/2517567236 >> v1:172.21.15.28:6789/0 conn(0x7f4c00136d00 legacy=0x7f4c001370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 1 monclient: found mon.noname-i 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 10 monclient: _send_mon_message to mon.noname-i at v2:172.21.15.63:3303/0 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.200+0000 7f4bfed9d640 1 -- 172.21.15.28:0/2517567236 --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000a1f60 con 0x7f4c001377f0 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfed9d640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c001377f0 0x7f4c0013e7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009dc0 tx=0x7f4bf802bd50 comp rx=0 tx=0).ready entity=mon.7 client_cookie=dc036b7258fc18c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 1 -- 172.21.15.28:0/2517567236 <== mon.7 v2:172.21.15.63:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf802cd70 con 0x7f4c001377f0 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: dump: 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.208 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.209 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: _finish_auth 0 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: _check_auth_tickets 2024-03-27T21:32:28.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 5 monclient: authenticate success, global_id 4723 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 1 -- 172.21.15.28:0/2517567236 <== mon.7 v2:172.21.15.63:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8032340 con 0x7f4c001377f0 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 4 set_mon_vals no callback set 2024-03-27T21:32:28.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 1 -- 172.21.15.28:0/2517567236 <== mon.7 v2:172.21.15.63:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf8032960 con 0x7f4c001377f0 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4bfdd9b640 10 monclient: dump: 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.212 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.213 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.214 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.214 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.214 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 10 monclient: shutdown 2024-03-27T21:32:28.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:28.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 -- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c001377f0 msgr2=0x7f4c0013e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c001377f0 0x7f4c0013e7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009dc0 tx=0x7f4bf802bd50 comp rx=0 tx=0).stop 2024-03-27T21:32:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 -- 172.21.15.28:0/2517567236 shutdown_connections 2024-03-27T21:32:28.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c001377f0 0x7f4c0013e7f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 --2- 172.21.15.28:0/2517567236 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c000a3d70 0x7f4c0013c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 -- 172.21.15.28:0/2517567236 >> 172.21.15.28:0/2517567236 conn(0x7f4c000a9430 msgr2=0x7f4c000a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 -- 172.21.15.28:0/2517567236 shutdown_connections 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.201+0000 7f4c0491b640 1 -- 172.21.15.28:0/2517567236 wait complete. 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 10 monclient: build_initial_monmap 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 10 monclient: monmap: 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:28.219 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:28.220 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 1 librados: starting msgr at 2024-03-27T21:32:28.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 1 librados: starting objecter 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 1 Processor -- start 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 1 -- start start 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 1 librados: setting wanted keys 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 1 librados: calling monclient init 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.202+0000 7f4c0491b640 10 monclient: init 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient: _add_conns ranks=[7,3,6,5,1,4,8,0,2] 2024-03-27T21:32:28.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c000a3d70 0x7f4c00131d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): picked mon.noname-i con 0x7f4c000a3d70 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c00136d00 0x7f4c001322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): picked mon.noname-g con 0x7f4c00136d00 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 0x7f4c0009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): picked mon.noname-d con 0x7f4c001377f0 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000a11e0 con 0x7f4c00136d00 2024-03-27T21:32:28.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000a1630 con 0x7f4c001377f0 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0009dad0 con 0x7f4c000a3d70 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4c0491b640 10 monclient(hunting): authenticate will time out at 970.510041s 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 0x7f4c0009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 0x7f4c0009ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:45232/0 (socket says 172.21.15.28:45232) 2024-03-27T21:32:28.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 -- 172.21.15.28:0/4186274635 learned_addr learned my addr 172.21.15.28:0/4186274635 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): get_auth_request con 0x7f4c001377f0 auth_method 0 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c00136d00 0x7f4c001322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c000a3d70 0x7f4c00131d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request con 0x7f4c00136d00 auth_method 0 2024-03-27T21:32:28.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): get_auth_request con 0x7f4c000a3d70 auth_method 0 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bf7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfe59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient(hunting): handle_auth_done global_id 4650 payload 824 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 -- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c000a3d70 msgr2=0x7f4c00131d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c000a3d70 0x7f4c00131d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 -- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c00136d00 msgr2=0x7f4c001322c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c00136d00 0x7f4c001322c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient: _finish_hunting 0 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 monclient: found mon.noname-d 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:28.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 -- 172.21.15.28:0/4186274635 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009a70 con 0x7f4c001377f0 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.203+0000 7f4bfed9d640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 0x7f4c0009ba00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8037040 tx=0x7f4bf8004a40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 client.?.objecter ms_handle_connect 0x7f4c001377f0 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf8009450 con 0x7f4c001377f0 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:28.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: dump: 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.230 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: _finish_auth 0 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 5 monclient: authenticate success, global_id 4650 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8003e10 con 0x7f4c001377f0 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 10 monclient: _renew_subs 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0009f6f0 con 0x7f4c001377f0 2024-03-27T21:32:28.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f4bf80046c0 con 0x7f4c001377f0 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bfd59a640 4 set_mon_vals no callback set 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 10 client.4650.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 10 monclient: dump: 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.233 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.234 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 10 monclient: _renew_subs 2024-03-27T21:32:28.235 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00132800 con 0x7f4c001377f0 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4c0491b640 1 librados: init done 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.204+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f4bf8004250 con 0x7f4c001377f0 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4c0491b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4c0491b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4c0491b640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f4be003a250 0x7f4be003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.236 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c000a9810 con 0x7f4c001377f0 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f4bf806c5f0 con 0x7f4c001377f0 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 10 client.4650.objecter ms_dispatch 0x7f4c00000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 3 client.4650.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 3 client.4650.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 20 client.4650.objecter dump_active .. 0 homeless 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bfe59c640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f4be003a250 0x7f4be003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bfe59c640 10 monclient: get_auth_request con 0x7f4be003a250 auth_method 0 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bf6ffd640 10 client.4650.objecter ms_handle_connect 0x7f4be003a250 2024-03-27T21:32:28.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.205+0000 7f4bfe59c640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f4be003a250 0x7f4be003c710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0005880 tx=0x7f4bf0009040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.209+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f4bf8004500 con 0x7f4c001377f0 2024-03-27T21:32:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.209+0000 7f4bf6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.209+0000 7f4bf6ffd640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:28.376 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.388+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c000a3020 con 0x7f4be003a250 2024-03-27T21:32:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.389+0000 7f4bf6ffd640 1 -- 172.21.15.28:0/4186274635 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4bf0001580 con 0x7f4be003a250 2024-03-27T21:32:28.377 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 5 to deep-scrub 2024-03-27T21:32:28.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 10 librados: watch_flush enter 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 10 librados: watch_flush exit 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 20 client.4650.objecter shutdown clearing up homeless session... 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 10 client.4650.objecter successfully canceled tick 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f4be003a250 msgr2=0x7f4be003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f4be003a250 0x7f4be003c710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0005880 tx=0x7f4bf0009040 comp rx=0 tx=0).stop 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 10 monclient: shutdown 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:28.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 msgr2=0x7f4c0009ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 0x7f4c0009ba00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8037040 tx=0x7f4bf8004a40 comp rx=0 tx=0).stop 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 shutdown_connections 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f4be003a250 0x7f4be003c710 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f4c001377f0 0x7f4c0009ba00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f4c00136d00 0x7f4c001322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 --2- 172.21.15.28:0/4186274635 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f4c000a3d70 0x7f4c00131d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 >> 172.21.15.28:0/4186274635 conn(0x7f4c000a9430 msgr2=0x7f4c000662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:28.381 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 shutdown_connections 2024-03-27T21:32:28.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 -- 172.21.15.28:0/4186274635 wait complete. 2024-03-27T21:32:28.382 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.391+0000 7f4c0491b640 1 librados: shutdown 2024-03-27T21:32:28.389 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:32:28.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.502+0000 7f0a569d2640 10 monclient: get_monmap_and_config 2024-03-27T21:32:28.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.502+0000 7f0a569d2640 10 monclient: build_initial_monmap 2024-03-27T21:32:28.500 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.502+0000 7f0a569d2640 10 monclient: monmap: 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:28.503702+0000 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:28.503702+0000 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.501 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:28.502 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:28.502 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:28.502 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:28.502 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:28.502 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:28.502 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.503+0000 7f0a569d2640 1 Processor -- start 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.503+0000 7f0a569d2640 1 -- start start 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.503+0000 7f0a569d2640 10 monclient: init 2024-03-27T21:32:28.503 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient: _add_conns ranks=[2,3,5,1,8,10,6,4,9,0,7] 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 0x7f0a501370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): picked mon.noname-b con 0x7f0a50136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): picked mon.noname-g con 0x7f0a500a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): picked mon.noname-h con 0x7f0a501339e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:28.504 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500a25b0 con 0x7f0a50136d00 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50137b60 con 0x7f0a500a3d70 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500a13f0 con 0x7f0a501339e0 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a569d2640 10 monclient(hunting): authenticate will time out at 970.810898s 2024-03-27T21:32:28.505 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 0x7f0a501370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 0x7f0a501370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3301/0 says I am v2:172.21.15.28:38578/0 (socket says 172.21.15.28:38578) 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 -- 172.21.15.28:0/2265338382 learned_addr learned my addr 172.21.15.28:0/2265338382 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): get_auth_request con 0x7f0a50136d00 auth_method 0 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.506 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4f7fe640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_done global_id 4709 payload 274 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a54f6f640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 -- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 msgr2=0x7f0a50133e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 -- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 msgr2=0x7f0a50137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.507 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:28.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 monclient: found mon.noname-b 2024-03-27T21:32:28.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:28.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.28:3301/0 2024-03-27T21:32:28.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4ffff640 1 -- 172.21.15.28:0/2265338382 --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500618f0 con 0x7f0a50136d00 2024-03-27T21:32:28.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4f7fe640 10 monclient: get_auth_request con 0x7f0a500a3d70 auth_method 0 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a54f6f640 10 monclient: get_auth_request con 0x7f0a501339e0 auth_method 0 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a4f7fe640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.504+0000 7f0a54f6f640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4ffff640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 0x7f0a501370e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a400098a0 tx=0x7f0a4002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69e25f35f229dc77 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 1 -- 172.21.15.28:0/2265338382 <== mon.2 v2:172.21.15.28:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a4002f050 con 0x7f0a50136d00 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: dump: 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.510 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.511 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.512 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.512 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: _finish_auth 0 2024-03-27T21:32:28.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:28.512 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 1 -- 172.21.15.28:0/2265338382 <== mon.2 v2:172.21.15.28:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40031970 con 0x7f0a50136d00 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 5 monclient: authenticate success, global_id 4709 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 1 -- 172.21.15.28:0/2265338382 <== mon.2 v2:172.21.15.28:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a40032390 con 0x7f0a50136d00 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 4 set_mon_vals no callback set 2024-03-27T21:32:28.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a4effd640 10 monclient: dump: 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.514 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.515 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 10 monclient: shutdown 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 1 -- 172.21.15.28:0/2265338382 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 msgr2=0x7f0a501370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.505+0000 7f0a569d2640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 0x7f0a501370e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0a400098a0 tx=0x7f0a4002b7a0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 -- 172.21.15.28:0/2265338382 shutdown_connections 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 --2- 172.21.15.28:0/2265338382 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0a50136d00 0x7f0a501370e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 -- 172.21.15.28:0/2265338382 >> 172.21.15.28:0/2265338382 conn(0x7f0a500a9430 msgr2=0x7f0a500a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 -- 172.21.15.28:0/2265338382 shutdown_connections 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 -- 172.21.15.28:0/2265338382 wait complete. 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 10 monclient: build_initial_monmap 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 10 monclient: monmap: 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:28.517 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:28.518 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:28.518 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:28.518 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:28.518 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:28.518 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:28.518 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:28.519 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:28.519 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:28.519 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:28.519 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:28.519 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:28.519 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 librados: starting msgr at 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 librados: starting objecter 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.506+0000 7f0a569d2640 1 Processor -- start 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 -- start start 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 librados: setting wanted keys 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 librados: calling monclient init 2024-03-27T21:32:28.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient: init 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient: _add_conns ranks=[3,5,7,2,0,8,1,4,6] 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): picked mon.noname-g con 0x7f0a500a3d70 addr [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): picked mon.noname-h con 0x7f0a501339e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0a50136d00 0x7f0a5009c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): picked mon.noname-i con 0x7f0a50136d00 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:28.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 -- --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501cc250 con 0x7f0a500a3d70 2024-03-27T21:32:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50120340 con 0x7f0a501339e0 2024-03-27T21:32:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:28.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500a11e0 con 0x7f0a50136d00 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a569d2640 10 monclient(hunting): authenticate will time out at 970.814255s 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 1 --2- >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3302/0 says I am v2:172.21.15.28:42306/0 (socket says 172.21.15.28:42306) 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0a50136d00 0x7f0a5009c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 1 -- 172.21.15.28:0/3174524860 learned_addr learned my addr 172.21.15.28:0/3174524860 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:28.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): get_auth_request con 0x7f0a501339e0 auth_method 0 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): get_auth_request con 0x7f0a500a3d70 auth_method 0 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): get_auth_request con 0x7f0a50136d00 auth_method 0 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a4f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.507+0000 7f0a54f6f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 10 monclient(hunting): handle_auth_done global_id 4719 payload 824 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 -- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0a50136d00 msgr2=0x7f0a5009c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0a50136d00 0x7f0a5009c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 -- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 msgr2=0x7f0a50133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 10 monclient: _finish_hunting 0 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 monclient: found mon.noname-g 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 10 monclient: _send_mon_message to mon.noname-g at v2:172.21.15.63:3301/0 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 -- 172.21.15.28:0/3174524860 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400094d0 con 0x7f0a500a3d70 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4ffff640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50132bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a40033000 tx=0x7f0a400046c0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 client.?.objecter ms_handle_connect 0x7f0a500a3d70 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mon.3 v2:172.21.15.63:3301/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a40003a80 con 0x7f0a500a3d70 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: dump: 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.528 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.529 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: _finish_auth 0 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: _check_auth_tickets 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:28.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mon.3 v2:172.21.15.63:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40003be0 con 0x7f0a500a3d70 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 5 monclient: authenticate success, global_id 4719 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 10 monclient: _renew_subs 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5011fcf0 con 0x7f0a500a3d70 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mon.3 v2:172.21.15.63:3301/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0a40003d50 con 0x7f0a500a3d70 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:28.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4cff9640 10 monclient: dump: 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:28.532 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:28.533 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 10 client.4719.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a4e7fc640 4 set_mon_vals no callback set 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 10 monclient: _renew_subs 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5009e380 con 0x7f0a500a3d70 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.508+0000 7f0a569d2640 1 librados: init done 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mon.3 v2:172.21.15.63:3301/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f0a40003610 con 0x7f0a500a3d70 2024-03-27T21:32:28.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a569d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a569d2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a569d2640 10 monclient: _send_mon_message to mon.g at v2:172.21.15.63:3301/0 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 --> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a500670d0 con 0x7f0a500a3d70 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a3c03a250 0x7f0a3c03c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mon.3 v2:172.21.15.63:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f0a4006c2e0 con 0x7f0a500a3d70 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 10 client.4719.objecter ms_dispatch 0x7f0a50000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 3 client.4719.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 3 client.4719.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:28.535 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4cff9640 20 client.4719.objecter dump_active .. 0 homeless 2024-03-27T21:32:28.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4f7fe640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a3c03a250 0x7f0a3c03c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:28.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.509+0000 7f0a4f7fe640 10 monclient: get_auth_request con 0x7f0a3c03a250 auth_method 0 2024-03-27T21:32:28.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.510+0000 7f0a4cff9640 10 client.4719.objecter ms_handle_connect 0x7f0a3c03a250 2024-03-27T21:32:28.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.510+0000 7f0a4f7fe640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a3c03a250 0x7f0a3c03c710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a5009e090 tx=0x7f0a44008040 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:28.536 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.515+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mon.3 v2:172.21.15.63:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f0a4003f7d0 con 0x7f0a500a3d70 2024-03-27T21:32:28.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.515+0000 7f0a4cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:28.537 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.515+0000 7f0a4cff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:28.679 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.691+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a500a3020 con 0x7f0a3c03a250 2024-03-27T21:32:28.681 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.693+0000 7f0a4cff9640 1 -- 172.21.15.28:0/3174524860 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+54061 (secure 0 0 0) 0x7f0a4400c040 con 0x7f0a3c03a250 2024-03-27T21:32:28.682 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:32:28.682 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:32:28.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 10 librados: watch_flush enter 2024-03-27T21:32:28.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 10 librados: watch_flush exit 2024-03-27T21:32:28.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 20 client.4719.objecter shutdown clearing up homeless session... 2024-03-27T21:32:28.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 10 client.4719.objecter successfully canceled tick 2024-03-27T21:32:28.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a3c03a250 msgr2=0x7f0a3c03c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a3c03a250 0x7f0a3c03c710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0a5009e090 tx=0x7f0a44008040 comp rx=0 tx=0).stop 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 10 monclient: shutdown 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 msgr2=0x7f0a50132bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50132bd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0a40033000 tx=0x7f0a400046c0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 shutdown_connections 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f0a3c03a250 0x7f0a3c03c710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f0a50136d00 0x7f0a5009c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f0a501339e0 0x7f0a50133110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 --2- 172.21.15.28:0/3174524860 >> [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] conn(0x7f0a500a3d70 0x7f0a50132bd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 >> 172.21.15.28:0/3174524860 conn(0x7f0a500a9430 msgr2=0x7f0a501349f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 shutdown_connections 2024-03-27T21:32:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 -- 172.21.15.28:0/3174524860 wait complete. 2024-03-27T21:32:28.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:28.695+0000 7f0a569d2640 1 librados: shutdown 2024-03-27T21:32:28.693 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2024-03-27T21:32:28.657404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168548,"kb_used_data":1876,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062492,"statfs":{"total":579820584960,"available":579647991808,"internally_reserved":0,"allocated":1921024,"data_stored":1313826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002547"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942230+0000","last_change":"2024-03-27T21:30:21.225528+0000","last_active":"2024-03-27T21:30:21.942230+0000","last_peered":"2024-03-27T21:30:21.942230+0000","last_clean":"2024-03-27T21:30:21.942230+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:30:21.942230+0000","last_undegraded":"2024-03-27T21:30:21.942230+0000","last_fullsized":"2024-03-27T21:30:21.942230+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:13:53.191509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938437+0000","last_change":"2024-03-27T21:30:20.934346+0000","last_active":"2024-03-27T21:30:21.938437+0000","last_peered":"2024-03-27T21:30:21.938437+0000","last_clean":"2024-03-27T21:30:21.938437+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:30:21.938437+0000","last_undegraded":"2024-03-27T21:30:21.938437+0000","last_fullsized":"2024-03-27T21:30:21.938437+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T23:56:30.786670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942245+0000","last_change":"2024-03-27T21:30:20.931542+0000","last_active":"2024-03-27T21:30:21.942245+0000","last_peered":"2024-03-27T21:30:21.942245+0000","last_clean":"2024-03-27T21:30:21.942245+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:30:21.942245+0000","last_undegraded":"2024-03-27T21:30:21.942245+0000","last_fullsized":"2024-03-27T21:30:21.942245+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:58:44.946118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.938523+0000","last_change":"2024-03-27T21:30:20.936161+0000","last_active":"2024-03-27T21:30:21.938523+0000","last_peered":"2024-03-27T21:30:21.938523+0000","last_clean":"2024-03-27T21:30:21.938523+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:30:21.938523+0000","last_undegraded":"2024-03-27T21:30:21.938523+0000","last_fullsized":"2024-03-27T21:30:21.938523+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T00:00:07.575014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125520+0000","last_change":"2024-03-27T21:30:20.935628+0000","last_active":"2024-03-27T21:30:22.125520+0000","last_peered":"2024-03-27T21:30:22.125520+0000","last_clean":"2024-03-27T21:30:22.125520+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:30:22.125520+0000","last_undegraded":"2024-03-27T21:30:22.125520+0000","last_fullsized":"2024-03-27T21:30:22.125520+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:42:06.531918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.131607+0000","last_change":"2024-03-27T21:30:20.931778+0000","last_active":"2024-03-27T21:30:22.131607+0000","last_peered":"2024-03-27T21:30:22.131607+0000","last_clean":"2024-03-27T21:30:22.131607+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:30:22.131607+0000","last_undegraded":"2024-03-27T21:30:22.131607+0000","last_fullsized":"2024-03-27T21:30:22.131607+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T06:24:39.167103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.122976+0000","last_change":"2024-03-27T21:30:20.932234+0000","last_active":"2024-03-27T21:30:22.122976+0000","last_peered":"2024-03-27T21:30:22.122976+0000","last_clean":"2024-03-27T21:30:22.122976+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:30:22.122976+0000","last_undegraded":"2024-03-27T21:30:22.122976+0000","last_fullsized":"2024-03-27T21:30:22.122976+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:10:47.778324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-27T21:30:22.125541+0000","last_change":"2024-03-27T21:30:20.935634+0000","last_active":"2024-03-27T21:30:22.125541+0000","last_peered":"2024-03-27T21:30:22.125541+0000","last_clean":"2024-03-27T21:30:22.125541+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:30:22.125541+0000","last_undegraded":"2024-03-27T21:30:22.125541+0000","last_fullsized":"2024-03-27T21:30:22.125541+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:19.881876+0000","last_clean_scrub_stamp":"2024-03-27T21:30:19.881876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:09:34.647480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:30:21.942270+0000","last_change":"2024-03-27T21:30:19.891105+0000","last_active":"2024-03-27T21:30:21.942270+0000","last_peered":"2024-03-27T21:30:21.942270+0000","last_clean":"2024-03-27T21:30:21.942270+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:30:21.942270+0000","last_undegraded":"2024-03-27T21:30:21.942270+0000","last_fullsized":"2024-03-27T21:30:21.942270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:30:18.879901+0000","last_clean_scrub_stamp":"2024-03-27T21:30:18.879901+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T09:29:55.027827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607581,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.53200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.439}]},{"osd":2,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60699999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57099999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.48999999999999999}]},{"osd":3,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33700000000000002,"15min":0.33900000000000002},"min":{"1min":0.22800000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.45900000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.376}]},{"osd":5,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.35199999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.42099999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45100000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40100000000000002}]}]},{"osd":3,"up_from":12,"seq":51539607580,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":675840,"data_stored":571767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.67900000000000005}]},{"osd":1,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61299999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.374,"15min":0.38},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.56599999999999995}]},{"osd":5,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36799999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.625}]}]},{"osd":5,"up_from":11,"seq":47244640284,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.47699999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.41399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.71999999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.54300000000000004}]},{"osd":3,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.378},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.308}]},{"osd":4,"last update":"Wed Mar 27 21:31:23 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.35599999999999998}]}]},{"osd":2,"up_from":11,"seq":47244640283,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31260,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340580,"statfs":{"total":96636764160,"available":96604753920,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.436,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35299999999999998},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.29099999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.47799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.26800000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.40000000000000002}]},{"osd":4,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.41199999999999998}]},{"osd":5,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.38200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.45100000000000001}]}]},{"osd":1,"up_from":11,"seq":47244640284,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.26300000000000001}]},{"osd":2,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33000000000000002},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.248}]},{"osd":3,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.374,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.438}]},{"osd":5,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.50600000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640283,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.28299999999999997}]},{"osd":2,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.39300000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47699999999999998}]},{"osd":4,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.439},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed Mar 27 21:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:32:28.697 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.697 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.697 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.697 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.698 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.698 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.698 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.698 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-27T21:30:19.881876+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=19, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.698 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-27T21:30:18.879901+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=30, tm_sec=18, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=21, tm_min=32, tm_sec=24, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T21:32:28.698 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-27T21:32:48.699 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T21:32:48.811 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.823+0000 7f89ba7fd640 10 monclient: get_monmap_and_config 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.823+0000 7f89ba7fd640 10 monclient: build_initial_monmap 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.823+0000 7f89ba7fd640 10 monclient: monmap: 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:48.824355+0000 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:48.824355+0000 2024-03-27T21:32:48.812 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:48.813 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:48.814 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:48.814 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:48.814 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:48.814 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:48.814 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:48.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 Processor -- start 2024-03-27T21:32:48.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 -- start start 2024-03-27T21:32:48.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient: init 2024-03-27T21:32:48.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:48.824 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient: _add_conns ranks=[10,9,7,6,2,5,0,1,3,4,8] 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f89b4136d00 0x7f89b41370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): picked mon.noname-f con 0x7f89b4136d00 addr v2:172.21.15.63:3300/0 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89b40a3d70 0x7f89b4137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): picked mon.noname-a con 0x7f89b40a3d70 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 --2- >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f89b41339e0 0x7f89b4133e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): picked mon.noname-i con 0x7f89b41339e0 addr [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:48.825 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b40a25b0 con 0x7f89b40a3d70 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b4137b60 con 0x7f89b4136d00 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 1 -- --> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f89b40a13f0 con 0x7f89b41339e0 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.824+0000 7f89ba7fd640 10 monclient(hunting): authenticate will time out at 991.131586s 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89b40a3d70 0x7f89b4137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.826 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89b40a3d70 0x7f89b4137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37234/0 (socket says 172.21.15.28:37234) 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 -- 172.21.15.28:0/3929404956 learned_addr learned my addr 172.21.15.28:0/3929404956 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): get_auth_request con 0x7f89b40a3d70 auth_method 0 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 1 --2- 172.21.15.28:0/3929404956 >> v2:172.21.15.63:3300/0 conn(0x7f89b4136d00 0x7f89b41370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 1 --2- 172.21.15.28:0/3929404956 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f89b41339e0 0x7f89b4133e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): get_auth_request con 0x7f89b4136d00 auth_method 0 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): get_auth_request con 0x7f89b41339e0 auth_method 0 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:48.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:48.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:48.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:48.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:48.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:48.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:48.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient(hunting): handle_auth_done global_id 34326 payload 274 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 -- 172.21.15.28:0/3929404956 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f89b41339e0 msgr2=0x7f89b4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 --2- 172.21.15.28:0/3929404956 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f89b41339e0 0x7f89b4133e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 -- 172.21.15.28:0/3929404956 >> v2:172.21.15.63:3300/0 conn(0x7f89b4136d00 msgr2=0x7f89b41370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 --2- 172.21.15.28:0/3929404956 >> v2:172.21.15.63:3300/0 conn(0x7f89b4136d00 0x7f89b41370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient: _finish_hunting 0 2024-03-27T21:32:48.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 monclient: found mon.noname-a 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.825+0000 7f89b37fe640 1 -- 172.21.15.28:0/3929404956 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40618f0 con 0x7f89b40a3d70 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b37fe640 1 --2- 172.21.15.28:0/3929404956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b40a3d70 0x7f89b4137620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89b40a5640 tx=0x7f89a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66b5f2c4cc062bc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 1 -- 172.21.15.28:0/3929404956 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f89a4031a50 con 0x7f89b40a3d70 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: dump: 2024-03-27T21:32:48.831 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:48.832 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:48.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: _finish_auth 0 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: _check_auth_tickets 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 1 -- 172.21.15.28:0/3929404956 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4031bd0 con 0x7f89b40a3d70 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 5 monclient: authenticate success, global_id 34326 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:48.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 1 -- 172.21.15.28:0/3929404956 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f89a4031d80 con 0x7f89b40a3d70 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 4 set_mon_vals no callback set 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89b2ffd640 10 monclient: dump: 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.835 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:48.836 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 10 monclient: shutdown 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3929404956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b40a3d70 msgr2=0x7f89b4137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3929404956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b40a3d70 0x7f89b4137620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89b40a5640 tx=0x7f89a402b880 comp rx=0 tx=0).stop 2024-03-27T21:32:48.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3929404956 shutdown_connections 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3929404956 >> [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] conn(0x7f89b41339e0 0x7f89b4133e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3929404956 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b40a3d70 0x7f89b4137620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3929404956 >> v2:172.21.15.63:3300/0 conn(0x7f89b4136d00 0x7f89b41370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3929404956 >> 172.21.15.28:0/3929404956 conn(0x7f89b40a9430 msgr2=0x7f89b40a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3929404956 shutdown_connections 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.826+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3929404956 wait complete. 2024-03-27T21:32:48.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.827+0000 7f89ba7fd640 10 monclient: build_initial_monmap 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.827+0000 7f89ba7fd640 10 monclient: monmap: 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:48.839 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:48.840 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.827+0000 7f89ba7fd640 1 librados: starting msgr at 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.827+0000 7f89ba7fd640 1 librados: starting objecter 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.827+0000 7f89ba7fd640 1 Processor -- start 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 -- start start 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 librados: setting wanted keys 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 librados: calling monclient init 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient: init 2024-03-27T21:32:48.841 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient: _add_conns ranks=[4,8,6,3,1,2,7,0,5] 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f89b40a3d70 0x7f89b41cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): picked mon.noname-c con 0x7f89b40a3d70 addr [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f89b41339e0 0x7f89b4132b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): picked mon.noname-e con 0x7f89b41339e0 addr [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 0x7f89b4133060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): picked mon.noname-d con 0x7f89b4136d00 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:48.842 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 -- --> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b411ff20 con 0x7f89b40a3d70 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f89b4120200 con 0x7f89b4136d00 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 1 -- --> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] -- mon_getmap magic: 0 v1 -- 0x7f89b41204e0 con 0x7f89b41339e0 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89ba7fd640 10 monclient(hunting): authenticate will time out at 991.135210s 2024-03-27T21:32:48.843 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 0x7f89b4133060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 1 --2- >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f89b41339e0 0x7f89b4132b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 1 --2- >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f89b40a3d70 0x7f89b41cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 0x7f89b4133060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:39678/0 (socket says 172.21.15.28:39678) 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 1 -- 172.21.15.28:0/3320706354 learned_addr learned my addr 172.21.15.28:0/3320706354 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): get_auth_request con 0x7f89b41339e0 auth_method 0 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:48.844 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): get_auth_request con 0x7f89b4136d00 auth_method 0 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): get_auth_request con 0x7f89b40a3d70 auth_method 0 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:48.845 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:48.846 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.828+0000 7f89b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 10 monclient(hunting): handle_auth_done global_id 4659 payload 824 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 -- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f89b41339e0 msgr2=0x7f89b4132b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f89b41339e0 0x7f89b4132b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 -- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f89b40a3d70 msgr2=0x7f89b41cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f89b40a3d70 0x7f89b41cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 10 monclient: _finish_hunting 0 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 monclient: found mon.noname-d 2024-03-27T21:32:48.847 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 -- 172.21.15.28:0/3320706354 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40094d0 con 0x7f89b4136d00 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b3fff640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f89b40a3d70 0x7f89b41cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b37fe640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f89b41339e0 0x7f89b4132b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b8d9a640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 0x7f89b4133060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00efc0 tx=0x7f89ac00c490 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 client.?.objecter ms_handle_connect 0x7f89b4136d00 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f89ac009b10 con 0x7f89b4136d00 2024-03-27T21:32:48.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: dump: 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.849 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:48.850 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: _finish_auth 0 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: _check_auth_tickets 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:48.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 5 monclient: authenticate success, global_id 4659 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac00f040 con 0x7f89b4136d00 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 10 monclient: _renew_subs 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b411fc40 con 0x7f89b4136d00 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f89ac014d60 con 0x7f89b4136d00 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 10 client.4659.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:48.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b27fc640 4 set_mon_vals no callback set 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89b0ff9640 10 monclient: dump: 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:48.853 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:48.854 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 10 monclient: _renew_subs 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b411f8a0 con 0x7f89b4136d00 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.829+0000 7f89ba7fd640 1 librados: init done 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mon.6 v2:172.21.15.28:3303/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f89ac00cd30 con 0x7f89b4136d00 2024-03-27T21:32:48.855 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f89a003a250 0x7f89a003c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89ba7fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mon.6 v2:172.21.15.28:3303/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f89ac04a930 con 0x7f89b4136d00 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89ba7fd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 10 client.4659.objecter ms_dispatch 0x7f89b4000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89ba7fd640 10 monclient: _send_mon_message to mon.d at v2:172.21.15.28:3303/0 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 3 client.4659.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 3 client.4659.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:48.856 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b40672e0 con 0x7f89b4136d00 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b0ff9640 20 client.4659.objecter dump_active .. 0 homeless 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b3fff640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f89a003a250 0x7f89a003c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.830+0000 7f89b3fff640 10 monclient: get_auth_request con 0x7f89a003a250 auth_method 0 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.831+0000 7f89b0ff9640 10 client.4659.objecter ms_handle_connect 0x7f89a003a250 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.831+0000 7f89b3fff640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f89a003a250 0x7f89a003c710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009e10 tx=0x7f89a8009190 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.835+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mon.6 v2:172.21.15.28:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f89ac018020 con 0x7f89b4136d00 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.835+0000 7f89b0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:48.857 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:48.835+0000 7f89b0ff9640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:49.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.012+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 --> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89b4120090 con 0x7f89a003a250 2024-03-27T21:32:49.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.015+0000 7f89b0ff9640 1 -- 172.21.15.28:0/3320706354 <== mgr.4132 v2:172.21.15.63:6824/33051 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+54281 (secure 0 0 0) 0x7f89b4120090 con 0x7f89a003a250 2024-03-27T21:32:49.003 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-27T21:32:49.004 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-27T21:32:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 10 librados: watch_flush enter 2024-03-27T21:32:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 10 librados: watch_flush exit 2024-03-27T21:32:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 20 client.4659.objecter shutdown clearing up homeless session... 2024-03-27T21:32:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 10 client.4659.objecter successfully canceled tick 2024-03-27T21:32:49.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f89a003a250 msgr2=0x7f89a003c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f89a003a250 0x7f89a003c710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89a8009e10 tx=0x7f89a8009190 comp rx=0 tx=0).stop 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 10 monclient: shutdown 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 msgr2=0x7f89b4133060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 0x7f89b4133060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00efc0 tx=0x7f89ac00c490 comp rx=0 tx=0).stop 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 shutdown_connections 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f89a003a250 0x7f89a003c710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f89b4136d00 0x7f89b4133060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] conn(0x7f89b41339e0 0x7f89b4132b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 --2- 172.21.15.28:0/3320706354 >> [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] conn(0x7f89b40a3d70 0x7f89b41cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 >> 172.21.15.28:0/3320706354 conn(0x7f89b40a9430 msgr2=0x7f89b40662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 shutdown_connections 2024-03-27T21:32:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 -- 172.21.15.28:0/3320706354 wait complete. 2024-03-27T21:32:49.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.017+0000 7f89ba7fd640 1 librados: shutdown 2024-03-27T21:32:49.015 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-03-27T21:32:48.661381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":168076,"kb_used_data":1876,"kb_used_omap":9,"kb_used_meta":166134,"kb_avail":566062964,"statfs":{"total":579820584960,"available":579648475136,"internally_reserved":0,"allocated":1921024,"data_stored":1313826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9562,"internal_metadata":170121894},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002490"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:38.589696+0000","last_change":"2024-03-27T21:32:38.589848+0000","last_active":"2024-03-27T21:32:38.589696+0000","last_peered":"2024-03-27T21:32:38.589696+0000","last_clean":"2024-03-27T21:32:38.589696+0000","last_became_active":"2024-03-27T21:30:21.225255+0000","last_became_peered":"2024-03-27T21:30:21.225255+0000","last_unstale":"2024-03-27T21:32:38.589696+0000","last_undegraded":"2024-03-27T21:32:38.589696+0000","last_fullsized":"2024-03-27T21:32:38.589696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:38.589662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:38.589662+0000","last_clean_scrub_stamp":"2024-03-27T21:32:38.589662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:26:41.405748+0000","scrub_duration":0.0014098839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:27.493082+0000","last_change":"2024-03-27T21:32:27.493082+0000","last_active":"2024-03-27T21:32:27.493082+0000","last_peered":"2024-03-27T21:32:27.493082+0000","last_clean":"2024-03-27T21:32:27.493082+0000","last_became_active":"2024-03-27T21:30:20.934100+0000","last_became_peered":"2024-03-27T21:30:20.934100+0000","last_unstale":"2024-03-27T21:32:27.493082+0000","last_undegraded":"2024-03-27T21:32:27.493082+0000","last_fullsized":"2024-03-27T21:32:27.493082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:27.492967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:27.492967+0000","last_clean_scrub_stamp":"2024-03-27T21:32:27.492967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T01:50:24.547971+0000","scrub_duration":0.0018117280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:37.587217+0000","last_change":"2024-03-27T21:32:37.587315+0000","last_active":"2024-03-27T21:32:37.587217+0000","last_peered":"2024-03-27T21:32:37.587217+0000","last_clean":"2024-03-27T21:32:37.587217+0000","last_became_active":"2024-03-27T21:30:20.931227+0000","last_became_peered":"2024-03-27T21:30:20.931227+0000","last_unstale":"2024-03-27T21:32:37.587217+0000","last_undegraded":"2024-03-27T21:32:37.587217+0000","last_fullsized":"2024-03-27T21:32:37.587217+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:37.587197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:37.587197+0000","last_clean_scrub_stamp":"2024-03-27T21:32:37.587197+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:23:51.760283+0000","scrub_duration":0.0018375310000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:28.471938+0000","last_change":"2024-03-27T21:32:28.471938+0000","last_active":"2024-03-27T21:32:28.471938+0000","last_peered":"2024-03-27T21:32:28.471938+0000","last_clean":"2024-03-27T21:32:28.471938+0000","last_became_active":"2024-03-27T21:30:20.935818+0000","last_became_peered":"2024-03-27T21:30:20.935818+0000","last_unstale":"2024-03-27T21:32:28.471938+0000","last_undegraded":"2024-03-27T21:32:28.471938+0000","last_fullsized":"2024-03-27T21:32:28.471938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:28.471819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:28.471819+0000","last_clean_scrub_stamp":"2024-03-27T21:32:28.471819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T02:53:46.511137+0000","scrub_duration":0.001349785,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:29.385971+0000","last_change":"2024-03-27T21:32:29.386053+0000","last_active":"2024-03-27T21:32:29.385971+0000","last_peered":"2024-03-27T21:32:29.385971+0000","last_clean":"2024-03-27T21:32:29.385971+0000","last_became_active":"2024-03-27T21:30:20.935301+0000","last_became_peered":"2024-03-27T21:30:20.935301+0000","last_unstale":"2024-03-27T21:32:29.385971+0000","last_undegraded":"2024-03-27T21:32:29.385971+0000","last_fullsized":"2024-03-27T21:32:29.385971+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:29.385952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:29.385952+0000","last_clean_scrub_stamp":"2024-03-27T21:32:29.385952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:33:18.136385+0000","scrub_duration":0.0016748189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:28.474003+0000","last_change":"2024-03-27T21:32:28.474099+0000","last_active":"2024-03-27T21:32:28.474003+0000","last_peered":"2024-03-27T21:32:28.474003+0000","last_clean":"2024-03-27T21:32:28.474003+0000","last_became_active":"2024-03-27T21:30:20.931488+0000","last_became_peered":"2024-03-27T21:30:20.931488+0000","last_unstale":"2024-03-27T21:32:28.474003+0000","last_undegraded":"2024-03-27T21:32:28.474003+0000","last_fullsized":"2024-03-27T21:32:28.474003+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:28.473985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:28.473985+0000","last_clean_scrub_stamp":"2024-03-27T21:32:28.473985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:52:26.562116+0000","scrub_duration":0.0010447970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:35.497248+0000","last_change":"2024-03-27T21:32:35.497390+0000","last_active":"2024-03-27T21:32:35.497248+0000","last_peered":"2024-03-27T21:32:35.497248+0000","last_clean":"2024-03-27T21:32:35.497248+0000","last_became_active":"2024-03-27T21:30:20.931904+0000","last_became_peered":"2024-03-27T21:30:20.931904+0000","last_unstale":"2024-03-27T21:32:35.497248+0000","last_undegraded":"2024-03-27T21:32:35.497248+0000","last_fullsized":"2024-03-27T21:32:35.497248+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:35.497226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:35.497226+0000","last_clean_scrub_stamp":"2024-03-27T21:32:35.497226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T01:07:23.506385+0000","scrub_duration":0.0019634140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:30.433465+0000","last_change":"2024-03-27T21:32:30.433580+0000","last_active":"2024-03-27T21:32:30.433465+0000","last_peered":"2024-03-27T21:32:30.433465+0000","last_clean":"2024-03-27T21:32:30.433465+0000","last_became_active":"2024-03-27T21:30:20.935317+0000","last_became_peered":"2024-03-27T21:30:20.935317+0000","last_unstale":"2024-03-27T21:32:30.433465+0000","last_undegraded":"2024-03-27T21:32:30.433465+0000","last_fullsized":"2024-03-27T21:32:30.433465+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T21:32:30.433443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T21:32:30.433443+0000","last_clean_scrub_stamp":"2024-03-27T21:32:30.433443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T03:47:17.914477+0000","scrub_duration":0.001855523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'119","reported_seq":176,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-27T21:32:30.491446+0000","last_change":"2024-03-27T21:32:30.491546+0000","last_active":"2024-03-27T21:32:30.491446+0000","last_peered":"2024-03-27T21:32:30.491446+0000","last_clean":"2024-03-27T21:32:30.491446+0000","last_became_active":"2024-03-27T21:30:19.890884+0000","last_became_peered":"2024-03-27T21:30:19.890884+0000","last_unstale":"2024-03-27T21:32:30.491446+0000","last_undegraded":"2024-03-27T21:32:30.491446+0000","last_fullsized":"2024-03-27T21:32:30.491446+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'119","last_scrub_stamp":"2024-03-27T21:32:30.491423+0000","last_deep_scrub":"15'119","last_deep_scrub_stamp":"2024-03-27T21:32:30.491423+0000","last_clean_scrub_stamp":"2024-03-27T21:32:30.491423+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T07:27:16.019545+0000","scrub_duration":0.0046835999999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":4,"up_from":12,"seq":51539607585,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48099999999999998,"15min":0.47999999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.59899999999999998,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.47599999999999998,"15min":0.47699999999999998},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.58199999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.41699999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.47299999999999998,"15min":0.47099999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.47499999999999998,"15min":0.47899999999999998},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.53200000000000003,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.60699999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.57099999999999995,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.38800000000000001}]},{"osd":3,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.45400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.33700000000000002,"15min":0.33900000000000002},"min":{"1min":0.22800000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.45900000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36599999999999999}]},{"osd":5,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.34799999999999998,"15min":0.35199999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.42099999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36599999999999999,"15min":0.37},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.45100000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.40000000000000002}]}]},{"osd":3,"up_from":12,"seq":51539607584,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":675840,"data_stored":571767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58899999999999997,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46600000000000003},"min":{"1min":0.35199999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50700000000000001}]},{"osd":1,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46200000000000002,"15min":0.45900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61299999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46200000000000002,"15min":0.46100000000000002},"min":{"1min":0.374,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.499},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.47799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.374,"15min":0.38},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53300000000000003,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.56599999999999995,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34999999999999998}]},{"osd":5,"last update":"Wed Mar 27 21:32:23 2024","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.36799999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.51400000000000001,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.40500000000000003,"15min":0.41099999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.371}]}]},{"osd":5,"up_from":11,"seq":47244640288,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.47299999999999998,"15min":0.46999999999999997},"min":{"1min":0.39400000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.38900000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.53800000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.41299999999999998}]},{"osd":1,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.38100000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.56999999999999995,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.48699999999999999,"15min":0.49099999999999999},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.61499999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48199999999999998,"15min":0.48499999999999999},"min":{"1min":0.36499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.57199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.41399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.71999999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47599999999999998}]},{"osd":3,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.502,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.433}]},{"osd":4,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.27800000000000002,"5min":0.254,"15min":0.254},"max":{"1min":0.42799999999999999,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.37,"15min":0.374},"min":{"1min":0.28799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.45300000000000001,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.51000000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640287,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31252,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340588,"statfs":{"total":96636764160,"available":96604762112,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.436,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35299999999999998},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.50600000000000001,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.32900000000000001}]},{"osd":1,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.47799999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.27600000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.46200000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.47199999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.44900000000000001}]},{"osd":4,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.37,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.5},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.46700000000000003}]},{"osd":5,"last update":"Wed Mar 27 21:32:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65100000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.38200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.432}]}]},{"osd":1,"up_from":11,"seq":47244640288,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":143360,"data_stored":42839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33000000000000002},"min":{"1min":0.25600000000000001,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.32400000000000001}]},{"osd":3,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.46100000000000002,"15min":0.45700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.46500000000000002},"min":{"1min":0.374,"5min":0.318,"15min":0.318},"max":{"1min":0.65800000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.46400000000000002,"15min":0.45800000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64100000000000001,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Mar 27 21:32:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.64100000000000001,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.58399999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640287,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27672,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344168,"statfs":{"total":96636764160,"available":96608428032,"internally_reserved":0,"allocated":671744,"data_stored":570703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.23499999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.52800000000000002,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.40400000000000003}]},{"osd":2,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.39700000000000002,"15min":0.39800000000000002},"min":{"1min":0.29999999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.45600000000000002}]},{"osd":3,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48699999999999999},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.61099999999999999,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.754},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66100000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.63700000000000001,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48199999999999998,"15min":0.48399999999999999},"min":{"1min":0.375,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.79800000000000004}]},{"osd":5,"last update":"Wed Mar 27 21:32:24 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79500000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.49299999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.73899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.89200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T21:32:49.017 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-27T21:32:49.117 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.129+0000 7f023758b640 10 monclient: get_monmap_and_config 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.129+0000 7f023758b640 10 monclient: build_initial_monmap 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.129+0000 7f023758b640 10 monclient: monmap: 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:32:49.130293+0000 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:32:49.130293+0000 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:49.118 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:0: v1:172.21.15.28:6789/0 mon.noname-a-legacy 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:1: v1:172.21.15.63:6789/0 mon.noname-f-legacy 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:49.119 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:49.120 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:49.120 INFO:teuthology.orchestra.run.smithi028.stderr:9: v2:172.21.15.28:3300/0 mon.noname-a 2024-03-27T21:32:49.120 INFO:teuthology.orchestra.run.smithi028.stderr:10: v2:172.21.15.63:3300/0 mon.noname-f 2024-03-27T21:32:49.120 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:49.120 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 Processor -- start 2024-03-27T21:32:49.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 -- start start 2024-03-27T21:32:49.129 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient: init 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient: _add_conns ranks=[2,6,9,4,1,3,10,5,8,0,7] 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 --2- >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0230136d00 0x7f02301370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): picked mon.noname-b con 0x7f0230136d00 addr [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 0x7f0230137620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): picked mon.noname-d con 0x7f02300a3d70 addr [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 0x7f0230133e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): picked mon.noname-a con 0x7f02301339e0 addr v2:172.21.15.28:3300/0 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300a25b0 con 0x7f02301339e0 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 -- --> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0230137b60 con 0x7f0230136d00 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 1 -- --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a13f0 con 0x7f02300a3d70 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:49.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f023758b640 10 monclient(hunting): authenticate will time out at 991.437436s 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 0x7f0230133e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0234b26640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 0x7f0230137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 0x7f0230133e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37250/0 (socket says 172.21.15.28:37250) 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 1 -- 172.21.15.28:0/3059271698 learned_addr learned my addr 172.21.15.28:0/3059271698 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0234b26640 1 --2- >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 0x7f0230137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3303/0 says I am v2:172.21.15.28:39688/0 (socket says 172.21.15.28:39688) 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 10 monclient(hunting): get_auth_request con 0x7f02301339e0 auth_method 0 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:49.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235327640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0230136d00 0x7f02301370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0234b26640 10 monclient(hunting): get_auth_request con 0x7f02300a3d70 auth_method 0 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0234b26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0234b26640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0234b26640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235327640 10 monclient(hunting): get_auth_request con 0x7f0230136d00 auth_method 0 2024-03-27T21:32:49.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235327640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235327640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235327640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.130+0000 7f0235b28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0235b28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:49.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0235327640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0235327640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0235327640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 10 monclient(hunting): handle_auth_done global_id 4668 payload 274 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 -- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0230136d00 msgr2=0x7f02301370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0230136d00 0x7f02301370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 -- 172.21.15.28:0/3059271698 >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 msgr2=0x7f0230133e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T21:32:49.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 --2- 172.21.15.28:0/3059271698 >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 0x7f0230133e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 10 monclient: _finish_hunting 0 2024-03-27T21:32:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 monclient: found mon.noname-d 2024-03-27T21:32:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 10 monclient: _send_mon_message to mon.noname-d at v2:172.21.15.28:3303/0 2024-03-27T21:32:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 -- 172.21.15.28:0/3059271698 --> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300618f0 con 0x7f02300a3d70 2024-03-27T21:32:49.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0235b28640 1 --2- 172.21.15.28:0/3059271698 >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 0x7f0230133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0235327640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0230136d00 0x7f02301370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.131+0000 7f0234b26640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 0x7f0230137620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02200097a0 tx=0x7f022002b6f0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=cf73869b15499f16 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 1 -- 172.21.15.28:0/3059271698 <== mon.6 v2:172.21.15.28:3303/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0220030980 con 0x7f02300a3d70 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: dump: 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:49.137 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:49.138 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: _finish_auth 0 2024-03-27T21:32:49.139 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: _check_auth_tickets 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 1 -- 172.21.15.28:0/3059271698 <== mon.6 v2:172.21.15.28:3303/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022002e050 con 0x7f02300a3d70 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 5 monclient: authenticate success, global_id 4668 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 10 monclient: get_monmap_and_config success 2024-03-27T21:32:49.140 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 1 -- 172.21.15.28:0/3059271698 <== mon.6 v2:172.21.15.28:3303/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f02200313a0 con 0x7f02300a3d70 2024-03-27T21:32:49.141 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:49.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 4 set_mon_vals no callback set 2024-03-27T21:32:49.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-03-27T21:32:49.142 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f0227fff640 10 monclient: dump: 2024-03-27T21:32:49.142 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:49.142 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:49.142 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.143 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.143 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:49.143 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:49.143 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:49.143 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:49.144 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:49.144 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:49.144 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:49.144 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:49.144 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:49.145 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:49.145 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:49.145 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:49.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 10 monclient: shutdown 2024-03-27T21:32:49.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:49.145 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 -- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 msgr2=0x7f0230137620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 0x7f0230137620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f02200097a0 tx=0x7f022002b6f0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 -- 172.21.15.28:0/3059271698 shutdown_connections 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 --2- 172.21.15.28:0/3059271698 >> v2:172.21.15.28:3300/0 conn(0x7f02301339e0 0x7f0230133e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] conn(0x7f02300a3d70 0x7f0230137620 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 --2- 172.21.15.28:0/3059271698 >> [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] conn(0x7f0230136d00 0x7f02301370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 -- 172.21.15.28:0/3059271698 >> 172.21.15.28:0/3059271698 conn(0x7f02300a9430 msgr2=0x7f02300a9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 -- 172.21.15.28:0/3059271698 shutdown_connections 2024-03-27T21:32:49.146 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.132+0000 7f023758b640 1 -- 172.21.15.28:0/3059271698 wait complete. 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 10 monclient: build_initial_monmap 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 10 monclient: monmap: 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 0 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 0.000000 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:created 0.000000 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 0 (unknown) 2024-03-27T21:32:49.147 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 1 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.noname-a 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.noname-f 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.noname-b 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.noname-g 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.noname-c 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.noname-h 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.noname-d 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.noname-i 2024-03-27T21:32:49.148 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.noname-e 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 1 librados: starting msgr at 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 1 librados: starting objecter 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 1 Processor -- start 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 1 -- start start 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 1 librados: setting wanted keys 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 1 librados: calling monclient init 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.133+0000 7f023758b640 10 monclient: init 2024-03-27T21:32:49.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient: _reopen_session rank -1 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient: _add_conns ranks=[0,5,1,7,2,4,6,3,8] 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 0x7f02301cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): picked mon.noname-a con 0x7f02300a3d70 addr [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 --2- >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f02301339e0 0x7f0230132bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): picked mon.noname-h con 0x7f02301339e0 addr [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230136d00 0x7f02301330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): picked mon.noname-f con 0x7f0230136d00 addr [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] 2024-03-27T21:32:49.150 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230120600 con 0x7f02300a3d70 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a1630 con 0x7f0230136d00 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): start opening mon connection 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 -- --> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02300a11e0 con 0x7f02301339e0 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): _renew_subs 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient(hunting): authenticate will time out at 991.440839s 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 0x7f02301cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:49.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 0x7f02301cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:37256/0 (socket says 172.21.15.28:37256) 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 -- 172.21.15.28:0/58014494 learned_addr learned my addr 172.21.15.28:0/58014494 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): get_auth_request con 0x7f02300a3d70 auth_method 0 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): _init_auth method 2 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): _init_auth creating new auth 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-27T21:32:49.152 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient(hunting): handle_auth_done global_id 34344 payload 824 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 -- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f02301339e0 msgr2=0x7f0230132bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f02301339e0 0x7f0230132bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 -- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230136d00 msgr2=0x7f02301330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230136d00 0x7f02301330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient: _finish_hunting 0 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 monclient: found mon.noname-a 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.28:3300/0 2024-03-27T21:32:49.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 -- 172.21.15.28:0/58014494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009b30 con 0x7f02300a3d70 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0235327640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 0x7f02301cb250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f022c00e960 tx=0x7f022c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 client.?.objecter ms_handle_connect 0x7f02300a3d70 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 client.?.objecter resend_mon_ops 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f022c00cdf0 con 0x7f02300a3d70 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-27T21:32:49.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: dump: 2024-03-27T21:32:49.155 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:49.155 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:49.155 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.156 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.156 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:49.156 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:49.156 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:49.157 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:49.157 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:49.157 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:49.157 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:49.157 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:49.158 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:49.158 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:49.158 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:49.158 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:49.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: _finish_auth 0 2024-03-27T21:32:49.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: _check_auth_tickets 2024-03-27T21:32:49.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-03-27T21:32:49.159 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 5 monclient: authenticate success, global_id 34344 2024-03-27T21:32:49.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c013470 con 0x7f02300a3d70 2024-03-27T21:32:49.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-27T21:32:49.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient: _renew_subs 2024-03-27T21:32:49.160 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 1037+0+0 (secure 0 0 0) 0x7f022c013a50 con 0x7f02300a3d70 2024-03-27T21:32:49.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:49.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c009400 con 0x7f02300a3d70 2024-03-27T21:32:49.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-27T21:32:49.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-27T21:32:49.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f02277fe640 4 set_mon_vals no callback set 2024-03-27T21:32:49.161 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.134+0000 7f0225ffb640 10 monclient: dump: 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:epoch 1 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:fsid 4104f5c5-b145-4d95-98f1-cb5df7cc2f83 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:last_changed 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:created 2024-03-27T21:29:39.649723+0000 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:min_mon_release 18 (reef) 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:election_strategy: 3 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-27T21:32:49.162 INFO:teuthology.orchestra.run.smithi028.stderr:1: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.f 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:2: [v2:172.21.15.28:3301/0,v1:172.21.15.28:6790/0] mon.b 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:3: [v2:172.21.15.63:3301/0,v1:172.21.15.63:6790/0] mon.g 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:4: [v2:172.21.15.28:3302/0,v1:172.21.15.28:6791/0] mon.c 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:5: [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] mon.h 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:6: [v2:172.21.15.28:3303/0,v1:172.21.15.28:6792/0] mon.d 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:7: [v2:172.21.15.63:3303/0,v1:172.21.15.63:6792/0] mon.i 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr:8: [v2:172.21.15.28:3304/0,v1:172.21.15.28:6793/0] mon.e 2024-03-27T21:32:49.163 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f023758b640 10 client.34344.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f023758b640 10 monclient: _renew_subs 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f023758b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0220009400 con 0x7f02300a3d70 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f023758b640 1 librados: init done 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 44809+0+0 (secure 0 0 0) 0x7f022c013bb0 con 0x7f02300a3d70 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f0225ffb640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f021403a250 0x7f021403c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T21:32:49.164 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4346+0+0 (secure 0 0 0) 0x7f022c04a3b0 con 0x7f02300a3d70 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f0225ffb640 10 client.34344.objecter ms_dispatch 0x7f0230000b90 osd_map(15..15 src has 1..15) v4 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f0225ffb640 3 client.34344.objecter handle_osd_map got epochs [15,15] > 0 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.135+0000 7f0225ffb640 3 client.34344.objecter handle_osd_map decoding full epoch 15 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f0225ffb640 20 client.34344.objecter dump_active .. 0 homeless 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f023758b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f023758b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f0234b26640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f021403a250 0x7f021403c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f023758b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:49.165 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02300672e0 con 0x7f02300a3d70 2024-03-27T21:32:49.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f0234b26640 10 monclient: get_auth_request con 0x7f021403a250 auth_method 0 2024-03-27T21:32:49.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f0225ffb640 10 client.34344.objecter ms_handle_connect 0x7f021403a250 2024-03-27T21:32:49.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.136+0000 7f0234b26640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f021403a250 0x7f021403c710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0220034000 tx=0x7f022002f000 comp rx=0 tx=0).ready entity=mgr.4132 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T21:32:49.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.141+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181614 (secure 0 0 0) 0x7f022c017080 con 0x7f02300a3d70 2024-03-27T21:32:49.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.141+0000 7f0225ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-03-27T21:32:49.166 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.141+0000 7f0225ffb640 10 monclient: _finish_command 1 = system:0 2024-03-27T21:32:49.308 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.320+0000 7f023758b640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-03-27T21:32:49.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.320+0000 7f023758b640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-03-27T21:32:49.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.320+0000 7f023758b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.28:3300/0 2024-03-27T21:32:49.309 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.320+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f0230074b30 con 0x7f02300a3d70 2024-03-27T21:32:49.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.325+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f022c01b3b0 con 0x7f02300a3d70 2024-03-27T21:32:49.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.325+0000 7f0225ffb640 10 monclient: handle_config config(1 keys) v1 2024-03-27T21:32:49.313 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.325+0000 7f02277fe640 4 set_mon_vals no callback set 2024-03-27T21:32:49.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.325+0000 7f02277fe640 10 set_mon_vals mon_health_to_clog = false 2024-03-27T21:32:49.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.326+0000 7f0225ffb640 1 -- 172.21.15.28:0/58014494 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7f022c011d20 con 0x7f02300a3d70 2024-03-27T21:32:49.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.326+0000 7f0225ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-03-27T21:32:49.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.326+0000 7f0225ffb640 10 monclient: _finish_command 2 = system:0 2024-03-27T21:32:49.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 10 librados: watch_flush enter 2024-03-27T21:32:49.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 10 librados: watch_flush exit 2024-03-27T21:32:49.317 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 20 client.34344.objecter shutdown clearing up homeless session... 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 10 client.34344.objecter successfully canceled tick 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f021403a250 msgr2=0x7f021403c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f021403a250 0x7f021403c710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0220034000 tx=0x7f022002f000 comp rx=0 tx=0).stop 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 10 monclient: shutdown 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 20 monclient: shutdown discarding 0 pending message(s) 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 msgr2=0x7f02301cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T21:32:49.318 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 0x7f02301cb250 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f022c00e960 tx=0x7f022c00ee20 comp rx=0 tx=0).stop 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 shutdown_connections 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:6824/33051,v1:172.21.15.63:6825/33051] conn(0x7f021403a250 0x7f021403c710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:3302/0,v1:172.21.15.63:6791/0] conn(0x7f02301339e0 0x7f0230132bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0230136d00 0x7f02301330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 --2- 172.21.15.28:0/58014494 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f02300a3d70 0x7f02301cb250 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.328+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 >> 172.21.15.28:0/58014494 conn(0x7f02300a9430 msgr2=0x7f02300662c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.329+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 shutdown_connections 2024-03-27T21:32:49.319 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.329+0000 7f023758b640 1 -- 172.21.15.28:0/58014494 wait complete. 2024-03-27T21:32:49.320 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-27T21:32:49.329+0000 7f023758b640 1 librados: shutdown 2024-03-27T21:32:49.327 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-27T21:32:49.327 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-27T21:32:49.327 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-27T21:32:49.327 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.368 INFO:tasks.ceph.osd.0:Stopped 2024-03-27T21:32:49.369 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-27T21:32:49.369 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.433 INFO:tasks.ceph.osd.1:Stopped 2024-03-27T21:32:49.434 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-27T21:32:49.434 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.497 INFO:tasks.ceph.osd.2:Stopped 2024-03-27T21:32:49.498 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-27T21:32:49.498 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.527 INFO:tasks.ceph.osd.3:Stopped 2024-03-27T21:32:49.527 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-27T21:32:49.527 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.608 INFO:tasks.ceph.osd.4:Stopped 2024-03-27T21:32:49.608 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-27T21:32:49.608 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.676 INFO:tasks.ceph.osd.5:Stopped 2024-03-27T21:32:49.677 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-27T21:32:49.677 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-27T21:32:49.677 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.744 INFO:tasks.ceph.mgr.x:Stopped 2024-03-27T21:32:49.744 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-27T21:32:49.745 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-27T21:32:49.745 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.756 INFO:tasks.ceph.mon.a:Stopped 2024-03-27T21:32:49.756 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-27T21:32:49.756 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.807 INFO:tasks.ceph.mon.b:Stopped 2024-03-27T21:32:49.807 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-27T21:32:49.807 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.858 INFO:tasks.ceph.mon.c:Stopped 2024-03-27T21:32:49.859 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-03-27T21:32:49.859 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.910 INFO:tasks.ceph.mon.d:Stopped 2024-03-27T21:32:49.910 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-03-27T21:32:49.910 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.960 INFO:tasks.ceph.mon.e:Stopped 2024-03-27T21:32:49.961 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-03-27T21:32:49.961 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:49.974 INFO:tasks.ceph.mon.f:Stopped 2024-03-27T21:32:49.974 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-03-27T21:32:49.975 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:50.028 INFO:tasks.ceph.mon.g:Stopped 2024-03-27T21:32:50.029 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-03-27T21:32:50.029 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:50.081 INFO:tasks.ceph.mon.h:Stopped 2024-03-27T21:32:50.082 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-03-27T21:32:50.082 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T21:32:50.134 INFO:tasks.ceph.mon.i:Stopped 2024-03-27T21:32:50.134 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-27T21:32:50.135 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'slow request' | head -n 1 2024-03-27T21:32:50.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e is failed for ~0s 2024-03-27T21:32:50.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.f is failed for ~0s 2024-03-27T21:32:50.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.g is failed for ~0s 2024-03-27T21:32:50.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.h is failed for ~0s 2024-03-27T21:32:50.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i is failed for ~0s 2024-03-27T21:32:50.171 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:32:50.172 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-27T21:32:50.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:32:50.365 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-27T21:32:50.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:32:50.431 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-27T21:32:50.511 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:32:50.512 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-27T21:32:50.727 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:32:50.728 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-27T21:32:50.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:32:50.817 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-27T21:32:50.874 INFO:tasks.ceph:Archiving mon data... 2024-03-27T21:32:50.876 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.a.tgz 2024-03-27T21:32:50.877 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-27T21:32:50.893 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.aguyO68gEo 2024-03-27T21:32:50.894 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.aguyO68gEo 2024-03-27T21:32:51.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.aguyO68gEo 2024-03-27T21:32:51.100 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.aguyO68gEo is 208KB 2024-03-27T21:32:51.194 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.aguyO68gEo 2024-03-27T21:32:51.208 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.b.tgz 2024-03-27T21:32:51.209 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-27T21:32:51.263 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.y1hzcdJUYi 2024-03-27T21:32:51.263 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.y1hzcdJUYi 2024-03-27T21:32:51.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.y1hzcdJUYi 2024-03-27T21:32:51.452 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.y1hzcdJUYi is 209KB 2024-03-27T21:32:51.546 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.y1hzcdJUYi 2024-03-27T21:32:51.561 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.c.tgz 2024-03-27T21:32:51.561 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-27T21:32:51.615 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.045DvGLk1K 2024-03-27T21:32:51.616 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.045DvGLk1K 2024-03-27T21:32:51.718 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.045DvGLk1K 2024-03-27T21:32:51.802 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.045DvGLk1K is 208KB 2024-03-27T21:32:51.896 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.045DvGLk1K 2024-03-27T21:32:51.911 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.d.tgz 2024-03-27T21:32:51.911 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-27T21:32:51.964 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.CfV7pDdy51 2024-03-27T21:32:51.965 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.CfV7pDdy51 2024-03-27T21:32:52.067 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.CfV7pDdy51 2024-03-27T21:32:52.152 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.CfV7pDdy51 is 209KB 2024-03-27T21:32:52.246 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.CfV7pDdy51 2024-03-27T21:32:52.260 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.e.tgz 2024-03-27T21:32:52.260 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-27T21:32:52.314 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.v2g7e4u8ir 2024-03-27T21:32:52.315 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.v2g7e4u8ir 2024-03-27T21:32:52.417 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.v2g7e4u8ir 2024-03-27T21:32:52.501 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.v2g7e4u8ir is 209KB 2024-03-27T21:32:52.594 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.v2g7e4u8ir 2024-03-27T21:32:52.608 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.f.tgz 2024-03-27T21:32:52.608 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-03-27T21:32:52.626 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.BqKaC7QLSj 2024-03-27T21:32:52.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.BqKaC7QLSj 2024-03-27T21:32:52.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.BqKaC7QLSj 2024-03-27T21:32:52.829 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.BqKaC7QLSj is 209KB 2024-03-27T21:32:52.927 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.BqKaC7QLSj 2024-03-27T21:32:52.943 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.g.tgz 2024-03-27T21:32:52.943 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-03-27T21:32:52.998 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.jIIxV3Lkh5 2024-03-27T21:32:52.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.jIIxV3Lkh5 2024-03-27T21:32:53.101 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.jIIxV3Lkh5 2024-03-27T21:32:53.185 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.jIIxV3Lkh5 is 209KB 2024-03-27T21:32:53.277 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.jIIxV3Lkh5 2024-03-27T21:32:53.291 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.h.tgz 2024-03-27T21:32:53.291 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-03-27T21:32:53.345 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.yi28SmrkQc 2024-03-27T21:32:53.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.yi28SmrkQc 2024-03-27T21:32:53.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.yi28SmrkQc 2024-03-27T21:32:53.528 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.yi28SmrkQc is 209KB 2024-03-27T21:32:53.622 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.yi28SmrkQc 2024-03-27T21:32:53.636 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/data/mon.i.tgz 2024-03-27T21:32:53.636 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-03-27T21:32:53.690 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.h3lvg7Ysfl 2024-03-27T21:32:53.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.h3lvg7Ysfl 2024-03-27T21:32:53.792 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.h3lvg7Ysfl 2024-03-27T21:32:53.876 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.h3lvg7Ysfl is 209KB 2024-03-27T21:32:53.970 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.h3lvg7Ysfl 2024-03-27T21:32:53.984 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-27T21:32:53.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-27T21:32:53.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-27T21:32:54.051 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-03-27T21:32:54.051 DEBUG:teuthology.orchestra.run.smithi028:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-27T21:32:54.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-27T21:32:54.088 INFO:teuthology.orchestra.run.smithi028.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-27T21:32:54.119 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-27T21:32:54.123 INFO:tasks.ceph:Archiving crash dumps... 2024-03-27T21:32:54.125 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/remote/smithi028/crash 2024-03-27T21:32:54.126 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-27T21:32:54.161 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/remote/smithi063/crash 2024-03-27T21:32:54.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-27T21:32:54.189 INFO:tasks.ceph:Compressing logs... 2024-03-27T21:32:54.189 DEBUG:teuthology.orchestra.run.smithi028:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T21:32:54.206 DEBUG:teuthology.orchestra.run.smithi063:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T21:32:55.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e has been restored 2024-03-27T21:32:55.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.f has been restored 2024-03-27T21:32:55.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.g has been restored 2024-03-27T21:32:55.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.h has been restored 2024-03-27T21:32:55.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i has been restored 2024-03-27T21:32:56.144 INFO:tasks.ceph:Archiving logs... 2024-03-27T21:32:56.144 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/remote/smithi028/log 2024-03-27T21:32:56.145 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T21:32:56.385 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/remote/smithi063/log 2024-03-27T21:32:56.385 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T21:32:56.610 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-27T21:32:56.619 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-27T21:32:56.620 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T21:32:56.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T21:32:56.713 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-27T21:32:56.722 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-27T21:32:56.722 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T21:32:56.725 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T21:32:56.739 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2024-03-27T21:32:56.739 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-03-27T21:32:56.743 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T21:32:56.743 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-03-27T21:32:56.743 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 61 +338us[ +338us] +/- 77ms 2024-03-27T21:32:56.743 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv02.front.sepia.ceph.com 3 6 377 62 -276us[ -277us] +/- 60ms 2024-03-27T21:32:56.744 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 -3285ns[-4169ns] +/- 61ms 2024-03-27T21:32:56.744 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:32:56.744 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T21:32:56.744 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-03-27T21:32:56.744 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 62 +353us[ +353us] +/- 77ms 2024-03-27T21:32:56.744 INFO:teuthology.orchestra.run.smithi028.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -279us[ -278us] +/- 60ms 2024-03-27T21:32:56.745 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 62 +4036ns[+4036ns] +/- 61ms 2024-03-27T21:32:56.745 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:32:56.746 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-27T21:32:56.755 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-27T21:32:56.755 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-27T21:32:56.785 DEBUG:teuthology.orchestra.run.smithi028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T21:32:56.860 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T21:32:56.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-27T21:32:56.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:32:56.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-27T21:32:56.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:32:56.987 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-27T21:32:56.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-27T21:32:57.036 INFO:teuthology.task.internal:Duration was 610.942273 seconds 2024-03-27T21:32:57.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-27T21:32:57.114 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-27T21:32:57.115 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T21:32:57.117 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T21:32:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T21:32:57.162 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T21:32:57.446 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-27T21:32:57.446 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-03-27T21:32:57.446 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T21:32:57.469 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-03-27T21:32:57.469 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T21:32:57.509 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-27T21:32:57.509 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T21:32:57.512 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T21:32:57.576 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-27T21:32:57.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T21:32:57.583 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T21:32:57.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-27T21:32:57.723 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-27T21:32:57.724 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T21:32:57.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T21:32:57.777 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-27T21:32:57.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:32:57.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:32:57.816 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-03-27T21:32:57.842 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-03-27T21:32:57.876 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:32:57.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:32:57.890 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:32:57.929 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:32:57.930 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-27T21:32:57.941 INFO:teuthology.task.internal:Transferring archived files... 2024-03-27T21:32:57.942 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/remote/smithi028 2024-03-27T21:32:57.942 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T21:32:57.979 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525/remote/smithi063 2024-03-27T21:32:57.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T21:32:58.016 INFO:teuthology.task.internal:Removing archive directory... 2024-03-27T21:32:58.016 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T21:32:58.018 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T21:32:58.065 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-27T21:32:58.082 INFO:teuthology.task.internal:Not uploading archives. 2024-03-27T21:32:58.083 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-27T21:32:58.114 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-27T21:32:58.114 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T21:32:58.116 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T21:32:58.128 INFO:teuthology.orchestra.run.smithi028.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest 2024-03-27T21:32:58.215 INFO:teuthology.orchestra.run.smithi063.stdout: 265763 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest 2024-03-27T21:32:58.215 INFO:teuthology.orchestra.run.smithi063.stdout: 277141 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:30 /home/ubuntu/cephtest/mnt.0 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:30 /home/ubuntu/cephtest/mnt.0/client.0 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277143 4 drwxr-xr-x 26 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 278313 4 -rwxr-xr-x 1 ubuntu ubuntu 2777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/make-debs.sh 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277339 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277357 4 -rw-r--r-- 1 ubuntu ubuntu 1209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mds.postinst 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277356 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mds.install 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277403 4 -rw-r--r-- 1 ubuntu ubuntu 3 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/compat 2024-03-27T21:32:58.216 INFO:teuthology.orchestra.run.smithi063.stdout: 277433 4 -rw-r--r-- 1 ubuntu ubuntu 260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/radosgw.prerm 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277427 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/python3-rbd.install 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277432 4 -rw-r--r-- 1 ubuntu ubuntu 1626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/radosgw.postinst 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277411 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/librados2.install 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277365 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-dashboard.prerm 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277362 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-cephadm.requires 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277368 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-diskprediction-local.install 2024-03-27T21:32:58.217 INFO:teuthology.orchestra.run.smithi063.stdout: 277410 4 -rw-r--r-- 1 ubuntu ubuntu 165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/librados-dev.install 2024-03-27T21:32:58.218 INFO:teuthology.orchestra.run.smithi063.stdout: 277392 4 -rw-r--r-- 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-prometheus-alerts.install 2024-03-27T21:32:58.218 INFO:teuthology.orchestra.run.smithi063.stdout: 277404 48 -rw-r--r-- 1 ubuntu ubuntu 45190 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/control 2024-03-27T21:32:58.218 INFO:teuthology.orchestra.run.smithi063.stdout: 277359 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-cephadm.install 2024-03-27T21:32:58.218 INFO:teuthology.orchestra.run.smithi063.stdout: 277389 4 -rwxr-xr-x 1 ubuntu ubuntu 528 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-osd.install 2024-03-27T21:32:58.218 INFO:teuthology.orchestra.run.smithi063.stdout: 277391 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-osd.prerm 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277414 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libradosstriper1.install 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277394 4 -rw-r--r-- 1 ubuntu ubuntu 546 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-test.install 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277435 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/rbd-mirror.install 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277360 4 -rw-r--r-- 1 ubuntu ubuntu 997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-cephadm.postinst 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277396 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/cephadm.install 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277418 4 -rw-r--r-- 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/librgw2.install 2024-03-27T21:32:58.219 INFO:teuthology.orchestra.run.smithi063.stdout: 277353 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-grafana-dashboards.install 2024-03-27T21:32:58.220 INFO:teuthology.orchestra.run.smithi063.stdout: 277367 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-diskprediction-cloud.prerm 2024-03-27T21:32:58.220 INFO:teuthology.orchestra.run.smithi063.stdout: 277387 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mon.prerm 2024-03-27T21:32:58.220 INFO:teuthology.orchestra.run.smithi063.stdout: 277422 4 -rw-r--r-- 1 ubuntu ubuntu 126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/py3dist-overrides 2024-03-27T21:32:58.220 INFO:teuthology.orchestra.run.smithi063.stdout: 277370 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-diskprediction-local.prerm 2024-03-27T21:32:58.221 INFO:teuthology.orchestra.run.smithi063.stdout: 277429 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/rados-objclass-dev.install 2024-03-27T21:32:58.221 INFO:teuthology.orchestra.run.smithi063.stdout: 277390 4 -rw-r--r-- 1 ubuntu ubuntu 1137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-osd.postinst 2024-03-27T21:32:58.221 INFO:teuthology.orchestra.run.smithi063.stdout: 277355 4 -rw-r--r-- 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mds.dirs 2024-03-27T21:32:58.221 INFO:teuthology.orchestra.run.smithi063.stdout: 277413 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libradosstriper-dev.install 2024-03-27T21:32:58.221 INFO:teuthology.orchestra.run.smithi063.stdout: 277431 4 -rw-r--r-- 1 ubuntu ubuntu 296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/radosgw.install 2024-03-27T21:32:58.221 INFO:teuthology.orchestra.run.smithi063.stdout: 277393 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-resource-agents.install 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277376 4 -rw-r--r-- 1 ubuntu ubuntu 1012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-rook.postinst 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277408 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libcephfs-jni.install 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277428 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/python3-rgw.install 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277381 4 -rw-r--r-- 1 ubuntu ubuntu 1209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr.postinst 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277386 4 -rw-r--r-- 1 ubuntu ubuntu 1075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mon.postinst 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277405 40 -rw-r--r-- 1 ubuntu ubuntu 36891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/copyright 2024-03-27T21:32:58.222 INFO:teuthology.orchestra.run.smithi063.stdout: 277341 4 -rw-r--r-- 1 ubuntu ubuntu 231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-base.dirs 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277423 4 -rwxr-xr-x 1 ubuntu ubuntu 173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/python3-ceph-argparse.install 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277343 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-base.lintian-overrides 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277412 4 -rw-r--r-- 1 ubuntu ubuntu 244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libradospp-dev.install 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277379 4 -rw-r--r-- 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr.dirs 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277369 4 -rw-r--r-- 1 ubuntu ubuntu 1012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-diskprediction-local.postinst 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277345 4 -rw-r--r-- 1 ubuntu ubuntu 1702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-base.postinst 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277346 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-base.prerm 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277417 4 -rw-r--r-- 1 ubuntu ubuntu 74 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/librgw-dev.install 2024-03-27T21:32:58.223 INFO:teuthology.orchestra.run.smithi063.stdout: 277361 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-cephadm.prerm 2024-03-27T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stdout: 277424 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/python3-ceph-common.install 2024-03-27T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stdout: 277384 4 -rw-r--r-- 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mon.dirs 2024-03-27T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stdout: 277425 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/python3-cephfs.install 2024-03-27T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stdout: 277373 4 -rw-r--r-- 1 ubuntu ubuntu 777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-modules-core.install 2024-03-27T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stdout: 277434 4 -rw-r--r-- 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/rbd-fuse.install 2024-03-27T21:32:58.224 INFO:teuthology.orchestra.run.smithi063.stdout: 277350 4 -rw-r--r-- 1 ubuntu ubuntu 1263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-common.postrm 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277440 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/watch 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277352 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-fuse.install 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277398 4 -rw-r--r-- 1 ubuntu ubuntu 987 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/cephadm.postrm 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277401 4 -rw-r--r-- 1 ubuntu ubuntu 72 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/cephfs-top.install 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277349 4 -rw-r--r-- 1 ubuntu ubuntu 4086 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-common.postinst 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277372 4 -rw-r--r-- 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-k8sevents.requires 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277402 20 -rw-r--r-- 1 ubuntu ubuntu 18214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/changelog 2024-03-27T21:32:58.225 INFO:teuthology.orchestra.run.smithi063.stdout: 277377 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-rook.prerm 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277415 4 -rw-r--r-- 1 ubuntu ubuntu 118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/librbd-dev.install 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277406 4 -rw-r--r-- 1 ubuntu ubuntu 150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libcephfs-dev.install 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277354 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-immutable-object-cache.install 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277416 4 -rw-r--r-- 1 ubuntu ubuntu 65 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/librbd1.install 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277348 4 -rwxr-xr-x 1 ubuntu ubuntu 1386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-common.install 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277342 4 -rw-r--r-- 1 ubuntu ubuntu 632 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-base.install 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277364 4 -rw-r--r-- 1 ubuntu ubuntu 1001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-dashboard.postinst 2024-03-27T21:32:58.226 INFO:teuthology.orchestra.run.smithi063.stdout: 277363 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-dashboard.install 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277380 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr.install 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277430 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/radosgw.dirs 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277407 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libcephfs-java.jlibs 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277358 4 -rw-r--r-- 1 ubuntu ubuntu 259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mds.prerm 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277374 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-modules-core.requires 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277388 4 -rw-r--r-- 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-osd.dirs 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277419 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libsqlite3-mod-ceph-dev.install 2024-03-27T21:32:58.227 INFO:teuthology.orchestra.run.smithi063.stdout: 277426 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/python3-rados.install 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277395 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-volume.install 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277437 8 -rwxr-xr-x 1 ubuntu ubuntu 6427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/rules 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277375 4 -rw-r--r-- 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-rook.install 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277351 4 -rw-r--r-- 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-exporter.install 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277344 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-base.maintscript 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277397 4 -rw-r--r-- 1 ubuntu ubuntu 2039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/cephadm.postinst 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277340 4 -rw-r--r-- 1 ubuntu ubuntu 536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/.gitignore 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277378 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-rook.requires 2024-03-27T21:32:58.228 INFO:teuthology.orchestra.run.smithi063.stdout: 277399 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/cephfs-mirror.install 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277400 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/cephfs-shell.install 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277436 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/rbd-nbd.install 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277385 4 -rw-r--r-- 1 ubuntu ubuntu 103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mon.install 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277347 4 -rw-r--r-- 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-common.dirs 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277421 4 -rw-r--r-- 1 ubuntu ubuntu 2084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libsqlite3-mod-ceph.symbols 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277383 4 -rw-r--r-- 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr.requires 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277438 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/source 2024-03-27T21:32:58.229 INFO:teuthology.orchestra.run.smithi063.stdout: 277439 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/source/format 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277409 4 -rw-r--r-- 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libcephfs2.install 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277420 4 -rw-r--r-- 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/libsqlite3-mod-ceph.install 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277382 4 -rw-r--r-- 1 ubuntu ubuntu 259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr.prerm 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277371 4 -rw-r--r-- 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-diskprediction-local.requires 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277366 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/debian/ceph-mgr-dashboard.requires 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277216 8 -rw-r--r-- 1 ubuntu ubuntu 7652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/COPYING-LGPL3 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277201 8 -rw-r--r-- 1 ubuntu ubuntu 8116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.githubmap 2024-03-27T21:32:58.230 INFO:teuthology.orchestra.run.smithi063.stdout: 277221 8 -rw-r--r-- 1 ubuntu ubuntu 8181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/README.md 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278217 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/default 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278219 4 -rw-r--r-- 1 ubuntu ubuntu 159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/default/ceph 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/sysctl 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278224 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/sysctl/90-ceph-osd.conf.in 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278225 4 -rw-r--r-- 1 ubuntu ubuntu 300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/sysctl/CMakeLists.txt 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278223 4 -rw-r--r-- 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/sysctl/.gitignore 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/sysconfig 2024-03-27T21:32:58.231 INFO:teuthology.orchestra.run.smithi063.stdout: 278221 4 -rw-r--r-- 1 ubuntu ubuntu 559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/etc/sysconfig/ceph 2024-03-27T21:32:58.232 INFO:teuthology.orchestra.run.smithi063.stdout: 277206 52 -rw-r--r-- 1 ubuntu ubuntu 50723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.mailmap 2024-03-27T21:32:58.232 INFO:teuthology.orchestra.run.smithi063.stdout: 283281 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/share 2024-03-27T21:32:58.232 INFO:teuthology.orchestra.run.smithi063.stdout: 283284 4 -rw-r--r-- 1 ubuntu ubuntu 395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/share/known_hosts_drop.ceph.com 2024-03-27T21:32:58.232 INFO:teuthology.orchestra.run.smithi063.stdout: 283283 4 -rw-r--r-- 1 ubuntu ubuntu 413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/share/id_rsa_drop.ceph.com.pub 2024-03-27T21:32:58.232 INFO:teuthology.orchestra.run.smithi063.stdout: 283282 4 -rw-r--r-- 1 ubuntu ubuntu 1679 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/share/id_rsa_drop.ceph.com 2024-03-27T21:32:58.232 INFO:teuthology.orchestra.run.smithi063.stdout: 283285 4 -rw-r--r-- 1 ubuntu ubuntu 1002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/share/uncrustify.cfg 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 277237 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-erasure-code-corpus 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 277212 4 -rw-r--r-- 1 ubuntu ubuntu 631 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/CONTRIBUTING.rst 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 277214 20 -rw-r--r-- 1 ubuntu ubuntu 18092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/COPYING-GPL2 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 277218 28 -rw-r--r-- 1 ubuntu ubuntu 25726 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/PendingReleaseNotes 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 278314 8 -rwxr-xr-x 1 ubuntu ubuntu 7456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/make-dist 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 277210 4 -rw-r--r-- 1 ubuntu ubuntu 322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/AUTHORS 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 278226 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples 2024-03-27T21:32:58.233 INFO:teuthology.orchestra.run.smithi063.stdout: 278236 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rbd-replay 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278241 4 -rwxr-xr-x 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rbd-replay/trace 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278239 4 -rwxr-xr-x 1 ubuntu ubuntu 236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rbd-replay/replay 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278238 4 -rwxr-xr-x 1 ubuntu ubuntu 245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rbd-replay/create-image 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278237 4 -rw-r--r-- 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rbd-replay/.gitignore 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278240 4 -rwxr-xr-x 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rbd-replay/run-rbd-replay-prep 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278227 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librados 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278232 12 -rw-r--r-- 1 ubuntu ubuntu 9667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librados/hello_world_c.c 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278228 4 -rw-r--r-- 1 ubuntu ubuntu 1133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librados/Makefile 2024-03-27T21:32:58.234 INFO:teuthology.orchestra.run.smithi063.stdout: 278229 4 -rw-r--r-- 1 ubuntu ubuntu 2756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librados/hello_radosstriper.cc 2024-03-27T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stdout: 278231 4 -rw-r--r-- 1 ubuntu ubuntu 646 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librados/hello_world.readme 2024-03-27T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stdout: 278230 12 -rw-r--r-- 1 ubuntu ubuntu 9293 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librados/hello_world.cc 2024-03-27T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stdout: 278242 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw 2024-03-27T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stdout: 278254 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang 2024-03-27T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stdout: 278263 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/topic-creation 2024-03-27T21:32:58.235 INFO:teuthology.orchestra.run.smithi063.stdout: 278264 4 -rw-r--r-- 1 ubuntu ubuntu 771 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/topic-creation/README.md 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278265 4 -rw-r--r-- 1 ubuntu ubuntu 2133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/topic-creation/topic-creation.go 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278260 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/put-bucket-notification-creation 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278261 4 -rw-r--r-- 1 ubuntu ubuntu 1524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/put-bucket-notification-creation/README.md 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278262 4 -rw-r--r-- 1 ubuntu ubuntu 2465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/put-bucket-notification-creation/put-bucket-notification-creation.go 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278256 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/object-upload 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278257 4 -rw-r--r-- 1 ubuntu ubuntu 1024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/object-upload/README.md 2024-03-27T21:32:58.236 INFO:teuthology.orchestra.run.smithi063.stdout: 278259 4 -rw-r--r-- 1 ubuntu ubuntu 2187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/object-upload/object-upload.go 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278258 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/object-upload/fortuna.txt 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278255 4 -rw-r--r-- 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/golang/.gitignore 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278284 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278296 4 -rw-r--r-- 1 ubuntu ubuntu 2307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/storage_class.md 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278289 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/img 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278290 408 -rw-r--r-- 1 ubuntu ubuntu 414931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/img/prometheus.png 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278293 4 -rw-r--r-- 1 ubuntu ubuntu 685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/prometheus_adapter.lua 2024-03-27T21:32:58.237 INFO:teuthology.orchestra.run.smithi063.stdout: 278287 4 -rw-r--r-- 1 ubuntu ubuntu 3276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/elasticsearch_adapter.lua 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278295 4 -rw-r--r-- 1 ubuntu ubuntu 792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/storage_class.lua 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278292 4 -rw-r--r-- 1 ubuntu ubuntu 3178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/nats_adapter.md 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278294 4 -rw-r--r-- 1 ubuntu ubuntu 1850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/prometheus_adapter.md 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278285 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/config 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278286 4 -rw-r--r-- 1 ubuntu ubuntu 669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/config/prometheus.yml 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278291 4 -rw-r--r-- 1 ubuntu ubuntu 3874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/nats_adapter.lua 2024-03-27T21:32:58.238 INFO:teuthology.orchestra.run.smithi063.stdout: 278288 4 -rw-r--r-- 1 ubuntu ubuntu 1831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/lua/elasticsearch_adapter.md 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278297 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw-cache 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278298 8 -rw-r--r-- 1 ubuntu ubuntu 5205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw-cache/nginx-default.conf 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278301 8 -rw-r--r-- 1 ubuntu ubuntu 5232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw-cache/nginx-slicing.conf 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278300 4 -rw-r--r-- 1 ubuntu ubuntu 4018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw-cache/nginx-noprefetch.conf 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278299 4 -rw-r--r-- 1 ubuntu ubuntu 1161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw-cache/nginx-lua-file.lua 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278302 4 -rw-r--r-- 1 ubuntu ubuntu 1808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw-cache/nginx.conf 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278266 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278267 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload 2024-03-27T21:32:58.239 INFO:teuthology.orchestra.run.smithi063.stdout: 278268 4 -rw-r--r-- 1 ubuntu ubuntu 1040 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/README.md 2024-03-27T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stdout: 278269 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/ceph-s3-upload.txt 2024-03-27T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stdout: 278271 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src 2024-03-27T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stdout: 278278 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/test 2024-03-27T21:32:58.240 INFO:teuthology.orchestra.run.smithi063.stdout: 278279 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/test/java 2024-03-27T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stdout: 278280 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/test/java/org 2024-03-27T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stdout: 278281 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/test/java/org/example 2024-03-27T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stdout: 278282 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/test/java/org/example/cephs3upload 2024-03-27T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stdout: 278283 4 -rw-r--r-- 1 ubuntu ubuntu 652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/test/java/org/example/cephs3upload/AppTest.java 2024-03-27T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stdout: 278272 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/main 2024-03-27T21:32:58.241 INFO:teuthology.orchestra.run.smithi063.stdout: 278273 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/main/java 2024-03-27T21:32:58.242 INFO:teuthology.orchestra.run.smithi063.stdout: 278274 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/main/java/org 2024-03-27T21:32:58.242 INFO:teuthology.orchestra.run.smithi063.stdout: 278275 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/main/java/org/example 2024-03-27T21:32:58.242 INFO:teuthology.orchestra.run.smithi063.stdout: 278276 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/main/java/org/example/cephs3upload 2024-03-27T21:32:58.242 INFO:teuthology.orchestra.run.smithi063.stdout: 278277 4 -rw-r--r-- 1 ubuntu ubuntu 2294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/src/main/java/org/example/cephs3upload/App.java 2024-03-27T21:32:58.243 INFO:teuthology.orchestra.run.smithi063.stdout: 278270 4 -rw-r--r-- 1 ubuntu ubuntu 2197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/java/ceph-s3-upload/pom.xml 2024-03-27T21:32:58.243 INFO:teuthology.orchestra.run.smithi063.stdout: 278303 4 -rw-r--r-- 1 ubuntu ubuntu 3813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/rgw_admin_curl.sh 2024-03-27T21:32:58.243 INFO:teuthology.orchestra.run.smithi063.stdout: 278243 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3 2024-03-27T21:32:58.243 INFO:teuthology.orchestra.run.smithi063.stdout: 278244 8 -rw-r--r-- 1 ubuntu ubuntu 4208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/README.md 2024-03-27T21:32:58.243 INFO:teuthology.orchestra.run.smithi063.stdout: 278251 12 -rw-r--r-- 1 ubuntu ubuntu 9059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/service-2.sdk-extras.json 2024-03-27T21:32:58.243 INFO:teuthology.orchestra.run.smithi063.stdout: 278248 4 -rwxr-xr-x 1 ubuntu ubuntu 449 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/get_usage_stats.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278246 4 -rwxr-xr-x 1 ubuntu ubuntu 1229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/delete_notification.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278245 4 -rwxr-xr-x 1 ubuntu ubuntu 1241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/append_object.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278252 4 -rw-r--r-- 1 ubuntu ubuntu 713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/topic_attributes.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278253 4 -rw-r--r-- 1 ubuntu ubuntu 970 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/topic_with_endpoint.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278249 4 -rwxr-xr-x 1 ubuntu ubuntu 640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/list_unordered.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278250 4 -rwxr-xr-x 1 ubuntu ubuntu 1775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/notification_filters.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278247 4 -rwxr-xr-x 1 ubuntu ubuntu 826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/rgw/boto3/get_notification.py 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librbd 2024-03-27T21:32:58.244 INFO:teuthology.orchestra.run.smithi063.stdout: 278234 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librbd/Makefile 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 278235 8 -rw-r--r-- 1 ubuntu ubuntu 6157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/examples/librbd/hello_world.cc 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 277211 24 -rw-r--r-- 1 ubuntu ubuntu 24500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/CMakeLists.txt 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 277173 4 -rw-r--r-- 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.gitattributes 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 277205 4 -rw-r--r-- 1 ubuntu ubuntu 2698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.gitmodules 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 278307 24 -rwxr-xr-x 1 ubuntu ubuntu 22428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/install-deps.sh 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 277209 4 -rw-r--r-- 1 ubuntu ubuntu 446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.readthedocs.yml 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 278304 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/fusetrace 2024-03-27T21:32:58.245 INFO:teuthology.orchestra.run.smithi063.stdout: 278305 4 -rw-r--r-- 1 ubuntu ubuntu 180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/fusetrace/Makefile 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 278306 28 -rw-r--r-- 1 ubuntu ubuntu 28326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/fusetrace/fusetrace_ll.cc 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277238 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277244 4 -rwxr-xr-x 1 ubuntu ubuntu 533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv/mset.sh 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277241 4 -rw-r--r-- 1 ubuntu ubuntu 399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv/README 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277239 4 -rw-r--r-- 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv/.menvrc 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277243 4 -rwxr-xr-x 1 ubuntu ubuntu 327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv/mdo.sh 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277240 4 -rw-r--r-- 1 ubuntu ubuntu 427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv/INSTALL 2024-03-27T21:32:58.246 INFO:teuthology.orchestra.run.smithi063.stdout: 277242 4 -rwxr-xr-x 1 ubuntu ubuntu 246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-menv/build_links.sh 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 291475 12 -rwxr-xr-x 1 ubuntu ubuntu 10199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/win32_build.sh 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277443 4 drwxr-xr-x 27 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277647 8 -rw-r--r-- 1 ubuntu ubuntu 7640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/conf.py 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277446 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/README.md 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277935 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277937 4 -rw-r--r-- 1 ubuntu ubuntu 1899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/alerts.rst 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277960 32 -rw-r--r-- 1 ubuntu ubuntu 29630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/modules.rst 2024-03-27T21:32:58.247 INFO:teuthology.orchestra.run.smithi063.stdout: 277972 4 -rw-r--r-- 1 ubuntu ubuntu 3604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/zabbix.rst 2024-03-27T21:32:58.248 INFO:teuthology.orchestra.run.smithi063.stdout: 277956 24 -rw-r--r-- 1 ubuntu ubuntu 22189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/inventory-card.png 2024-03-27T21:32:58.248 INFO:teuthology.orchestra.run.smithi063.stdout: 277959 4 -rw-r--r-- 1 ubuntu ubuntu 802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/mds_autoscaler.rst 2024-03-27T21:32:58.248 INFO:teuthology.orchestra.run.smithi063.stdout: 277951 4 -rw-r--r-- 1 ubuntu ubuntu 1656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/diskprediction.rst 2024-03-27T21:32:58.248 INFO:teuthology.orchestra.run.smithi063.stdout: 277946 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/dashboard_plugins 2024-03-27T21:32:58.248 INFO:teuthology.orchestra.run.smithi063.stdout: 277949 4 -rw-r--r-- 1 ubuntu ubuntu 1179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/dashboard_plugins/motd.inc.rst 2024-03-27T21:32:58.248 INFO:teuthology.orchestra.run.smithi063.stdout: 277948 4 -rw-r--r-- 1 ubuntu ubuntu 1632 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/dashboard_plugins/feature_toggles.inc.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277947 4 -rw-r--r-- 1 ubuntu ubuntu 1004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/dashboard_plugins/debug.inc.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277943 4 -rw-r--r-- 1 ubuntu ubuntu 2614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/crash.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277963 12 -rw-r--r-- 1 ubuntu ubuntu 9234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/orchestrator_modules.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277971 12 -rw-r--r-- 1 ubuntu ubuntu 10676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/telemetry.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277962 12 -rw-r--r-- 1 ubuntu ubuntu 8997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/orchestrator.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277969 8 -rw-r--r-- 1 ubuntu ubuntu 6515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/status-card-open.png 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277961 28 -rw-r--r-- 1 ubuntu ubuntu 24703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/nfs.rst 2024-03-27T21:32:58.249 INFO:teuthology.orchestra.run.smithi063.stdout: 277945 60 -rw-r--r-- 1 ubuntu ubuntu 57573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/dashboard.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277958 4 -rw-r--r-- 1 ubuntu ubuntu 1105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/localpool.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277955 4 -rw-r--r-- 1 ubuntu ubuntu 1857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/insights.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277968 4 -rw-r--r-- 1 ubuntu ubuntu 989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/rook.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277957 4 -rw-r--r-- 1 ubuntu ubuntu 582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/iostat.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277952 4 -rw-r--r-- 1 ubuntu ubuntu 730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/hello.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277954 12 -rw-r--r-- 1 ubuntu ubuntu 8208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/influx.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277936 8 -rw-r--r-- 1 ubuntu ubuntu 5810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/administrator.rst 2024-03-27T21:32:58.250 INFO:teuthology.orchestra.run.smithi063.stdout: 277944 140 -rw-r--r-- 1 ubuntu ubuntu 142227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/dashboard-landing-page.png 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277967 4 -rw-r--r-- 1 ubuntu ubuntu 3676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/rgw.rst 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277950 20 -rw-r--r-- 1 ubuntu ubuntu 16497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/details-card.png 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277964 4 -rw-r--r-- 1 ubuntu ubuntu 1355 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/progress.rst 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277966 8 -rw-r--r-- 1 ubuntu ubuntu 6343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/restful.rst 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277953 4 -rw-r--r-- 1 ubuntu ubuntu 1810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/index.rst 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277938 20 -rw-r--r-- 1 ubuntu ubuntu 17736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/capacity-card.png 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277965 16 -rw-r--r-- 1 ubuntu ubuntu 15134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/prometheus.rst 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277942 68 -rw-r--r-- 1 ubuntu ubuntu 68915 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/cluster-utilization-card.png 2024-03-27T21:32:58.251 INFO:teuthology.orchestra.run.smithi063.stdout: 277941 4 -rw-r--r-- 1 ubuntu ubuntu 843 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/cli_api.rst 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 277970 4 -rw-r--r-- 1 ubuntu ubuntu 2286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/telegraf.rst 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 277939 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/ceph_api 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 277940 4 -rw-r--r-- 1 ubuntu ubuntu 3842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mgr/ceph_api/index.rst 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 278199 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 278207 4 -rw-r--r-- 1 ubuntu ubuntu 2798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/process.rst 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 278200 8 -rw-r--r-- 1 ubuntu ubuntu 6913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/CVE-2021-20288.rst 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 278204 4 -rw-r--r-- 1 ubuntu ubuntu 1382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/CVE-2022-0670.rst 2024-03-27T21:32:58.252 INFO:teuthology.orchestra.run.smithi063.stdout: 278203 4 -rw-r--r-- 1 ubuntu ubuntu 596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/CVE-2021-3531.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 278201 4 -rw-r--r-- 1 ubuntu ubuntu 576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/CVE-2021-3509.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 278205 12 -rw-r--r-- 1 ubuntu ubuntu 8635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/cves.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 278206 4 -rw-r--r-- 1 ubuntu ubuntu 1288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/index.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 278202 4 -rw-r--r-- 1 ubuntu ubuntu 804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/security/CVE-2021-3524.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 277521 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 277545 8 -rw-r--r-- 1 ubuntu ubuntu 7532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/eviction.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 277565 16 -rw-r--r-- 1 ubuntu ubuntu 12400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/multimds.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 277573 8 -rw-r--r-- 1 ubuntu ubuntu 7272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/standby.rst 2024-03-27T21:32:58.253 INFO:teuthology.orchestra.run.smithi063.stdout: 277540 8 -rw-r--r-- 1 ubuntu ubuntu 5806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/createfs.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277552 4 -rw-r--r-- 1 ubuntu ubuntu 158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/journaler.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277571 8 -rw-r--r-- 1 ubuntu ubuntu 5069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/scrub.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277533 4 -rw-r--r-- 1 ubuntu ubuntu 2493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cephfs-io-path.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277530 8 -rw-r--r-- 1 ubuntu ubuntu 7770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/capabilities.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277575 20 -rw-r--r-- 1 ubuntu ubuntu 16842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/troubleshooting.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277572 12 -rw-r--r-- 1 ubuntu ubuntu 9664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/snap-schedule.rst 2024-03-27T21:32:58.254 INFO:teuthology.orchestra.run.smithi063.stdout: 277535 16 -rw-r--r-- 1 ubuntu ubuntu 16081 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cephfs-mirroring.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277563 8 -rw-r--r-- 1 ubuntu ubuntu 6444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mount-using-kernel-driver.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277536 40 -rw-r--r-- 1 ubuntu ubuntu 37292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cephfs-top.png 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277576 4 -rw-r--r-- 1 ubuntu ubuntu 2993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/upgrading.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277543 4 -rw-r--r-- 1 ubuntu ubuntu 2222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/disaster-recovery.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277544 8 -rw-r--r-- 1 ubuntu ubuntu 4888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/dynamic-metadata-management.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277528 4 -rw-r--r-- 1 ubuntu ubuntu 3349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/app-best-practices.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277523 16 -rw-r--r-- 1 ubuntu ubuntu 13282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/administration.rst 2024-03-27T21:32:58.255 INFO:teuthology.orchestra.run.smithi063.stdout: 277555 12 -rw-r--r-- 1 ubuntu ubuntu 11627 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mantle.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277561 4 -rw-r--r-- 1 ubuntu ubuntu 3235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mount-prerequisites.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277547 12 -rw-r--r-- 1 ubuntu ubuntu 10525 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/file-layouts.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277539 4 -rw-r--r-- 1 ubuntu ubuntu 2896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/client-config-ref.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277529 12 -rw-r--r-- 1 ubuntu ubuntu 8733 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cache-configuration.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277542 12 -rw-r--r-- 1 ubuntu ubuntu 11004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/disaster-recovery-experts.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277566 4 -rw-r--r-- 1 ubuntu ubuntu 3700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/nfs.rst 2024-03-27T21:32:58.256 INFO:teuthology.orchestra.run.smithi063.stdout: 277564 4 -rw-r--r-- 1 ubuntu ubuntu 1954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/multifs.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277567 8 -rw-r--r-- 1 ubuntu ubuntu 5310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/posix.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277548 48 -rw-r--r-- 1 ubuntu ubuntu 45765 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/fs-volumes.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277532 108 -rw-r--r-- 1 ubuntu ubuntu 108799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cephfs-architecture.svg 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277549 4 -rw-r--r-- 1 ubuntu ubuntu 2676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/full.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277562 4 -rw-r--r-- 1 ubuntu ubuntu 3596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mount-using-fuse.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277569 8 -rw-r--r-- 1 ubuntu ubuntu 5260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/quota.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277558 8 -rw-r--r-- 1 ubuntu ubuntu 7040 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mds-journaling.rst 2024-03-27T21:32:58.257 INFO:teuthology.orchestra.run.smithi063.stdout: 277570 4 -rw-r--r-- 1 ubuntu ubuntu 2270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/recover-fs-after-mon-store-loss.rst 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277560 8 -rw-r--r-- 1 ubuntu ubuntu 5508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mds-states.rst 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277574 256 -rw-r--r-- 1 ubuntu ubuntu 261223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/subtree-partitioning.svg 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277559 4 -rw-r--r-- 1 ubuntu ubuntu 2215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mds-state-diagram.dot 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277553 4 -rw-r--r-- 1 ubuntu ubuntu 1716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/kernel-features.rst 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277546 4 -rw-r--r-- 1 ubuntu ubuntu 1822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/experimental-features.rst 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277557 4 -rw-r--r-- 1 ubuntu ubuntu 2191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mds-config-ref.rst 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277541 8 -rw-r--r-- 1 ubuntu ubuntu 4584 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/dirfrags.rst 2024-03-27T21:32:58.258 INFO:teuthology.orchestra.run.smithi063.stdout: 277551 8 -rw-r--r-- 1 ubuntu ubuntu 5943 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/index.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277568 160 -rw-r--r-- 1 ubuntu ubuntu 159819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/quiesce-set-states.svg 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277538 16 -rw-r--r-- 1 ubuntu ubuntu 14852 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/client-auth.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277522 8 -rw-r--r-- 1 ubuntu ubuntu 5312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/add-remove-mds.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277534 8 -rw-r--r-- 1 ubuntu ubuntu 7115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cephfs-journal-tool.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277550 12 -rw-r--r-- 1 ubuntu ubuntu 10456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/health-messages.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277537 8 -rw-r--r-- 1 ubuntu ubuntu 5886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/cephfs-top.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277556 4 -rw-r--r-- 1 ubuntu ubuntu 3770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/mdcache.rst 2024-03-27T21:32:58.259 INFO:teuthology.orchestra.run.smithi063.stdout: 277531 4 -rw-r--r-- 1 ubuntu ubuntu 3152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/ceph-dokan.rst 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277524 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/api 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277527 4 -rw-r--r-- 1 ubuntu ubuntu 236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/api/libcephfs-py.rst 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277525 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/api/index.rst 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277526 4 -rw-r--r-- 1 ubuntu ubuntu 501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/api/libcephfs-java.rst 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277554 4 -rw-r--r-- 1 ubuntu ubuntu 3188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephfs/lazyio.rst 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277978 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277987 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/command 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277989 4 -rw-r--r-- 1 ubuntu ubuntu 2012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/command/list-inconsistent-snap.json 2024-03-27T21:32:58.260 INFO:teuthology.orchestra.run.smithi063.stdout: 277988 8 -rw-r--r-- 1 ubuntu ubuntu 7173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/command/list-inconsistent-obj.json 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 277990 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 277995 4 -rw-r--r-- 1 ubuntu ubuntu 1165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/demo-ceph.conf 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 277992 28 -rw-r--r-- 1 ubuntu ubuntu 25230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/bluestore-config-ref.rst 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 278002 4 -rw-r--r-- 1 ubuntu ubuntu 2142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/mon-lookup-dns.rst 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 278009 8 -rw-r--r-- 1 ubuntu ubuntu 4186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/storage-devices.rst 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 278003 12 -rw-r--r-- 1 ubuntu ubuntu 10422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/mon-osd-interaction.rst 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 277997 4 -rw-r--r-- 1 ubuntu ubuntu 553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/general-config-ref.rst 2024-03-27T21:32:58.261 INFO:teuthology.orchestra.run.smithi063.stdout: 278008 4 -rw-r--r-- 1 ubuntu ubuntu 1114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/pool-pg.conf 2024-03-27T21:32:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 277994 8 -rw-r--r-- 1 ubuntu ubuntu 7195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/common.rst 2024-03-27T21:32:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 277991 16 -rw-r--r-- 1 ubuntu ubuntu 12447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/auth-config-ref.rst 2024-03-27T21:32:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 278000 28 -rw-r--r-- 1 ubuntu ubuntu 28540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/mclock-config-ref.rst 2024-03-27T21:32:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 278006 20 -rw-r--r-- 1 ubuntu ubuntu 17092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/osd-config-ref.rst 2024-03-27T21:32:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 278005 16 -rw-r--r-- 1 ubuntu ubuntu 14567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/network-config-ref.rst 2024-03-27T21:32:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 277999 4 -rw-r--r-- 1 ubuntu ubuntu 1955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/journal-ref.rst 2024-03-27T21:32:58.263 INFO:teuthology.orchestra.run.smithi063.stdout: 278004 12 -rw-r--r-- 1 ubuntu ubuntu 9603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/msgr2.rst 2024-03-27T21:32:58.263 INFO:teuthology.orchestra.run.smithi063.stdout: 278001 28 -rw-r--r-- 1 ubuntu ubuntu 27796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/mon-config-ref.rst 2024-03-27T21:32:58.263 INFO:teuthology.orchestra.run.smithi063.stdout: 277998 4 -rw-r--r-- 1 ubuntu ubuntu 1487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/index.rst 2024-03-27T21:32:58.263 INFO:teuthology.orchestra.run.smithi063.stdout: 277996 12 -rw-r--r-- 1 ubuntu ubuntu 10261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/filestore-config-ref.rst 2024-03-27T21:32:58.263 INFO:teuthology.orchestra.run.smithi063.stdout: 278007 4 -rw-r--r-- 1 ubuntu ubuntu 2529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/pool-pg-config-ref.rst 2024-03-27T21:32:58.264 INFO:teuthology.orchestra.run.smithi063.stdout: 277993 28 -rw-r--r-- 1 ubuntu ubuntu 24776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/configuration/ceph-conf.rst 2024-03-27T21:32:58.264 INFO:teuthology.orchestra.run.smithi063.stdout: 278048 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting 2024-03-27T21:32:58.264 INFO:teuthology.orchestra.run.smithi063.stdout: 278056 28 -rw-r--r-- 1 ubuntu ubuntu 27284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/troubleshooting-pg.rst 2024-03-27T21:32:58.264 INFO:teuthology.orchestra.run.smithi063.stdout: 278054 32 -rw-r--r-- 1 ubuntu ubuntu 32396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/troubleshooting-mon.rst 2024-03-27T21:32:58.264 INFO:teuthology.orchestra.run.smithi063.stdout: 278055 32 -rw-r--r-- 1 ubuntu ubuntu 31618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/troubleshooting-osd.rst 2024-03-27T21:32:58.264 INFO:teuthology.orchestra.run.smithi063.stdout: 278052 20 -rw-r--r-- 1 ubuntu ubuntu 18722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/log-and-debug.rst 2024-03-27T21:32:58.265 INFO:teuthology.orchestra.run.smithi063.stdout: 278051 4 -rw-r--r-- 1 ubuntu ubuntu 484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/index.rst 2024-03-27T21:32:58.265 INFO:teuthology.orchestra.run.smithi063.stdout: 278053 8 -rw-r--r-- 1 ubuntu ubuntu 6536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/memory-profiling.rst 2024-03-27T21:32:58.265 INFO:teuthology.orchestra.run.smithi063.stdout: 278049 4 -rw-r--r-- 1 ubuntu ubuntu 1305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/community.rst 2024-03-27T21:32:58.265 INFO:teuthology.orchestra.run.smithi063.stdout: 278050 4 -rw-r--r-- 1 ubuntu ubuntu 1723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/troubleshooting/cpu-profiling.rst 2024-03-27T21:32:58.265 INFO:teuthology.orchestra.run.smithi063.stdout: 278013 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations 2024-03-27T21:32:58.266 INFO:teuthology.orchestra.run.smithi063.stdout: 278044 4 -rw-r--r-- 1 ubuntu ubuntu 3407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/read-balancer.rst 2024-03-27T21:32:58.266 INFO:teuthology.orchestra.run.smithi063.stdout: 278019 4 -rw-r--r-- 1 ubuntu ubuntu 3418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/change-mon-elections.rst 2024-03-27T21:32:58.266 INFO:teuthology.orchestra.run.smithi063.stdout: 278022 48 -rw-r--r-- 1 ubuntu ubuntu 45725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/crush-map.rst 2024-03-27T21:32:58.267 INFO:teuthology.orchestra.run.smithi063.stdout: 278023 4 -rw-r--r-- 1 ubuntu ubuntu 2490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/data-placement.rst 2024-03-27T21:32:58.267 INFO:teuthology.orchestra.run.smithi063.stdout: 278030 4 -rw-r--r-- 1 ubuntu ubuntu 4051 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code-shec.rst 2024-03-27T21:32:58.267 INFO:teuthology.orchestra.run.smithi063.stdout: 278038 8 -rw-r--r-- 1 ubuntu ubuntu 4678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/pg-repair.rst 2024-03-27T21:32:58.267 INFO:teuthology.orchestra.run.smithi063.stdout: 278036 8 -rw-r--r-- 1 ubuntu ubuntu 6056 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/operating.rst 2024-03-27T21:32:58.268 INFO:teuthology.orchestra.run.smithi063.stdout: 278035 24 -rw-r--r-- 1 ubuntu ubuntu 22583 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/monitoring.rst 2024-03-27T21:32:58.268 INFO:teuthology.orchestra.run.smithi063.stdout: 278025 12 -rw-r--r-- 1 ubuntu ubuntu 8682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code-clay.rst 2024-03-27T21:32:58.268 INFO:teuthology.orchestra.run.smithi063.stdout: 278015 16 -rw-r--r-- 1 ubuntu ubuntu 15321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/add-or-rm-osds.rst 2024-03-27T21:32:58.268 INFO:teuthology.orchestra.run.smithi063.stdout: 278027 4 -rw-r--r-- 1 ubuntu ubuntu 3493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code-jerasure.rst 2024-03-27T21:32:58.269 INFO:teuthology.orchestra.run.smithi063.stdout: 278037 4 -rw-r--r-- 1 ubuntu ubuntu 4090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/pg-concepts.rst 2024-03-27T21:32:58.269 INFO:teuthology.orchestra.run.smithi063.stdout: 278024 8 -rw-r--r-- 1 ubuntu ubuntu 7435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/devices.rst 2024-03-27T21:32:58.269 INFO:teuthology.orchestra.run.smithi063.stdout: 278014 24 -rw-r--r-- 1 ubuntu ubuntu 20986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/add-or-rm-mons.rst 2024-03-27T21:32:58.269 INFO:teuthology.orchestra.run.smithi063.stdout: 278031 16 -rw-r--r-- 1 ubuntu ubuntu 13377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278021 32 -rw-r--r-- 1 ubuntu ubuntu 30560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/crush-map-edits.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278032 56 -rw-r--r-- 1 ubuntu ubuntu 56962 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/health-checks.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278016 12 -rw-r--r-- 1 ubuntu ubuntu 8877 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/balancer.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278029 8 -rw-r--r-- 1 ubuntu ubuntu 4106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code-profile.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278020 20 -rw-r--r-- 1 ubuntu ubuntu 18581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/control.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278042 40 -rw-r--r-- 1 ubuntu ubuntu 38795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/placement-groups.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278045 12 -rw-r--r-- 1 ubuntu ubuntu 11911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/stretch-mode.rst 2024-03-27T21:32:58.270 INFO:teuthology.orchestra.run.smithi063.stdout: 278028 12 -rw-r--r-- 1 ubuntu ubuntu 11708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code-lrc.rst 2024-03-27T21:32:58.271 INFO:teuthology.orchestra.run.smithi063.stdout: 278043 24 -rw-r--r-- 1 ubuntu ubuntu 22594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/pools.rst 2024-03-27T21:32:58.271 INFO:teuthology.orchestra.run.smithi063.stdout: 278026 4 -rw-r--r-- 1 ubuntu ubuntu 2723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/erasure-code-isa.rst 2024-03-27T21:32:58.271 INFO:teuthology.orchestra.run.smithi063.stdout: 278046 4 -rw-r--r-- 1 ubuntu ubuntu 3985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/upmap.rst 2024-03-27T21:32:58.271 INFO:teuthology.orchestra.run.smithi063.stdout: 278033 4 -rw-r--r-- 1 ubuntu ubuntu 2273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/index.rst 2024-03-27T21:32:58.271 INFO:teuthology.orchestra.run.smithi063.stdout: 278018 20 -rw-r--r-- 1 ubuntu ubuntu 19025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/cache-tiering.rst 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278039 4 -rw-r--r-- 1 ubuntu ubuntu 3746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/pg-states.rst 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278047 36 -rw-r--r-- 1 ubuntu ubuntu 34330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/user-management.rst 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278034 24 -rw-r--r-- 1 ubuntu ubuntu 23530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/monitoring-osd-pg.rst 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278017 12 -rw-r--r-- 1 ubuntu ubuntu 12195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/bluestore-migration.rst 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278040 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/pgcalc 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278041 8 -rw-r--r-- 1 ubuntu ubuntu 6003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/operations/pgcalc/index.rst 2024-03-27T21:32:58.272 INFO:teuthology.orchestra.run.smithi063.stdout: 278010 4 -rw-r--r-- 1 ubuntu ubuntu 2115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/index.rst 2024-03-27T21:32:58.273 INFO:teuthology.orchestra.run.smithi063.stdout: 277979 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api 2024-03-27T21:32:58.273 INFO:teuthology.orchestra.run.smithi063.stdout: 277983 8 -rw-r--r-- 1 ubuntu ubuntu 6132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/librados.rst 2024-03-27T21:32:58.273 INFO:teuthology.orchestra.run.smithi063.stdout: 277984 4 -rw-r--r-- 1 ubuntu ubuntu 287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/libradospp.rst 2024-03-27T21:32:58.273 INFO:teuthology.orchestra.run.smithi063.stdout: 277981 20 -rw-r--r-- 1 ubuntu ubuntu 17727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/libcephsqlite.rst 2024-03-27T21:32:58.273 INFO:teuthology.orchestra.run.smithi063.stdout: 277986 16 -rw-r--r-- 1 ubuntu ubuntu 12985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/python.rst 2024-03-27T21:32:58.273 INFO:teuthology.orchestra.run.smithi063.stdout: 277980 4 -rw-r--r-- 1 ubuntu ubuntu 924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/index.rst 2024-03-27T21:32:58.274 INFO:teuthology.orchestra.run.smithi063.stdout: 277985 4 -rw-r--r-- 1 ubuntu ubuntu 1816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/objclass-sdk.rst 2024-03-27T21:32:58.274 INFO:teuthology.orchestra.run.smithi063.stdout: 277982 32 -rw-r--r-- 1 ubuntu ubuntu 29409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/api/librados-intro.rst 2024-03-27T21:32:58.274 INFO:teuthology.orchestra.run.smithi063.stdout: 278011 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/man 2024-03-27T21:32:58.274 INFO:teuthology.orchestra.run.smithi063.stdout: 278012 4 -rw-r--r-- 1 ubuntu ubuntu 744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rados/man/index.rst 2024-03-27T21:32:58.274 INFO:teuthology.orchestra.run.smithi063.stdout: 277934 4 -rw-r--r-- 1 ubuntu ubuntu 1136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man_index.rst 2024-03-27T21:32:58.275 INFO:teuthology.orchestra.run.smithi063.stdout: 277880 4 -rw-r--r-- 1 ubuntu ubuntu 3898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/logo.png 2024-03-27T21:32:58.275 INFO:teuthology.orchestra.run.smithi063.stdout: 277445 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/CMakeLists.txt 2024-03-27T21:32:58.276 INFO:teuthology.orchestra.run.smithi063.stdout: 277973 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mon 2024-03-27T21:32:58.276 INFO:teuthology.orchestra.run.smithi063.stdout: 277974 4 -rw-r--r-- 1 ubuntu ubuntu 828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mon/README.txt 2024-03-27T21:32:58.276 INFO:teuthology.orchestra.run.smithi063.stdout: 277975 4 -rw-r--r-- 1 ubuntu ubuntu 2832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/mon/paxos-call-chain.dot 2024-03-27T21:32:58.276 INFO:teuthology.orchestra.run.smithi063.stdout: 277976 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/monitoring 2024-03-27T21:32:58.277 INFO:teuthology.orchestra.run.smithi063.stdout: 277977 20 -rw-r--r-- 1 ubuntu ubuntu 17390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/monitoring/index.rst 2024-03-27T21:32:58.277 INFO:teuthology.orchestra.run.smithi063.stdout: 277451 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_static 2024-03-27T21:32:58.277 INFO:teuthology.orchestra.run.smithi063.stdout: 277454 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_static/js 2024-03-27T21:32:58.277 INFO:teuthology.orchestra.run.smithi063.stdout: 277455 24 -rw-r--r-- 1 ubuntu ubuntu 20784 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_static/js/pgcalc.js 2024-03-27T21:32:58.278 INFO:teuthology.orchestra.run.smithi063.stdout: 277452 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_static/css 2024-03-27T21:32:58.278 INFO:teuthology.orchestra.run.smithi063.stdout: 277453 4 -rw-r--r-- 1 ubuntu ubuntu 354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_static/css/custom.css 2024-03-27T21:32:58.278 INFO:teuthology.orchestra.run.smithi063.stdout: 278174 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases 2024-03-27T21:32:58.278 INFO:teuthology.orchestra.run.smithi063.stdout: 278190 588 -rw-r--r-- 1 ubuntu ubuntu 601946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/nautilus.rst 2024-03-27T21:32:58.279 INFO:teuthology.orchestra.run.smithi063.stdout: 278176 24 -rw-r--r-- 1 ubuntu ubuntu 23570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/bobtail.rst 2024-03-27T21:32:58.279 INFO:teuthology.orchestra.run.smithi063.stdout: 278180 108 -rw-r--r-- 1 ubuntu ubuntu 109407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/firefly.rst 2024-03-27T21:32:58.279 INFO:teuthology.orchestra.run.smithi063.stdout: 278179 32 -rw-r--r-- 1 ubuntu ubuntu 30377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/emperor.rst 2024-03-27T21:32:58.279 INFO:teuthology.orchestra.run.smithi063.stdout: 278182 72 -rw-r--r-- 1 ubuntu ubuntu 69725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/giant.rst 2024-03-27T21:32:58.280 INFO:teuthology.orchestra.run.smithi063.stdout: 278175 12 -rw-r--r-- 1 ubuntu ubuntu 9331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/argonaut.rst 2024-03-27T21:32:58.280 INFO:teuthology.orchestra.run.smithi063.stdout: 278192 296 -rw-r--r-- 1 ubuntu ubuntu 301736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/pacific.rst 2024-03-27T21:32:58.280 INFO:teuthology.orchestra.run.smithi063.stdout: 278186 420 -rw-r--r-- 1 ubuntu ubuntu 428192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/jewel.rst 2024-03-27T21:32:58.281 INFO:teuthology.orchestra.run.smithi063.stdout: 278177 32 -rw-r--r-- 1 ubuntu ubuntu 31410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/cuttlefish.rst 2024-03-27T21:32:58.281 INFO:teuthology.orchestra.run.smithi063.stdout: 278193 200 -rw-r--r-- 1 ubuntu ubuntu 200807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/quincy.rst 2024-03-27T21:32:58.281 INFO:teuthology.orchestra.run.smithi063.stdout: 278195 16 -rw-r--r-- 1 ubuntu ubuntu 12859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/releases.yml 2024-03-27T21:32:58.281 INFO:teuthology.orchestra.run.smithi063.stdout: 278178 44 -rw-r--r-- 1 ubuntu ubuntu 41568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/dumpling.rst 2024-03-27T21:32:58.282 INFO:teuthology.orchestra.run.smithi063.stdout: 278183 180 -rw-r--r-- 1 ubuntu ubuntu 181661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/hammer.rst 2024-03-27T21:32:58.282 INFO:teuthology.orchestra.run.smithi063.stdout: 278188 720 -rw-r--r-- 1 ubuntu ubuntu 736301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/luminous.rst 2024-03-27T21:32:58.282 INFO:teuthology.orchestra.run.smithi063.stdout: 278187 316 -rw-r--r-- 1 ubuntu ubuntu 322789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/kraken.rst 2024-03-27T21:32:58.282 INFO:teuthology.orchestra.run.smithi063.stdout: 278185 84 -rw-r--r-- 1 ubuntu ubuntu 85821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/infernalis.rst 2024-03-27T21:32:58.283 INFO:teuthology.orchestra.run.smithi063.stdout: 278194 80 -rw-r--r-- 1 ubuntu ubuntu 81661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/reef.rst 2024-03-27T21:32:58.283 INFO:teuthology.orchestra.run.smithi063.stdout: 278191 700 -rw-r--r-- 1 ubuntu ubuntu 713217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/octopus.rst 2024-03-27T21:32:58.283 INFO:teuthology.orchestra.run.smithi063.stdout: 278184 8 -rw-r--r-- 1 ubuntu ubuntu 8029 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/index.rst 2024-03-27T21:32:58.283 INFO:teuthology.orchestra.run.smithi063.stdout: 278181 4 -rw-r--r-- 1 ubuntu ubuntu 3055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/general.rst 2024-03-27T21:32:58.284 INFO:teuthology.orchestra.run.smithi063.stdout: 278189 596 -rw-r--r-- 1 ubuntu ubuntu 606974 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/releases/mimic.rst 2024-03-27T21:32:58.284 INFO:teuthology.orchestra.run.smithi063.stdout: 277860 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install 2024-03-27T21:32:58.284 INFO:teuthology.orchestra.run.smithi063.stdout: 277861 4 -rw-r--r-- 1 ubuntu ubuntu 3307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/build-ceph.rst 2024-03-27T21:32:58.285 INFO:teuthology.orchestra.run.smithi063.stdout: 277871 20 -rw-r--r-- 1 ubuntu ubuntu 17306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/manual-freebsd-deployment.rst 2024-03-27T21:32:58.285 INFO:teuthology.orchestra.run.smithi063.stdout: 277864 16 -rw-r--r-- 1 ubuntu ubuntu 13222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/get-packages.rst 2024-03-27T21:32:58.285 INFO:teuthology.orchestra.run.smithi063.stdout: 277868 4 -rw-r--r-- 1 ubuntu ubuntu 2198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/install-storage-cluster.rst 2024-03-27T21:32:58.285 INFO:teuthology.orchestra.run.smithi063.stdout: 277874 4 -rw-r--r-- 1 ubuntu ubuntu 2750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/windows-install.rst 2024-03-27T21:32:58.286 INFO:teuthology.orchestra.run.smithi063.stdout: 277862 4 -rw-r--r-- 1 ubuntu ubuntu 3455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/clone-source.rst 2024-03-27T21:32:58.286 INFO:teuthology.orchestra.run.smithi063.stdout: 277863 8 -rw-r--r-- 1 ubuntu ubuntu 5180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/containers.rst 2024-03-27T21:32:58.286 INFO:teuthology.orchestra.run.smithi063.stdout: 277865 4 -rw-r--r-- 1 ubuntu ubuntu 522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/get-tarballs.rst 2024-03-27T21:32:58.286 INFO:teuthology.orchestra.run.smithi063.stdout: 277867 4 -rw-r--r-- 1 ubuntu ubuntu 1966 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/index_manual.rst 2024-03-27T21:32:58.287 INFO:teuthology.orchestra.run.smithi063.stdout: 277873 4 -rw-r--r-- 1 ubuntu ubuntu 1399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/windows-basic-config.rst 2024-03-27T21:32:58.287 INFO:teuthology.orchestra.run.smithi063.stdout: 277870 20 -rw-r--r-- 1 ubuntu ubuntu 18003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/manual-deployment.rst 2024-03-27T21:32:58.287 INFO:teuthology.orchestra.run.smithi063.stdout: 277866 4 -rw-r--r-- 1 ubuntu ubuntu 2657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/index.rst 2024-03-27T21:32:58.288 INFO:teuthology.orchestra.run.smithi063.stdout: 277872 4 -rw-r--r-- 1 ubuntu ubuntu 1811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/mirrors.rst 2024-03-27T21:32:58.288 INFO:teuthology.orchestra.run.smithi063.stdout: 277869 4 -rw-r--r-- 1 ubuntu ubuntu 3846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/install-vm-cloud.rst 2024-03-27T21:32:58.288 INFO:teuthology.orchestra.run.smithi063.stdout: 277875 4 -rw-r--r-- 1 ubuntu ubuntu 3146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/install/windows-troubleshooting.rst 2024-03-27T21:32:58.288 INFO:teuthology.orchestra.run.smithi063.stdout: 277804 4 -rw-r--r-- 1 ubuntu ubuntu 1150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/favicon.ico 2024-03-27T21:32:58.289 INFO:teuthology.orchestra.run.smithi063.stdout: 277805 4 -rw-r--r-- 1 ubuntu ubuntu 3736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/foundation.rst 2024-03-27T21:32:58.289 INFO:teuthology.orchestra.run.smithi063.stdout: 277447 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_ext 2024-03-27T21:32:58.289 INFO:teuthology.orchestra.run.smithi063.stdout: 277448 16 -rw-r--r-- 1 ubuntu ubuntu 14400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_ext/ceph_commands.py 2024-03-27T21:32:58.289 INFO:teuthology.orchestra.run.smithi063.stdout: 277449 16 -rw-r--r-- 1 ubuntu ubuntu 15171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_ext/ceph_confval.py 2024-03-27T21:32:58.289 INFO:teuthology.orchestra.run.smithi063.stdout: 277450 12 -rw-r--r-- 1 ubuntu ubuntu 12230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_ext/ceph_releases.py 2024-03-27T21:32:58.290 INFO:teuthology.orchestra.run.smithi063.stdout: 277648 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev 2024-03-27T21:32:58.290 INFO:teuthology.orchestra.run.smithi063.stdout: 277725 4 -rw-r--r-- 1 ubuntu ubuntu 1207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/internals.rst 2024-03-27T21:32:58.290 INFO:teuthology.orchestra.run.smithi063.stdout: 277730 4 -rw-r--r-- 1 ubuntu ubuntu 1616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/macos.rst 2024-03-27T21:32:58.290 INFO:teuthology.orchestra.run.smithi063.stdout: 277783 8 -rw-r--r-- 1 ubuntu ubuntu 4830 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/rados-client-protocol.rst 2024-03-27T21:32:58.290 INFO:teuthology.orchestra.run.smithi063.stdout: 277679 12 -rw-r--r-- 1 ubuntu ubuntu 10333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/continuous-integration.rst 2024-03-27T21:32:58.291 INFO:teuthology.orchestra.run.smithi063.stdout: 277674 12 -rw-r--r-- 1 ubuntu ubuntu 12108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephx.rst 2024-03-27T21:32:58.291 INFO:teuthology.orchestra.run.smithi063.stdout: 277696 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide 2024-03-27T21:32:58.291 INFO:teuthology.orchestra.run.smithi063.stdout: 277706 8 -rw-r--r-- 1 ubuntu ubuntu 6676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/running-tests-locally.rst 2024-03-27T21:32:58.292 INFO:teuthology.orchestra.run.smithi063.stdout: 277707 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests 2024-03-27T21:32:58.292 INFO:teuthology.orchestra.run.smithi063.stdout: 277712 16 -rw-r--r-- 1 ubuntu ubuntu 13105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests/tests-integration-testing-teuthology-workflow.rst 2024-03-27T21:32:58.292 INFO:teuthology.orchestra.run.smithi063.stdout: 277709 8 -rw-r--r-- 1 ubuntu ubuntu 6972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests/tests-integration-testing-teuthology-debugging-tips.rst 2024-03-27T21:32:58.292 INFO:teuthology.orchestra.run.smithi063.stdout: 277710 28 -rw-r--r-- 1 ubuntu ubuntu 27573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests/tests-integration-testing-teuthology-intro.rst 2024-03-27T21:32:58.293 INFO:teuthology.orchestra.run.smithi063.stdout: 277713 4 -rw-r--r-- 1 ubuntu ubuntu 103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests/tests-sentry-developers-guide.rst 2024-03-27T21:32:58.293 INFO:teuthology.orchestra.run.smithi063.stdout: 277711 4 -rw-r--r-- 1 ubuntu ubuntu 2933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests/tests-integration-testing-teuthology-kernel.rst 2024-03-27T21:32:58.293 INFO:teuthology.orchestra.run.smithi063.stdout: 277708 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/testing_integration_tests/index.rst 2024-03-27T21:32:58.293 INFO:teuthology.orchestra.run.smithi063.stdout: 277703 4 -rw-r--r-- 1 ubuntu ubuntu 1408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/issue-tracker.rst 2024-03-27T21:32:58.293 INFO:teuthology.orchestra.run.smithi063.stdout: 277699 4 -rw-r--r-- 1 ubuntu ubuntu 1393 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/debugging-gdb.rst 2024-03-27T21:32:58.293 INFO:teuthology.orchestra.run.smithi063.stdout: 277702 4 -rw-r--r-- 1 ubuntu ubuntu 1205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/intro.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277697 24 -rw-r--r-- 1 ubuntu ubuntu 22342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/basic-workflow.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277714 8 -rw-r--r-- 1 ubuntu ubuntu 6182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/tests-unit-tests.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277700 12 -rw-r--r-- 1 ubuntu ubuntu 11588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/essentials.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277704 4 -rw-r--r-- 1 ubuntu ubuntu 2350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/jaegertracing.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277701 4 -rw-r--r-- 1 ubuntu ubuntu 915 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/index.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277705 4 -rw-r--r-- 1 ubuntu ubuntu 3899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/merging.rst 2024-03-27T21:32:58.294 INFO:teuthology.orchestra.run.smithi063.stdout: 277698 104 -rw-r--r-- 1 ubuntu ubuntu 104195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/developer_guide/dash-devel.rst 2024-03-27T21:32:58.295 INFO:teuthology.orchestra.run.smithi063.stdout: 277729 4 -rw-r--r-- 1 ubuntu ubuntu 2597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/logs.rst 2024-03-27T21:32:58.295 INFO:teuthology.orchestra.run.smithi063.stdout: 277717 8 -rw-r--r-- 1 ubuntu ubuntu 4531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/dpdk.rst 2024-03-27T21:32:58.295 INFO:teuthology.orchestra.run.smithi063.stdout: 277691 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/dashboard 2024-03-27T21:32:58.295 INFO:teuthology.orchestra.run.smithi063.stdout: 277692 4 -rw-r--r-- 1 ubuntu ubuntu 3891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/dashboard/ui_goals.rst 2024-03-27T21:32:58.295 INFO:teuthology.orchestra.run.smithi063.stdout: 277671 16 -rw-r--r-- 1 ubuntu ubuntu 15695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephfs-mirroring.rst 2024-03-27T21:32:58.295 INFO:teuthology.orchestra.run.smithi063.stdout: 277796 16 -rw-r--r-- 1 ubuntu ubuntu 13060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/seastore.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277678 4 -rw-r--r-- 1 ubuntu ubuntu 997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/context.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277693 16 -rw-r--r-- 1 ubuntu ubuntu 15346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/deduplication.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277795 16 -rw-r--r-- 1 ubuntu ubuntu 12676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/release-process.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277675 24 -rw-r--r-- 1 ubuntu ubuntu 22522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephx_protocol.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277780 20 -rw-r--r-- 1 ubuntu ubuntu 20324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/perf_histograms.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277740 8 -rw-r--r-- 1 ubuntu ubuntu 6865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mon-elections.rst 2024-03-27T21:32:58.296 INFO:teuthology.orchestra.run.smithi063.stdout: 277722 4 -rw-r--r-- 1 ubuntu ubuntu 2287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/generatedocs.rst 2024-03-27T21:32:58.297 INFO:teuthology.orchestra.run.smithi063.stdout: 277720 8 -rw-r--r-- 1 ubuntu ubuntu 7889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/file-striping.rst 2024-03-27T21:32:58.297 INFO:teuthology.orchestra.run.smithi063.stdout: 277779 12 -rw-r--r-- 1 ubuntu ubuntu 8296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/perf_counters.rst 2024-03-27T21:32:58.297 INFO:teuthology.orchestra.run.smithi063.stdout: 277803 8 -rw-r--r-- 1 ubuntu ubuntu 7256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/zoned-storage.rst 2024-03-27T21:32:58.297 INFO:teuthology.orchestra.run.smithi063.stdout: 277778 4 -rw-r--r-- 1 ubuntu ubuntu 1450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/perf.rst 2024-03-27T21:32:58.297 INFO:teuthology.orchestra.run.smithi063.stdout: 277652 4 -rw-r--r-- 1 ubuntu ubuntu 3471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/bluestore.rst 2024-03-27T21:32:58.297 INFO:teuthology.orchestra.run.smithi063.stdout: 277793 12 -rw-r--r-- 1 ubuntu ubuntu 10506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/rbd-layering.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277802 4 -rw-r--r-- 1 ubuntu ubuntu 1373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/wireshark.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277716 8 -rw-r--r-- 1 ubuntu ubuntu 4209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/documenting.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277672 4 -rw-r--r-- 1 ubuntu ubuntu 3794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephfs-reclaim.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277746 4 -rw-r--r-- 1 ubuntu ubuntu 1082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/object-store.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277721 4 -rw-r--r-- 1 ubuntu ubuntu 1349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/freebsd.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277659 48 -rw-r--r-- 1 ubuntu ubuntu 47993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph_krb_auth.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277676 4 -rw-r--r-- 1 ubuntu ubuntu 1769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/config-key.rst 2024-03-27T21:32:58.298 INFO:teuthology.orchestra.run.smithi063.stdout: 277724 4 -rw-r--r-- 1 ubuntu ubuntu 240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/iana.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277800 4 -rw-r--r-- 1 ubuntu ubuntu 2184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/versions.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277791 4 -rw-r--r-- 1 ubuntu ubuntu 2149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/rbd-diff.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277782 8 -rw-r--r-- 1 ubuntu ubuntu 4153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/quick_guide.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277650 4 -rw-r--r-- 1 ubuntu ubuntu 2906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/balancer-design.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277718 12 -rw-r--r-- 1 ubuntu ubuntu 8623 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/encoding.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277653 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph-volume 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277656 4 -rw-r--r-- 1 ubuntu ubuntu 1732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph-volume/plugins.rst 2024-03-27T21:32:58.299 INFO:teuthology.orchestra.run.smithi063.stdout: 277654 4 -rw-r--r-- 1 ubuntu ubuntu 198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph-volume/index.rst 2024-03-27T21:32:58.300 INFO:teuthology.orchestra.run.smithi063.stdout: 277655 4 -rw-r--r-- 1 ubuntu ubuntu 3451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph-volume/lvm.rst 2024-03-27T21:32:58.300 INFO:teuthology.orchestra.run.smithi063.stdout: 277657 4 -rw-r--r-- 1 ubuntu ubuntu 1340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph-volume/systemd.rst 2024-03-27T21:32:58.300 INFO:teuthology.orchestra.run.smithi063.stdout: 277658 4 -rw-r--r-- 1 ubuntu ubuntu 3619 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/ceph-volume/zfs.rst 2024-03-27T21:32:58.300 INFO:teuthology.orchestra.run.smithi063.stdout: 277794 8 -rw-r--r-- 1 ubuntu ubuntu 6700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/release-checklists.rst 2024-03-27T21:32:58.300 INFO:teuthology.orchestra.run.smithi063.stdout: 277737 4 -rw-r--r-- 1 ubuntu ubuntu 2707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mempool_accounting.rst 2024-03-27T21:32:58.300 INFO:teuthology.orchestra.run.smithi063.stdout: 277727 4 -rw-r--r-- 1 ubuntu ubuntu 640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/libs.rst 2024-03-27T21:32:58.301 INFO:teuthology.orchestra.run.smithi063.stdout: 277781 8 -rw-r--r-- 1 ubuntu ubuntu 6515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/placement-group.rst 2024-03-27T21:32:58.301 INFO:teuthology.orchestra.run.smithi063.stdout: 277682 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson 2024-03-27T21:32:58.301 INFO:teuthology.orchestra.run.smithi063.stdout: 277683 20 -rw-r--r-- 1 ubuntu ubuntu 18179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson/crimson.rst 2024-03-27T21:32:58.301 INFO:teuthology.orchestra.run.smithi063.stdout: 277686 4 -rw-r--r-- 1 ubuntu ubuntu 2106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson/osd.rst 2024-03-27T21:32:58.301 INFO:teuthology.orchestra.run.smithi063.stdout: 277687 8 -rw-r--r-- 1 ubuntu ubuntu 5727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson/pipeline.rst 2024-03-27T21:32:58.302 INFO:teuthology.orchestra.run.smithi063.stdout: 277685 4 -rw-r--r-- 1 ubuntu ubuntu 171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson/index.rst 2024-03-27T21:32:58.302 INFO:teuthology.orchestra.run.smithi063.stdout: 277688 28 -rw-r--r-- 1 ubuntu ubuntu 26409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson/poseidonstore.rst 2024-03-27T21:32:58.302 INFO:teuthology.orchestra.run.smithi063.stdout: 277684 8 -rw-r--r-- 1 ubuntu ubuntu 7206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crimson/error-handling.rst 2024-03-27T21:32:58.302 INFO:teuthology.orchestra.run.smithi063.stdout: 277677 12 -rw-r--r-- 1 ubuntu ubuntu 8582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/config.rst 2024-03-27T21:32:58.302 INFO:teuthology.orchestra.run.smithi063.stdout: 277777 12 -rw-r--r-- 1 ubuntu ubuntu 11904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/peering.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277651 8 -rw-r--r-- 1 ubuntu ubuntu 7308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/blkin.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277799 4 -rw-r--r-- 1 ubuntu ubuntu 865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/testing.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277731 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mds_internals 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277732 4 -rw-r--r-- 1 ubuntu ubuntu 1649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mds_internals/data-structures.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277736 8 -rw-r--r-- 1 ubuntu ubuntu 6240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mds_internals/quiesce.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277733 4 -rw-r--r-- 1 ubuntu ubuntu 3541 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mds_internals/exports.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277734 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mds_internals/index.rst 2024-03-27T21:32:58.303 INFO:teuthology.orchestra.run.smithi063.stdout: 277735 16 -rw-r--r-- 1 ubuntu ubuntu 12372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mds_internals/locking.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277695 4 -rw-r--r-- 1 ubuntu ubuntu 3537 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/dev_cluster_deployment.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277784 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277785 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw/admin 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277786 8 -rw-r--r-- 1 ubuntu ubuntu 7623 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw/admin/adminops_nonimplemented.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277787 8 -rw-r--r-- 1 ubuntu ubuntu 6415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw/bucket_index.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277788 4 -rw-r--r-- 1 ubuntu ubuntu 284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw/index.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277789 44 -rw-r--r-- 1 ubuntu ubuntu 43503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw/s3_compliance.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277790 4 -rw-r--r-- 1 ubuntu ubuntu 2825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/radosgw/usage.rst 2024-03-27T21:32:58.304 INFO:teuthology.orchestra.run.smithi063.stdout: 277723 4 -rw-r--r-- 1 ubuntu ubuntu 2825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/health-reports.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277738 4 -rw-r--r-- 1 ubuntu ubuntu 1566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/messenger.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277743 32 -rw-r--r-- 1 ubuntu ubuntu 32513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/msgr2.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277747 4 -rw-r--r-- 1 ubuntu ubuntu 1752 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd-class-path.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277739 8 -rw-r--r-- 1 ubuntu ubuntu 7828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mon-bootstrap.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277689 8 -rw-r--r-- 1 ubuntu ubuntu 5070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/crush-msr.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277680 4 -rw-r--r-- 1 ubuntu ubuntu 2619 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/corpus.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277744 4 -rw-r--r-- 1 ubuntu ubuntu 4032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/network-encoding.rst 2024-03-27T21:32:58.305 INFO:teuthology.orchestra.run.smithi063.stdout: 277741 4 -rw-r--r-- 1 ubuntu ubuntu 3013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mon-on-disk-formats.rst 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277694 4 -rw-r--r-- 1 ubuntu ubuntu 606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/delayed-delete.rst 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277742 20 -rw-r--r-- 1 ubuntu ubuntu 18562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/mon-osdmap-prune.rst 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277649 4 -rw-r--r-- 1 ubuntu ubuntu 3841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/PlanningImplementation.txt 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277660 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277661 8 -rw-r--r-- 1 ubuntu ubuntu 4544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/compliance-check.rst 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277668 4 -rw-r--r-- 1 ubuntu ubuntu 3780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/host-maintenance.rst 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277669 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/index.rst 2024-03-27T21:32:58.306 INFO:teuthology.orchestra.run.smithi063.stdout: 277667 20 -rw-r--r-- 1 ubuntu ubuntu 18252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/developing-cephadm.rst 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277670 4 -rw-r--r-- 1 ubuntu ubuntu 3242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/scalability-notes.rst 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277662 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/design 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277666 20 -rw-r--r-- 1 ubuntu ubuntu 19095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/design/storage_devices_and_osds.rst 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277663 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/design/mockups 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277665 152 -rw-r--r-- 1 ubuntu ubuntu 152649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/design/mockups/OSD_Creation_host_mode.svg 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277664 120 -rw-r--r-- 1 ubuntu ubuntu 122394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephadm/design/mockups/OSD_Creation_device_mode.svg 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277798 12 -rw-r--r-- 1 ubuntu ubuntu 10132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/session_authentication.rst 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277681 4 -rw-r--r-- 1 ubuntu ubuntu 1194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cpu-profiler.rst 2024-03-27T21:32:58.307 INFO:teuthology.orchestra.run.smithi063.stdout: 277719 4 -rw-r--r-- 1 ubuntu ubuntu 3740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/erasure-coded-pool.rst 2024-03-27T21:32:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 277728 8 -rw-r--r-- 1 ubuntu ubuntu 4814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/logging.rst 2024-03-27T21:32:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 277792 4 -rw-r--r-- 1 ubuntu ubuntu 1853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/rbd-export.rst 2024-03-27T21:32:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 277801 4 -rw-r--r-- 1 ubuntu ubuntu 1329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/vstart-ganesha.rst 2024-03-27T21:32:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 277797 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/sepia.rst 2024-03-27T21:32:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 277745 8 -rw-r--r-- 1 ubuntu ubuntu 5201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/network-protocol.rst 2024-03-27T21:32:58.308 INFO:teuthology.orchestra.run.smithi063.stdout: 277673 8 -rw-r--r-- 1 ubuntu ubuntu 7025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cephfs-snapshots.rst 2024-03-27T21:32:58.309 INFO:teuthology.orchestra.run.smithi063.stdout: 277690 4 -rw-r--r-- 1 ubuntu ubuntu 1641 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/cxx.rst 2024-03-27T21:32:58.309 INFO:teuthology.orchestra.run.smithi063.stdout: 277726 8 -rw-r--r-- 1 ubuntu ubuntu 7413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/kubernetes.rst 2024-03-27T21:32:58.309 INFO:teuthology.orchestra.run.smithi063.stdout: 277748 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals 2024-03-27T21:32:58.309 INFO:teuthology.orchestra.run.smithi063.stdout: 277764 12 -rw-r--r-- 1 ubuntu ubuntu 11327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/osdmap_versions.txt 2024-03-27T21:32:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: 277776 4 -rw-r--r-- 1 ubuntu ubuntu 1228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/wbthrottle.rst 2024-03-27T21:32:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: 277772 4 -rw-r--r-- 1 ubuntu ubuntu 2295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/scrub.rst 2024-03-27T21:32:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: 277761 8 -rw-r--r-- 1 ubuntu ubuntu 5800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/map_message_handling.rst 2024-03-27T21:32:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: 277774 8 -rw-r--r-- 1 ubuntu ubuntu 4548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/stale_read.rst 2024-03-27T21:32:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: 277749 4 -rw-r--r-- 1 ubuntu ubuntu 2770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/async_recovery.rst 2024-03-27T21:32:58.310 INFO:teuthology.orchestra.run.smithi063.stdout: 277759 12 -rw-r--r-- 1 ubuntu ubuntu 9093 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/log_based_pg.rst 2024-03-27T21:32:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: 277750 4 -rw-r--r-- 1 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/backfill_reservation.rst 2024-03-27T21:32:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: 277770 4 -rw-r--r-- 1 ubuntu ubuntu 3147 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/recovery_reservation.rst 2024-03-27T21:32:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: 277773 12 -rw-r--r-- 1 ubuntu ubuntu 9117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/snaps.rst 2024-03-27T21:32:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: 277766 8 -rw-r--r-- 1 ubuntu ubuntu 5413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/past_intervals.rst 2024-03-27T21:32:58.311 INFO:teuthology.orchestra.run.smithi063.stdout: 277751 4 -rw-r--r-- 1 ubuntu ubuntu 3625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/erasure_coding.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277768 4 -rw-r--r-- 1 ubuntu ubuntu 2518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/pg_removal.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277760 24 -rw-r--r-- 1 ubuntu ubuntu 21250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/manifest.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277775 4 -rw-r--r-- 1 ubuntu ubuntu 3518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/watch_notify.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277769 4 -rw-r--r-- 1 ubuntu ubuntu 1025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/pgpool.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277763 4 -rw-r--r-- 1 ubuntu ubuntu 3432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/osd_overview.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277771 4 -rw-r--r-- 1 ubuntu ubuntu 1218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/refcount.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277765 8 -rw-r--r-- 1 ubuntu ubuntu 6593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/partial_object_recovery.rst 2024-03-27T21:32:58.312 INFO:teuthology.orchestra.run.smithi063.stdout: 277762 24 -rw-r--r-- 1 ubuntu ubuntu 22921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/mclock_wpq_cmp_study.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277752 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/erasure_coding 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277755 4 -rw-r--r-- 1 ubuntu ubuntu 1396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/erasure_coding/jerasure.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277753 12 -rw-r--r-- 1 ubuntu ubuntu 9918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/erasure_coding/developer_notes.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277754 12 -rw-r--r-- 1 ubuntu ubuntu 8745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/erasure_coding/ecbackend.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277756 20 -rw-r--r-- 1 ubuntu ubuntu 20338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/erasure_coding/proposals.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277757 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/index.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277767 4 -rw-r--r-- 1 ubuntu ubuntu 1156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/pg.rst 2024-03-27T21:32:58.313 INFO:teuthology.orchestra.run.smithi063.stdout: 277758 4 -rw-r--r-- 1 ubuntu ubuntu 3357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/osd_internals/last_epoch_started.rst 2024-03-27T21:32:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: 277715 12 -rw-r--r-- 1 ubuntu ubuntu 11156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/dev/development-workflow.rst 2024-03-27T21:32:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: 278196 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/scripts 2024-03-27T21:32:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: 278197 4 -rw-r--r-- 1 ubuntu ubuntu 464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/scripts/README.md 2024-03-27T21:32:58.314 INFO:teuthology.orchestra.run.smithi063.stdout: 278198 12 -rwxr-xr-x 1 ubuntu ubuntu 8474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/scripts/gen_state_diagram.py 2024-03-27T21:32:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: 277469 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume 2024-03-27T21:32:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: 277474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm 2024-03-27T21:32:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: 277477 4 -rw-r--r-- 1 ubuntu ubuntu 866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/create.rst 2024-03-27T21:32:58.315 INFO:teuthology.orchestra.run.smithi063.stdout: 277484 16 -rw-r--r-- 1 ubuntu ubuntu 12376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/prepare.rst 2024-03-27T21:32:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: 277475 4 -rw-r--r-- 1 ubuntu ubuntu 4078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/activate.rst 2024-03-27T21:32:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: 277482 4 -rw-r--r-- 1 ubuntu ubuntu 339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/newdb.rst 2024-03-27T21:32:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: 277487 4 -rw-r--r-- 1 ubuntu ubuntu 2214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/zap.rst 2024-03-27T21:32:58.316 INFO:teuthology.orchestra.run.smithi063.stdout: 277483 4 -rw-r--r-- 1 ubuntu ubuntu 357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/newwal.rst 2024-03-27T21:32:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: 277485 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/scan.rst 2024-03-27T21:32:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: 277478 4 -rw-r--r-- 1 ubuntu ubuntu 3273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/encryption.rst 2024-03-27T21:32:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: 277481 4 -rw-r--r-- 1 ubuntu ubuntu 1747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/migrate.rst 2024-03-27T21:32:58.317 INFO:teuthology.orchestra.run.smithi063.stdout: 277480 8 -rw-r--r-- 1 ubuntu ubuntu 7333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/list.rst 2024-03-27T21:32:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: 277476 8 -rw-r--r-- 1 ubuntu ubuntu 7306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/batch.rst 2024-03-27T21:32:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: 277479 4 -rw-r--r-- 1 ubuntu ubuntu 759 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/index.rst 2024-03-27T21:32:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: 277486 4 -rw-r--r-- 1 ubuntu ubuntu 872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/lvm/systemd.rst 2024-03-27T21:32:58.318 INFO:teuthology.orchestra.run.smithi063.stdout: 277494 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/zfs 2024-03-27T21:32:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: 277496 4 -rw-r--r-- 1 ubuntu ubuntu 762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/zfs/inventory.rst 2024-03-27T21:32:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: 277495 4 -rw-r--r-- 1 ubuntu ubuntu 717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/zfs/index.rst 2024-03-27T21:32:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: 277472 4 -rw-r--r-- 1 ubuntu ubuntu 4076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/intro.rst 2024-03-27T21:32:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: 277470 4 -rw-r--r-- 1 ubuntu ubuntu 417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/drive-group.rst 2024-03-27T21:32:58.319 INFO:teuthology.orchestra.run.smithi063.stdout: 277473 4 -rw-r--r-- 1 ubuntu ubuntu 705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/inventory.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277488 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/simple 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277489 4 -rw-r--r-- 1 ubuntu ubuntu 3138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/simple/activate.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277491 8 -rw-r--r-- 1 ubuntu ubuntu 6234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/simple/scan.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277490 4 -rw-r--r-- 1 ubuntu ubuntu 1030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/simple/index.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277492 4 -rw-r--r-- 1 ubuntu ubuntu 888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/simple/systemd.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277471 4 -rw-r--r-- 1 ubuntu ubuntu 2373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/index.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277493 4 -rw-r--r-- 1 ubuntu ubuntu 2000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/ceph-volume/systemd.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277806 24 -rw-r--r-- 1 ubuntu ubuntu 23608 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/glossary.rst 2024-03-27T21:32:58.320 INFO:teuthology.orchestra.run.smithi063.stdout: 277468 76 -rw-r--r-- 1 ubuntu ubuntu 77772 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/architecture.rst 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277808 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/hardware-monitoring 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277809 12 -rw-r--r-- 1 ubuntu ubuntu 8504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/hardware-monitoring/index.rst 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277459 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_themes 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277460 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_themes/ceph 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277464 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_themes/ceph/theme.conf 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277461 12 -rw-r--r-- 1 ubuntu ubuntu 9080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_themes/ceph/layout.html 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_themes/ceph/static 2024-03-27T21:32:58.321 INFO:teuthology.orchestra.run.smithi063.stdout: 277463 4 -rw-r--r-- 1 ubuntu ubuntu 3694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_themes/ceph/static/ceph.css_t 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277876 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/jaegertracing 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277879 132 -rw-r--r-- 1 ubuntu ubuntu 131398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/jaegertracing/rgw_jaeger.png 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277878 116 -rw-r--r-- 1 ubuntu ubuntu 117123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/jaegertracing/osd_jaeger.png 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277877 4 -rw-r--r-- 1 ubuntu ubuntu 3932 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/jaegertracing/index.rst 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277456 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_templates 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277457 4 -rw-r--r-- 1 ubuntu ubuntu 1189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_templates/page.html 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277458 4 -rw-r--r-- 1 ubuntu ubuntu 685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/_templates/smarttoc.html 2024-03-27T21:32:58.322 INFO:teuthology.orchestra.run.smithi063.stdout: 277577 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277621 52 -rw-r--r-- 1 ubuntu ubuntu 49420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.87.2.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277633 172 -rw-r--r-- 1 ubuntu ubuntu 175571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.10.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277592 48 -rw-r--r-- 1 ubuntu ubuntu 46694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.5.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277604 48 -rw-r--r-- 1 ubuntu ubuntu 48291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.6.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277643 132 -rw-r--r-- 1 ubuntu ubuntu 134912 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v12.2.1.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277610 116 -rw-r--r-- 1 ubuntu ubuntu 115660 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.10.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277585 72 -rw-r--r-- 1 ubuntu ubuntu 72225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.5.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277625 92 -rw-r--r-- 1 ubuntu ubuntu 91586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.3.txt 2024-03-27T21:32:58.323 INFO:teuthology.orchestra.run.smithi063.stdout: 277600 8 -rw-r--r-- 1 ubuntu ubuntu 7437 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.2.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277623 92 -rw-r--r-- 1 ubuntu ubuntu 91540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.10.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277644 336 -rw-r--r-- 1 ubuntu ubuntu 340172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v12.2.2.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277587 16 -rw-r--r-- 1 ubuntu ubuntu 15992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.7.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277599 8 -rw-r--r-- 1 ubuntu ubuntu 7643 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.11.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277626 124 -rw-r--r-- 1 ubuntu ubuntu 124131 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.4.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277606 48 -rw-r--r-- 1 ubuntu ubuntu 46313 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.8.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277618 88 -rw-r--r-- 1 ubuntu ubuntu 89673 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.8.txt 2024-03-27T21:32:58.324 INFO:teuthology.orchestra.run.smithi063.stdout: 277607 12 -rw-r--r-- 1 ubuntu ubuntu 8524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.9.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277615 16 -rw-r--r-- 1 ubuntu ubuntu 13270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.5.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277636 164 -rw-r--r-- 1 ubuntu ubuntu 167893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.4.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277581 16 -rw-r--r-- 1 ubuntu ubuntu 12592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.1.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277628 140 -rw-r--r-- 1 ubuntu ubuntu 140106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.6.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277645 364 -rw-r--r-- 1 ubuntu ubuntu 372035 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v12.2.3.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277582 48 -rw-r--r-- 1 ubuntu ubuntu 47269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.2.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277635 208 -rw-r--r-- 1 ubuntu ubuntu 212983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.3.txt 2024-03-27T21:32:58.325 INFO:teuthology.orchestra.run.smithi063.stdout: 277637 4 -rw-r--r-- 1 ubuntu ubuntu 1325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.5.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277646 60 -rw-r--r-- 1 ubuntu ubuntu 58748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v9.2.1.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277605 4 -rw-r--r-- 1 ubuntu ubuntu 3768 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.7.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277639 60 -rw-r--r-- 1 ubuntu ubuntu 57517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.7.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277614 4 -rw-r--r-- 1 ubuntu ubuntu 1371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.4.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277629 112 -rw-r--r-- 1 ubuntu ubuntu 113251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.7.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277580 32 -rw-r--r-- 1 ubuntu ubuntu 30913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.48.3argonaut.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277590 32 -rw-r--r-- 1 ubuntu ubuntu 30172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.3.txt 2024-03-27T21:32:58.326 INFO:teuthology.orchestra.run.smithi063.stdout: 277584 40 -rw-r--r-- 1 ubuntu ubuntu 40349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.4.txt 2024-03-27T21:32:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 277583 20 -rw-r--r-- 1 ubuntu ubuntu 19590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.3.txt 2024-03-27T21:32:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 277591 32 -rw-r--r-- 1 ubuntu ubuntu 30724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.4.txt 2024-03-27T21:32:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 277596 24 -rw-r--r-- 1 ubuntu ubuntu 20595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.9.txt 2024-03-27T21:32:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 277619 40 -rw-r--r-- 1 ubuntu ubuntu 40535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.9.txt 2024-03-27T21:32:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 277578 48 -rw-r--r-- 1 ubuntu ubuntu 47254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.48.1argonaut.txt 2024-03-27T21:32:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 277609 8 -rw-r--r-- 1 ubuntu ubuntu 7566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.1.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277589 4 -rw-r--r-- 1 ubuntu ubuntu 835 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.2.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277630 76 -rw-r--r-- 1 ubuntu ubuntu 75534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.8.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277611 108 -rw-r--r-- 1 ubuntu ubuntu 110390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.11.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277588 8 -rw-r--r-- 1 ubuntu ubuntu 4910 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.1.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277622 4 -rw-r--r-- 1 ubuntu ubuntu 2603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.1.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277608 8 -rw-r--r-- 1 ubuntu ubuntu 7609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.72.2.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277601 28 -rw-r--r-- 1 ubuntu ubuntu 25403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.3.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277579 20 -rw-r--r-- 1 ubuntu ubuntu 16863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.48.2argonaut.txt 2024-03-27T21:32:58.328 INFO:teuthology.orchestra.run.smithi063.stdout: 277593 4 -rw-r--r-- 1 ubuntu ubuntu 3002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.6.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277634 108 -rw-r--r-- 1 ubuntu ubuntu 108410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.2.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277598 24 -rw-r--r-- 1 ubuntu ubuntu 24207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.10.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277617 4 -rw-r--r-- 1 ubuntu ubuntu 2824 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.7.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277638 184 -rw-r--r-- 1 ubuntu ubuntu 185688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.6.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277631 4 -rw-r--r-- 1 ubuntu ubuntu 2385 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.9.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277620 76 -rw-r--r-- 1 ubuntu ubuntu 76441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.87.1.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277602 20 -rw-r--r-- 1 ubuntu ubuntu 19555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.4.txt 2024-03-27T21:32:58.329 INFO:teuthology.orchestra.run.smithi063.stdout: 277641 4 -rw-r--r-- 1 ubuntu ubuntu 1988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.9.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277640 192 -rw-r--r-- 1 ubuntu ubuntu 195489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.8.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277595 32 -rw-r--r-- 1 ubuntu ubuntu 29129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.8.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277612 44 -rw-r--r-- 1 ubuntu ubuntu 43567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.2.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277597 8 -rw-r--r-- 1 ubuntu ubuntu 5269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.1.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277616 116 -rw-r--r-- 1 ubuntu ubuntu 115187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.6.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277632 80 -rw-r--r-- 1 ubuntu ubuntu 80183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v10.2.1.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277642 284 -rw-r--r-- 1 ubuntu ubuntu 289580 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v11.2.1.txt 2024-03-27T21:32:58.330 INFO:teuthology.orchestra.run.smithi063.stdout: 277603 28 -rw-r--r-- 1 ubuntu ubuntu 26410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.67.5.txt 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 277613 4 -rw-r--r-- 1 ubuntu ubuntu 632 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.80.3.txt 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 277586 4 -rw-r--r-- 1 ubuntu ubuntu 1276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.56.6.txt 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 277624 56 -rw-r--r-- 1 ubuntu ubuntu 55416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.2.txt 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 277594 12 -rw-r--r-- 1 ubuntu ubuntu 8438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.61.7.txt 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 277627 4 -rw-r--r-- 1 ubuntu ubuntu 2942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/changelog/v0.94.5.txt 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 277807 4 -rw-r--r-- 1 ubuntu ubuntu 4022 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/governance.rst 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 278057 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 278070 8 -rw-r--r-- 1 ubuntu ubuntu 5439 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/d3n_datacache.rst 2024-03-27T21:32:58.331 INFO:teuthology.orchestra.run.smithi063.stdout: 278089 4 -rw-r--r-- 1 ubuntu ubuntu 2482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/oidc.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278083 4 -rw-r--r-- 1 ubuntu ubuntu 2782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/mfa.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278071 8 -rw-r--r-- 1 ubuntu ubuntu 7255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/dynamicresharding.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278128 4 -rw-r--r-- 1 ubuntu ubuntu 4038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/zone-features.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278067 16 -rw-r--r-- 1 ubuntu ubuntu 14214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/cloud-transition.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278082 8 -rw-r--r-- 1 ubuntu ubuntu 8186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/metrics.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278092 12 -rw-r--r-- 1 ubuntu ubuntu 8463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/placement.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278085 56 -rw-r--r-- 1 ubuntu ubuntu 55449 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/multisite.rst 2024-03-27T21:32:58.332 INFO:teuthology.orchestra.run.smithi063.stdout: 278059 8 -rw-r--r-- 1 ubuntu ubuntu 7995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/STSLite.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278126 8 -rw-r--r-- 1 ubuntu ubuntu 7388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/troubleshooting.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278097 12 -rw-r--r-- 1 ubuntu ubuntu 11326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3-notification-compatibility.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278086 8 -rw-r--r-- 1 ubuntu ubuntu 7164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/multitenancy.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278096 20 -rw-r--r-- 1 ubuntu ubuntu 16990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/role.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278122 4 -rw-r--r-- 1 ubuntu ubuntu 1417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/serviceops.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278118 8 -rw-r--r-- 1 ubuntu ubuntu 4728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/java.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278116 4 -rw-r--r-- 1 ubuntu ubuntu 2174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/auth.rst 2024-03-27T21:32:58.333 INFO:teuthology.orchestra.run.smithi063.stdout: 278120 4 -rw-r--r-- 1 ubuntu ubuntu 2285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/python.rst 2024-03-27T21:32:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: 278117 12 -rw-r--r-- 1 ubuntu ubuntu 9370 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/containerops.rst 2024-03-27T21:32:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: 278121 4 -rw-r--r-- 1 ubuntu ubuntu 2231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/ruby.rst 2024-03-27T21:32:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: 278123 4 -rw-r--r-- 1 ubuntu ubuntu 3448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/tempurl.rst 2024-03-27T21:32:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: 278124 4 -rw-r--r-- 1 ubuntu ubuntu 3259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/tutorial.rst 2024-03-27T21:32:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: 278119 8 -rw-r--r-- 1 ubuntu ubuntu 7054 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift/objectops.rst 2024-03-27T21:32:58.334 INFO:teuthology.orchestra.run.smithi063.stdout: 278099 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278104 8 -rw-r--r-- 1 ubuntu ubuntu 5075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/csharp.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278111 4 -rw-r--r-- 1 ubuntu ubuntu 4018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/serviceops.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278100 16 -rw-r--r-- 1 ubuntu ubuntu 13527 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/authentication.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278105 8 -rw-r--r-- 1 ubuntu ubuntu 6544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/java.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278109 8 -rw-r--r-- 1 ubuntu ubuntu 4891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/python.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278107 8 -rw-r--r-- 1 ubuntu ubuntu 5073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/perl.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278102 8 -rw-r--r-- 1 ubuntu ubuntu 5466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/commons.rst 2024-03-27T21:32:58.335 INFO:teuthology.orchestra.run.smithi063.stdout: 278108 8 -rw-r--r-- 1 ubuntu ubuntu 5693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/php.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278101 52 -rw-r--r-- 1 ubuntu ubuntu 50144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/bucketops.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278110 12 -rw-r--r-- 1 ubuntu ubuntu 8711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/ruby.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278103 8 -rw-r--r-- 1 ubuntu ubuntu 8018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/cpp.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278106 40 -rw-r--r-- 1 ubuntu ubuntu 38905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3/objectops.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278094 8 -rw-r--r-- 1 ubuntu ubuntu 5951 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/qat-accel.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278069 16 -rw-r--r-- 1 ubuntu ubuntu 12640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/config-ref.rst 2024-03-27T21:32:58.336 INFO:teuthology.orchestra.run.smithi063.stdout: 278084 28 -rw-r--r-- 1 ubuntu ubuntu 28057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/multisite-sync-policy.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278112 56 -rw-r--r-- 1 ubuntu ubuntu 54425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3select.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278074 8 -rw-r--r-- 1 ubuntu ubuntu 4196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/frontends.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278087 16 -rw-r--r-- 1 ubuntu ubuntu 13271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/nfs.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278113 20 -rw-r--r-- 1 ubuntu ubuntu 17135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/session-tags.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278066 8 -rw-r--r-- 1 ubuntu ubuntu 7762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/cloud-sync-module.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278068 4 -rw-r--r-- 1 ubuntu ubuntu 2845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/compression.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278098 8 -rw-r--r-- 1 ubuntu ubuntu 5985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/s3.rst 2024-03-27T21:32:58.337 INFO:teuthology.orchestra.run.smithi063.stdout: 278125 4 -rw-r--r-- 1 ubuntu ubuntu 3399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/sync-modules.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278088 28 -rw-r--r-- 1 ubuntu ubuntu 24848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/notifications.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278073 4 -rw-r--r-- 1 ubuntu ubuntu 3993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/encryption.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278076 8 -rw-r--r-- 1 ubuntu ubuntu 4247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/keycloak.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278091 8 -rw-r--r-- 1 ubuntu ubuntu 4560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/orphans.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278079 8 -rw-r--r-- 1 ubuntu ubuntu 7788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/layout.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278062 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/api.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278080 8 -rw-r--r-- 1 ubuntu ubuntu 6423 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/ldap-auth.rst 2024-03-27T21:32:58.338 INFO:teuthology.orchestra.run.smithi063.stdout: 278060 32 -rw-r--r-- 1 ubuntu ubuntu 29188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/admin.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278093 4 -rw-r--r-- 1 ubuntu ubuntu 1707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/pools.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278081 44 -rw-r--r-- 1 ubuntu ubuntu 43178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/lua-scripting.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278127 16 -rw-r--r-- 1 ubuntu ubuntu 15360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/vault.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278058 12 -rw-r--r-- 1 ubuntu ubuntu 12062 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/STS.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278061 40 -rw-r--r-- 1 ubuntu ubuntu 40923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/adminops.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278095 8 -rw-r--r-- 1 ubuntu ubuntu 5954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/rgw-cache.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278075 4 -rw-r--r-- 1 ubuntu ubuntu 3444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/index.rst 2024-03-27T21:32:58.339 INFO:teuthology.orchestra.run.smithi063.stdout: 278114 8 -rw-r--r-- 1 ubuntu ubuntu 5191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/swift.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278090 4 -rw-r--r-- 1 ubuntu ubuntu 2467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/opa.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278077 12 -rw-r--r-- 1 ubuntu ubuntu 9399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/keystone.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278064 4 -rw-r--r-- 1 ubuntu ubuntu 3768 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/barbican.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278072 8 -rw-r--r-- 1 ubuntu ubuntu 5334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/elastic-sync-module.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278078 8 -rw-r--r-- 1 ubuntu ubuntu 8122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/kmip.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278063 4 -rw-r--r-- 1 ubuntu ubuntu 1611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/archive-sync-module.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 278065 12 -rw-r--r-- 1 ubuntu ubuntu 9857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/radosgw/bucketpolicy.rst 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 277810 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images 2024-03-27T21:32:58.340 INFO:teuthology.orchestra.run.smithi063.stdout: 277818 28 -rw-r--r-- 1 ubuntu ubuntu 26248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/docreviewprocess.jpg 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277858 52 -rw-r--r-- 1 ubuntu ubuntu 51158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/zone-sync2.png 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277847 20 -rw-r--r-- 1 ubuntu ubuntu 16414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/stack.png 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277820 160 -rw-r--r-- 1 ubuntu ubuntu 162254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/esx_config_iscsi_main.png 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277812 32 -rw-r--r-- 1 ubuntu ubuntu 29192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/HAProxy_for_RGW.svg 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277816 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/dashboard 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277817 8 -rw-r--r-- 1 ubuntu ubuntu 5787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/dashboard/invalid-credentials.png 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277824 124 -rw-r--r-- 1 ubuntu ubuntu 126675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/keycloak-userclientmapper.png 2024-03-27T21:32:58.341 INFO:teuthology.orchestra.run.smithi063.stdout: 277813 60 -rw-r--r-- 1 ubuntu ubuntu 58212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/RADOS.jpg 2024-03-27T21:32:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: 277822 116 -rw-r--r-- 1 ubuntu ubuntu 116445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/esx_web_client_storage_main.png 2024-03-27T21:32:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: 277852 24 -rwxr-xr-x 1 ubuntu ubuntu 20594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_iscsi_target_tab.png 2024-03-27T21:32:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: 277825 96 -rw-r--r-- 1 ubuntu ubuntu 97290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/keycloak-usercredentials.png 2024-03-27T21:32:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: 277853 24 -rwxr-xr-x 1 ubuntu ubuntu 22340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_iscsi_target_tab2.png 2024-03-27T21:32:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: 277855 16 -rwxr-xr-x 1 ubuntu ubuntu 13334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_mpio_set_failover_only.png 2024-03-27T21:32:58.342 INFO:teuthology.orchestra.run.smithi063.stdout: 277844 68 -rw-r--r-- 1 ubuntu ubuntu 68497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/region-sync.png 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277815 44 -rw-r--r-- 1 ubuntu ubuntu 43211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/RDBSnapshots.jpg 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277811 92 -rw-r--r-- 1 ubuntu ubuntu 90271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/CRUSH.jpg 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277849 8 -rwxr-xr-x 1 ubuntu ubuntu 6956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_iscsi_connect_to_target.png 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277828 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277835 32 -rw-r--r-- 1 ubuntu ubuntu 31567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Obj_Rec_Throughput_HDD_NoWALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277834 20 -rw-r--r-- 1 ubuntu ubuntu 19355 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Client_Throughput_NVMe_SSD_WPQ_vs_mClock.png 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277836 32 -rw-r--r-- 1 ubuntu ubuntu 28836 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Obj_Rec_Throughput_HDD_WALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.343 INFO:teuthology.orchestra.run.smithi063.stdout: 277841 60 -rw-r--r-- 1 ubuntu ubuntu 58139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Recovery_Rate_Comparison_HDD_NoWALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277829 32 -rw-r--r-- 1 ubuntu ubuntu 29399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Client_Latency_Percentiles_HDD_NoWALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277831 28 -rw-r--r-- 1 ubuntu ubuntu 27008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Client_Latency_Percentiles_NVMe_SSD_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277842 52 -rw-r--r-- 1 ubuntu ubuntu 50218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Recovery_Rate_Comparison_HDD_WALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277838 92 -rw-r--r-- 1 ubuntu ubuntu 92308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Clat_Latency_Comparison_HDD_NoWALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277839 124 -rw-r--r-- 1 ubuntu ubuntu 124128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Clat_Latency_Comparison_HDD_WALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277832 24 -rw-r--r-- 1 ubuntu ubuntu 21076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Client_Throughput_HDD_NoWALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277833 20 -rw-r--r-- 1 ubuntu ubuntu 19387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Client_Throughput_HDD_WALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.344 INFO:teuthology.orchestra.run.smithi063.stdout: 277837 32 -rw-r--r-- 1 ubuntu ubuntu 31652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Obj_Rec_Throughput_NVMe_SSD_WPQ_vs_mClock.png 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277843 52 -rw-r--r-- 1 ubuntu ubuntu 50603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Recovery_Rate_Comparison_NVMe_SSD_WPQ_vs_mClock.png 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277840 64 -rw-r--r-- 1 ubuntu ubuntu 62976 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Clat_Latency_Comparison_NVMe_SSD_WPQ_vs_mClock.png 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277830 28 -rw-r--r-- 1 ubuntu ubuntu 28150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/mclock_wpq_study/Avg_Client_Latency_Percentiles_HDD_WALdB_WPQ_vs_mClock.png 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277854 20 -rw-r--r-- 1 ubuntu ubuntu 18464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_mpclaim_output.png 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277848 24 -rwxr-xr-x 1 ubuntu ubuntu 21371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_iscsi_advanced_window.png 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277857 732 -rw-r--r-- 1 ubuntu ubuntu 747810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/zone-sync.svg 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277845 792 -rw-r--r-- 1 ubuntu ubuntu 809416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/region-sync.svg 2024-03-27T21:32:58.345 INFO:teuthology.orchestra.run.smithi063.stdout: 277821 140 -rw-r--r-- 1 ubuntu ubuntu 139270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/esx_iscsi_recov_timeout.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277827 92 -rw-r--r-- 1 ubuntu ubuntu 93042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/keycloak-usertags.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277856 48 -rw-r--r-- 1 ubuntu ubuntu 47495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/zone-sync.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277823 80 -rw-r--r-- 1 ubuntu ubuntu 80244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/keycloak-adduser.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277851 24 -rwxr-xr-x 1 ubuntu ubuntu 21808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_iscsi_discovery_tab.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277819 188 -rw-r--r-- 1 ubuntu ubuntu 191689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/esx_chap.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277826 88 -rw-r--r-- 1 ubuntu ubuntu 89315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/keycloak-userdetails.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277846 16 -rw-r--r-- 1 ubuntu ubuntu 14440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/rgw-encryption-barbican.png 2024-03-27T21:32:58.346 INFO:teuthology.orchestra.run.smithi063.stdout: 277850 12 -rwxr-xr-x 1 ubuntu ubuntu 10913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/win2016_iscsi_devices_mpio.png 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 277814 72 -rw-r--r-- 1 ubuntu ubuntu 71953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/images/RBD.jpg 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278129 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278145 4 -rw-r--r-- 1 ubuntu ubuntu 1019 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-targets.rst 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278153 4 -rw-r--r-- 1 ubuntu ubuntu 612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/nvmeof-requirements.rst 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278152 4 -rw-r--r-- 1 ubuntu ubuntu 2468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/nvmeof-overview.rst 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278133 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/disk.conf 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278161 4 -rw-r--r-- 1 ubuntu ubuntu 435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-integrations.rst 2024-03-27T21:32:58.347 INFO:teuthology.orchestra.run.smithi063.stdout: 278172 16 -rw-r--r-- 1 ubuntu ubuntu 12441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-snapshot.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278156 12 -rw-r--r-- 1 ubuntu ubuntu 8967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rados-rbd-cmds.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278138 4 -rw-r--r-- 1 ubuntu ubuntu 696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-initiators.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278171 4 -rw-r--r-- 1 ubuntu ubuntu 1440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-replay.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278144 12 -rw-r--r-- 1 ubuntu ubuntu 9153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-target-cli.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278160 8 -rw-r--r-- 1 ubuntu ubuntu 4841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-exclusive-locks.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278151 4 -rw-r--r-- 1 ubuntu ubuntu 390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/nvmeof-initiators.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278146 12 -rw-r--r-- 1 ubuntu ubuntu 11485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/libvirt.rst 2024-03-27T21:32:58.348 INFO:teuthology.orchestra.run.smithi063.stdout: 278150 4 -rw-r--r-- 1 ubuntu ubuntu 1354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/nvmeof-initiator-linux.rst 2024-03-27T21:32:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: 278170 8 -rw-r--r-- 1 ubuntu ubuntu 5045 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-persistent-write-log-cache.rst 2024-03-27T21:32:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: 278137 4 -rw-r--r-- 1 ubuntu ubuntu 3000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-initiator-win.rst 2024-03-27T21:32:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: 278135 4 -rw-r--r-- 1 ubuntu ubuntu 3472 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-initiator-esx.rst 2024-03-27T21:32:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: 278139 4 -rw-r--r-- 1 ubuntu ubuntu 2971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-monitoring.rst 2024-03-27T21:32:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: 278166 16 -rw-r--r-- 1 ubuntu ubuntu 14208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-nomad.rst 2024-03-27T21:32:58.349 INFO:teuthology.orchestra.run.smithi063.stdout: 278140 4 -rw-r--r-- 1 ubuntu ubuntu 2769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-overview.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278173 12 -rw-r--r-- 1 ubuntu ubuntu 9396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-windows.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278167 16 -rw-r--r-- 1 ubuntu ubuntu 15282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-openstack.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278165 24 -rw-r--r-- 1 ubuntu ubuntu 23965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-mirroring.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278142 12 -rw-r--r-- 1 ubuntu ubuntu 10109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-target-ansible.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278159 12 -rw-r--r-- 1 ubuntu ubuntu 11301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-encryption.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278169 8 -rw-r--r-- 1 ubuntu ubuntu 6948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-persistent-read-only-cache.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278136 4 -rw-r--r-- 1 ubuntu ubuntu 3254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-initiator-linux.rst 2024-03-27T21:32:58.350 INFO:teuthology.orchestra.run.smithi063.stdout: 278157 8 -rw-r--r-- 1 ubuntu ubuntu 6659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-cloudstack.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278158 12 -rw-r--r-- 1 ubuntu ubuntu 9629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-config-ref.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278155 8 -rw-r--r-- 1 ubuntu ubuntu 8157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/qemu-rbd.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278149 4 -rw-r--r-- 1 ubuntu ubuntu 1779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/nvmeof-initiator-esx.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278154 4 -rw-r--r-- 1 ubuntu ubuntu 4059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/nvmeof-target-configure.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278168 4 -rw-r--r-- 1 ubuntu ubuntu 491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-operations.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278141 4 -rw-r--r-- 1 ubuntu ubuntu 1565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-requirements.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278134 4 -rw-r--r-- 1 ubuntu ubuntu 2497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/index.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278164 16 -rw-r--r-- 1 ubuntu ubuntu 13430 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-live-migration.rst 2024-03-27T21:32:58.351 INFO:teuthology.orchestra.run.smithi063.stdout: 278162 4 -rw-r--r-- 1 ubuntu ubuntu 1564 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-ko.rst 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278163 16 -rw-r--r-- 1 ubuntu ubuntu 13409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/rbd-kubernetes.rst 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278130 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/api 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278132 4 -rw-r--r-- 1 ubuntu ubuntu 2420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/api/librbdpy.rst 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278131 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/api/index.rst 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278143 8 -rw-r--r-- 1 ubuntu ubuntu 4566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/iscsi-target-cli-manual-install.rst 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278147 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/man 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 278148 4 -rw-r--r-- 1 ubuntu ubuntu 461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/rbd/man/index.rst 2024-03-27T21:32:58.352 INFO:teuthology.orchestra.run.smithi063.stdout: 277859 4 -rw-r--r-- 1 ubuntu ubuntu 3057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/index.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277497 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277519 20 -rw-r--r-- 1 ubuntu ubuntu 16770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/troubleshooting.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277503 24 -rw-r--r-- 1 ubuntu ubuntu 20820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/install.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277500 4 -rw-r--r-- 1 ubuntu ubuntu 2516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/compatibility.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277499 4 -rw-r--r-- 1 ubuntu ubuntu 1884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/client-setup.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277498 8 -rw-r--r-- 1 ubuntu ubuntu 6408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/adoption.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277504 28 -rw-r--r-- 1 ubuntu ubuntu 25492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/operations.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277501 20 -rw-r--r-- 1 ubuntu ubuntu 20117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/host-management.rst 2024-03-27T21:32:58.353 INFO:teuthology.orchestra.run.smithi063.stdout: 277505 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277518 4 -rw-r--r-- 1 ubuntu ubuntu 972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/tracing.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277512 24 -rw-r--r-- 1 ubuntu ubuntu 20988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/monitoring.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277509 4 -rw-r--r-- 1 ubuntu ubuntu 1263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/mds.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277508 4 -rw-r--r-- 1 ubuntu ubuntu 2094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/iscsi.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277514 28 -rw-r--r-- 1 ubuntu ubuntu 27919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/osd.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277511 8 -rw-r--r-- 1 ubuntu ubuntu 6892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/mon.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277516 8 -rw-r--r-- 1 ubuntu ubuntu 7550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/smb.rst 2024-03-27T21:32:58.354 INFO:teuthology.orchestra.run.smithi063.stdout: 277513 8 -rw-r--r-- 1 ubuntu ubuntu 6069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/nfs.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277515 16 -rw-r--r-- 1 ubuntu ubuntu 13382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/rgw.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277517 8 -rw-r--r-- 1 ubuntu ubuntu 5966 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/snmp-gateway.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277510 4 -rw-r--r-- 1 ubuntu ubuntu 940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/mgr.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277507 28 -rw-r--r-- 1 ubuntu ubuntu 25496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/index.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277506 8 -rw-r--r-- 1 ubuntu ubuntu 5236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/services/custom-container.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277502 4 -rw-r--r-- 1 ubuntu ubuntu 1727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/index.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277520 12 -rw-r--r-- 1 ubuntu ubuntu 10157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/cephadm/upgrade.rst 2024-03-27T21:32:58.355 INFO:teuthology.orchestra.run.smithi063.stdout: 277444 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/.gitignore 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 277465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/api 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 277467 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/api/mon_command_api.rst 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 277466 4 -rw-r--r-- 1 ubuntu ubuntu 743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/api/index.rst 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 278208 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 278214 8 -rw-r--r-- 1 ubuntu ubuntu 4278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/os-recommendations.rst 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 278213 4 -rw-r--r-- 1 ubuntu ubuntu 3848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/intro.rst 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 278209 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/ceph.conf 2024-03-27T21:32:58.356 INFO:teuthology.orchestra.run.smithi063.stdout: 278210 40 -rw-r--r-- 1 ubuntu ubuntu 39179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/documenting-ceph.rst 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 278215 4 -rw-r--r-- 1 ubuntu ubuntu 2312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/quick-rbd.rst 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 278212 32 -rw-r--r-- 1 ubuntu ubuntu 30983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/hardware-recommendations.rst 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 278211 12 -rw-r--r-- 1 ubuntu ubuntu 10406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/start/get-involved.rst 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 277881 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 277933 4 -rw-r--r-- 1 ubuntu ubuntu 428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/CMakeLists.txt 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 277882 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8 2024-03-27T21:32:58.357 INFO:teuthology.orchestra.run.smithi063.stdout: 277904 4 -rw-r--r-- 1 ubuntu ubuntu 1409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-volume-systemd.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277920 8 -rw-r--r-- 1 ubuntu ubuntu 6300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/radosgw.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277888 4 -rw-r--r-- 1 ubuntu ubuntu 1287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-create-keys.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277883 4 -rw-r--r-- 1 ubuntu ubuntu 1867 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/CMakeLists.txt 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277891 4 -rw-r--r-- 1 ubuntu ubuntu 1869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-diff-sorted.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277922 4 -rw-r--r-- 1 ubuntu ubuntu 1591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-ggate.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277932 4 -rw-r--r-- 1 ubuntu ubuntu 3603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rgw-restore-bucket-index.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277907 20 -rw-r--r-- 1 ubuntu ubuntu 17612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/cephadm.rst 2024-03-27T21:32:58.358 INFO:teuthology.orchestra.run.smithi063.stdout: 277927 4 -rw-r--r-- 1 ubuntu ubuntu 1895 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-replay.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277897 4 -rw-r--r-- 1 ubuntu ubuntu 2405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-monstore-tool.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277914 4 -rw-r--r-- 1 ubuntu ubuntu 3718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/monmaptool.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277925 4 -rw-r--r-- 1 ubuntu ubuntu 1986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-replay-many.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277886 4 -rw-r--r-- 1 ubuntu ubuntu 811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-clsinfo.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277924 4 -rw-r--r-- 1 ubuntu ubuntu 2712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-nbd.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277885 12 -rw-r--r-- 1 ubuntu ubuntu 9113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-bluestore-tool.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277921 4 -rw-r--r-- 1 ubuntu ubuntu 1345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-fuse.rst 2024-03-27T21:32:58.359 INFO:teuthology.orchestra.run.smithi063.stdout: 277889 4 -rw-r--r-- 1 ubuntu ubuntu 1224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-debugpack.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277893 4 -rw-r--r-- 1 ubuntu ubuntu 2003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-immutable-object-cache.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277884 8 -rw-r--r-- 1 ubuntu ubuntu 6017 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-authtool.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277892 4 -rw-r--r-- 1 ubuntu ubuntu 2464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-fuse.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277896 4 -rw-r--r-- 1 ubuntu ubuntu 3160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-mon.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277906 40 -rw-r--r-- 1 ubuntu ubuntu 40906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277915 12 -rw-r--r-- 1 ubuntu ubuntu 10836 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/mount.ceph.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277905 16 -rw-r--r-- 1 ubuntu ubuntu 13205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-volume.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277923 4 -rw-r--r-- 1 ubuntu ubuntu 1815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-mirror.rst 2024-03-27T21:32:58.360 INFO:teuthology.orchestra.run.smithi063.stdout: 277898 16 -rw-r--r-- 1 ubuntu ubuntu 13928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-objectstore-tool.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277918 12 -rw-r--r-- 1 ubuntu ubuntu 10124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rados.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277908 4 -rw-r--r-- 1 ubuntu ubuntu 1811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/cephfs-mirror.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277890 4 -rw-r--r-- 1 ubuntu ubuntu 3975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-dencoder.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277894 4 -rw-r--r-- 1 ubuntu ubuntu 3424 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-kvstore-tool.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277916 4 -rw-r--r-- 1 ubuntu ubuntu 2032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/mount.fuse.ceph.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277919 24 -rw-r--r-- 1 ubuntu ubuntu 23139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/radosgw-admin.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277928 44 -rw-r--r-- 1 ubuntu ubuntu 43507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd.rst 2024-03-27T21:32:58.361 INFO:teuthology.orchestra.run.smithi063.stdout: 277900 4 -rw-r--r-- 1 ubuntu ubuntu 1857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-post-file.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277909 16 -rw-r--r-- 1 ubuntu ubuntu 14576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/cephfs-shell.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277901 4 -rw-r--r-- 1 ubuntu ubuntu 789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-rbdnamer.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277911 4 -rw-r--r-- 1 ubuntu ubuntu 2993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/crushdiff.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277912 12 -rw-r--r-- 1 ubuntu ubuntu 9487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/crushtool.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277926 4 -rw-r--r-- 1 ubuntu ubuntu 1208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbd-replay-prep.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277902 4 -rw-r--r-- 1 ubuntu ubuntu 882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-run.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277887 8 -rw-r--r-- 1 ubuntu ubuntu 4212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-conf.rst 2024-03-27T21:32:58.362 INFO:teuthology.orchestra.run.smithi063.stdout: 277903 4 -rw-r--r-- 1 ubuntu ubuntu 2514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-syn.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277913 4 -rw-r--r-- 1 ubuntu ubuntu 821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/librados-config.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277917 12 -rw-r--r-- 1 ubuntu ubuntu 11135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/osdmaptool.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277910 4 -rw-r--r-- 1 ubuntu ubuntu 2379 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/cephfs-top.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277895 4 -rw-r--r-- 1 ubuntu ubuntu 2326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-mds.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277931 4 -rw-r--r-- 1 ubuntu ubuntu 1413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rgw-policy-check.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277929 8 -rw-r--r-- 1 ubuntu ubuntu 4629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rbdmap.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277899 4 -rw-r--r-- 1 ubuntu ubuntu 4050 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/ceph-osd.rst 2024-03-27T21:32:58.363 INFO:teuthology.orchestra.run.smithi063.stdout: 277930 4 -rw-r--r-- 1 ubuntu ubuntu 1925 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc/man/8/rgw-orphan-list.rst 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277207 108 -rw-r--r-- 1 ubuntu ubuntu 106582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.organizationmap 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277188 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277191 8 -rw-r--r-- 1 ubuntu ubuntu 6522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/labeler.yml 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277192 4 -rw-r--r-- 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/milestone.yml 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277189 12 -rw-r--r-- 1 ubuntu ubuntu 10225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/CODEOWNERS 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277194 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows 2024-03-27T21:32:58.364 INFO:teuthology.orchestra.run.smithi063.stdout: 277197 4 -rw-r--r-- 1 ubuntu ubuntu 298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows/pr-check-deps.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277199 4 -rw-r--r-- 1 ubuntu ubuntu 1160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows/pr-triage.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277196 4 -rw-r--r-- 1 ubuntu ubuntu 804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows/needs-rebase.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277200 4 -rw-r--r-- 1 ubuntu ubuntu 2417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows/stale.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277198 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows/pr-checklist.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277195 4 -rw-r--r-- 1 ubuntu ubuntu 2152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/workflows/create-backport-trackers.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277193 4 -rw-r--r-- 1 ubuntu ubuntu 2590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/pull_request_template.md 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277190 4 -rw-r--r-- 1 ubuntu ubuntu 471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.github/dependabot.yml 2024-03-27T21:32:58.365 INFO:teuthology.orchestra.run.smithi063.stdout: 277228 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 277231 4 -rw-r--r-- 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin/doc-python-common-requirements.txt 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 277232 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin/doc-read-the-docs.txt 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 277230 4 -rw-r--r-- 1 ubuntu ubuntu 65 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin/doc-pybind.txt 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 277233 4 -rw-r--r-- 1 ubuntu ubuntu 426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin/doc-requirements.txt 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 277234 4 -rwxr-xr-x 1 ubuntu ubuntu 848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin/serve-doc 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 277229 4 -rwxr-xr-x 1 ubuntu ubuntu 3770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/admin/build-doc 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 278329 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 278330 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin 2024-03-27T21:32:58.366 INFO:teuthology.orchestra.run.smithi063.stdout: 278335 4 -rw-r--r-- 1 ubuntu ubuntu 3101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/README.md 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278336 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/alerts.jsonnet 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278333 4 -rw-r--r-- 1 ubuntu ubuntu 2345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/CMakeLists.txt 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278381 4 -rw-r--r-- 1 ubuntu ubuntu 305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/requirements-lint.txt 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278378 52 -rw-r--r-- 1 ubuntu ubuntu 52182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/prometheus_alerts.yml 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278380 4 -rw-r--r-- 1 ubuntu ubuntu 9 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/requirements-grafonnet.txt 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278409 4 -rw-r--r-- 1 ubuntu ubuntu 1905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tox.ini 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278340 4 -rw-r--r-- 1 ubuntu ubuntu 471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards.libsonnet 2024-03-27T21:32:58.367 INFO:teuthology.orchestra.run.smithi063.stdout: 278383 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278384 8 -rw-r--r-- 1 ubuntu ubuntu 5399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/README.md 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278386 4 -rw-r--r-- 1 ubuntu ubuntu 345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/settings.py 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278391 20 -rwxr-xr-x 1 ubuntu ubuntu 18342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/validate_rules.py 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278388 4 -rwxr-xr-x 1 ubuntu ubuntu 1176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/test_syntax.py 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278387 112 -rw-r--r-- 1 ubuntu ubuntu 111720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/test_alerts.yml 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278385 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/__init__.py 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278389 4 -rw-r--r-- 1 ubuntu ubuntu 603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/test_unittests.py 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278390 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_alerts/utils.py 2024-03-27T21:32:58.368 INFO:teuthology.orchestra.run.smithi063.stdout: 278341 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278351 28 -rw-r--r-- 1 ubuntu ubuntu 25252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/rgw.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278345 32 -rw-r--r-- 1 ubuntu ubuntu 29028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/multi-cluster.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278346 24 -rw-r--r-- 1 ubuntu ubuntu 20788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/osd.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278350 88 -rw-r--r-- 1 ubuntu ubuntu 86723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/rgw-s3-analytics.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278348 16 -rw-r--r-- 1 ubuntu ubuntu 15942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/pool.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278344 28 -rw-r--r-- 1 ubuntu ubuntu 25730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/host.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278352 4 -rw-r--r-- 1 ubuntu ubuntu 4023 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/timeseries_panel.libsonnet 2024-03-27T21:32:58.369 INFO:teuthology.orchestra.run.smithi063.stdout: 278343 4 -rw-r--r-- 1 ubuntu ubuntu 2321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/cephfs.libsonnet 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278353 24 -rw-r--r-- 1 ubuntu ubuntu 23124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/utils.libsonnet 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278349 12 -rw-r--r-- 1 ubuntu ubuntu 10567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/rbd.libsonnet 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278342 52 -rw-r--r-- 1 ubuntu ubuntu 50255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/ceph-cluster.libsonnet 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278347 4 -rw-r--r-- 1 ubuntu ubuntu 1702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards/piechart_panel.libsonnet 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278374 4 -rw-r--r-- 1 ubuntu ubuntu 357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/jsonnetfile.lock.json 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278334 4 -rw-r--r-- 1 ubuntu ubuntu 397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/Makefile 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278392 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards 2024-03-27T21:32:58.370 INFO:teuthology.orchestra.run.smithi063.stdout: 278408 8 -rw-r--r-- 1 ubuntu ubuntu 4256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/util.py 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278407 4 -rw-r--r-- 1 ubuntu ubuntu 217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/requirements.txt 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278394 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278403 16 -rw-r--r-- 1 ubuntu ubuntu 13547 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/radosgw_overview.feature 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278396 24 -rw-r--r-- 1 ubuntu ubuntu 23049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/ceph-cluster.feature 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278399 4 -rw-r--r-- 1 ubuntu ubuntu 2185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/hosts_overview.feature 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278401 4 -rw-r--r-- 1 ubuntu ubuntu 815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/osds-overview.feature 2024-03-27T21:32:58.371 INFO:teuthology.orchestra.run.smithi063.stdout: 278402 8 -rw-r--r-- 1 ubuntu ubuntu 8014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/radosgw-detail.feature 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278405 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/steps 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278406 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/steps/__init__.py 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278404 4 -rw-r--r-- 1 ubuntu ubuntu 3973 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/self.feature 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278397 8 -rw-r--r-- 1 ubuntu ubuntu 4650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/environment.py 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278400 8 -rw-r--r-- 1 ubuntu ubuntu 5429 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/osd-device-details.feature 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278395 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/__init__.py 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278398 12 -rw-r--r-- 1 ubuntu ubuntu 9064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/features/host-details.feature 2024-03-27T21:32:58.372 INFO:teuthology.orchestra.run.smithi063.stdout: 278393 8 -rw-r--r-- 1 ubuntu ubuntu 5809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/tests_dashboards/__init__.py 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278332 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/.pylintrc -> ../../src/pybind/mgr/dashboard/.pylintrc 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278339 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards.jsonnet 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278382 4 -rwxr-xr-x 1 ubuntu ubuntu 1022 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/test-jsonnet.sh 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278377 60 -rw-r--r-- 1 ubuntu ubuntu 60463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/prometheus_alerts.libsonnet 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278338 4 -rw-r--r-- 1 ubuntu ubuntu 634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/config.libsonnet 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278379 4 -rw-r--r-- 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/requirements-alerts.txt 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278375 4 -rwxr-xr-x 1 ubuntu ubuntu 474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/lint-jsonnet.sh 2024-03-27T21:32:58.373 INFO:teuthology.orchestra.run.smithi063.stdout: 278373 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/jsonnetfile.json 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278376 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/mixin.libsonnet 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278331 4 -rw-r--r-- 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/.gitignore 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278354 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278368 16 -rw-r--r-- 1 ubuntu ubuntu 13843 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/radosgw-sync-overview.json 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278371 164 -rw-r--r-- 1 ubuntu ubuntu 165387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/rgw-s3-analytics.json 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278355 4 -rw-r--r-- 1 ubuntu ubuntu 221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/.lint 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278363 36 -rw-r--r-- 1 ubuntu ubuntu 33410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/osds-overview.json 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278357 36 -rw-r--r-- 1 ubuntu ubuntu 32787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/ceph-cluster.json 2024-03-27T21:32:58.374 INFO:teuthology.orchestra.run.smithi063.stdout: 278367 40 -rw-r--r-- 1 ubuntu ubuntu 39749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/radosgw-overview.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278365 48 -rw-r--r-- 1 ubuntu ubuntu 45460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/pool-overview.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278370 24 -rw-r--r-- 1 ubuntu ubuntu 22044 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/rbd-overview.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278369 16 -rw-r--r-- 1 ubuntu ubuntu 12811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/rbd-details.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278366 20 -rw-r--r-- 1 ubuntu ubuntu 16980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/radosgw-detail.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278358 12 -rw-r--r-- 1 ubuntu ubuntu 9556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/cephfs-overview.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278362 28 -rw-r--r-- 1 ubuntu ubuntu 27084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/osd-device-details.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278364 20 -rw-r--r-- 1 ubuntu ubuntu 19980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/pool-detail.json 2024-03-27T21:32:58.375 INFO:teuthology.orchestra.run.smithi063.stdout: 278360 28 -rw-r--r-- 1 ubuntu ubuntu 27723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/hosts-overview.json 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278359 44 -rw-r--r-- 1 ubuntu ubuntu 44123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/host-details.json 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278356 116 -rw-r--r-- 1 ubuntu ubuntu 115800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/ceph-cluster-advanced.json 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278361 64 -rw-r--r-- 1 ubuntu ubuntu 64728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/dashboards_out/multi-cluster-overview.json 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278372 4 -rwxr-xr-x 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/jsonnet-bundler-build.sh 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278337 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/ceph-mixin/alerts.libsonnet 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278410 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278414 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots 2024-03-27T21:32:58.376 INFO:teuthology.orchestra.run.smithi063.stdout: 278415 200 -rw-r--r-- 1 ubuntu ubuntu 201798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/ceph-cluster1.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278421 136 -rw-r--r-- 1 ubuntu ubuntu 137137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/osd-performance.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278424 100 -rw-r--r-- 1 ubuntu ubuntu 102273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/pool-overview.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278418 816 -rw-r--r-- 1 ubuntu ubuntu 833169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/host-details.resized.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278422 352 -rw-r--r-- 1 ubuntu ubuntu 358872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/osd_overview.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278423 124 -rw-r--r-- 1 ubuntu ubuntu 123041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/pool-details.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278420 52 -rw-r--r-- 1 ubuntu ubuntu 52682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/mds-performance.png 2024-03-27T21:32:58.377 INFO:teuthology.orchestra.run.smithi063.stdout: 278419 396 -rw-r--r-- 1 ubuntu ubuntu 403994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/host_overview.png 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278416 200 -rw-r--r-- 1 ubuntu ubuntu 204800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/ceph-cluster2.png 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278417 212 -rw-r--r-- 1 ubuntu ubuntu 214033 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/host-details.png 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278425 272 -rw-r--r-- 1 ubuntu ubuntu 277302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/rgw-detail.png 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278426 292 -rw-r--r-- 1 ubuntu ubuntu 296415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/screenshots/rgw-overview.png 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278411 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/build 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278413 4 -rw-r--r-- 1 ubuntu ubuntu 1744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/build/README.md 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278412 4 -rwxr-xr-x 1 ubuntu ubuntu 3554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/grafana/build/Makefile 2024-03-27T21:32:58.378 INFO:teuthology.orchestra.run.smithi063.stdout: 278427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/snmp 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 278429 4 -rw-r--r-- 1 ubuntu ubuntu 2837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/snmp/README.md 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 278428 12 -rw-r--r-- 1 ubuntu ubuntu 11727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/monitoring/snmp/CEPH-MIB.txt 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 277220 4 -rw-r--r-- 1 ubuntu ubuntu 1457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/README.aix 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 277224 4 -rw-r--r-- 1 ubuntu ubuntu 3893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/SECURITY.md 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 291473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/udev 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 291474 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/udev/50-rbd.rules 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 283275 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/selinux 2024-03-27T21:32:58.379 INFO:teuthology.orchestra.run.smithi063.stdout: 283277 4 -rw-r--r-- 1 ubuntu ubuntu 375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/selinux/CMakeLists.txt 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 283279 8 -rw-r--r-- 1 ubuntu ubuntu 4964 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/selinux/ceph.if 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 283280 8 -rw-r--r-- 1 ubuntu ubuntu 4822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/selinux/ceph.te 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 283278 4 -rw-r--r-- 1 ubuntu ubuntu 1147 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/selinux/ceph.fc 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 283276 4 -rw-r--r-- 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/selinux/.gitignore 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 278315 4 -rwxr-xr-x 1 ubuntu ubuntu 259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/make-srpm.sh 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 277215 28 -rw-r--r-- 1 ubuntu ubuntu 26436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/COPYING-LGPL2.1 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 283286 4 drwxr-xr-x 77 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src 2024-03-27T21:32:58.380 INFO:teuthology.orchestra.run.smithi063.stdout: 284821 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dmclock 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 291441 60 -rwxr-xr-x 1 ubuntu ubuntu 60013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/vstart.sh 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284896 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284897 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/CMakeLists.txt 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284902 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/http_server.h 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284901 8 -rw-r--r-- 1 ubuntu ubuntu 5568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/http_server.cc 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284899 4 -rw-r--r-- 1 ubuntu ubuntu 2722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/DaemonMetricCollector.h 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284900 4 -rw-r--r-- 1 ubuntu ubuntu 2378 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/ceph_exporter.cc 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284903 4 -rw-r--r-- 1 ubuntu ubuntu 1572 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/util.cc 2024-03-27T21:32:58.381 INFO:teuthology.orchestra.run.smithi063.stdout: 284904 4 -rw-r--r-- 1 ubuntu ubuntu 499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/util.h 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 284898 20 -rw-r--r-- 1 ubuntu ubuntu 17326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/exporter/DaemonMetricCollector.cc 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 286512 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 286525 4 drwxr-xr-x 40 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 288822 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 288839 20 -rw-r--r-- 1 ubuntu ubuntu 18203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/module.py 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 288836 4 -rw-r--r-- 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/context.py 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 288838 4 -rw-r--r-- 1 ubuntu ubuntu 204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/hooks.py 2024-03-27T21:32:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 288835 8 -rw-r--r-- 1 ubuntu ubuntu 4740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/common.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288823 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/__init__.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288837 4 -rw-r--r-- 1 ubuntu ubuntu 2270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/decorators.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288824 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288833 4 -rw-r--r-- 1 ubuntu ubuntu 2604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/request.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288826 4 -rw-r--r-- 1 ubuntu ubuntu 1999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/config.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288832 8 -rw-r--r-- 1 ubuntu ubuntu 4111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/pool.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288829 4 -rw-r--r-- 1 ubuntu ubuntu 953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/mon.py 2024-03-27T21:32:58.383 INFO:teuthology.orchestra.run.smithi063.stdout: 288834 4 -rw-r--r-- 1 ubuntu ubuntu 737 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/server.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288828 4 -rw-r--r-- 1 ubuntu ubuntu 320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/doc.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288831 4 -rw-r--r-- 1 ubuntu ubuntu 688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/perf.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288827 4 -rw-r--r-- 1 ubuntu ubuntu 561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/crush.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288825 4 -rw-r--r-- 1 ubuntu ubuntu 990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/__init__.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288830 4 -rw-r--r-- 1 ubuntu ubuntu 3542 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/restful/api/osd.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288744 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mds_autoscaler 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288746 4 -rw-r--r-- 1 ubuntu ubuntu 3748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mds_autoscaler/module.py 2024-03-27T21:32:58.384 INFO:teuthology.orchestra.run.smithi063.stdout: 288747 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mds_autoscaler/tests 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 288749 4 -rw-r--r-- 1 ubuntu ubuntu 2566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mds_autoscaler/tests/test_autoscaler.py 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 288748 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mds_autoscaler/tests/__init__.py 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 288745 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mds_autoscaler/__init__.py 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 286623 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cli_api 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 286625 4 -rwxr-xr-x 1 ubuntu ubuntu 3987 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cli_api/module.py 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 286626 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cli_api/tests 2024-03-27T21:32:58.385 INFO:teuthology.orchestra.run.smithi063.stdout: 286627 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cli_api/tests/__init__.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 286628 4 -rw-r--r-- 1 ubuntu ubuntu 1718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cli_api/tests/test_cli_api.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 286624 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cli_api/__init__.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 288919 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/tests 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 288922 16 -rw-r--r-- 1 ubuntu ubuntu 16229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/tests/test_object_format.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 288923 4 -rw-r--r-- 1 ubuntu ubuntu 3786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/tests/test_tls.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 288920 8 -rw-r--r-- 1 ubuntu ubuntu 8010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/tests/__init__.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 288921 4 -rw-r--r-- 1 ubuntu ubuntu 513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/tests/test_mgr_util.py 2024-03-27T21:32:58.386 INFO:teuthology.orchestra.run.smithi063.stdout: 288789 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/osd_perf_query 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288791 8 -rw-r--r-- 1 ubuntu ubuntu 7796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/osd_perf_query/module.py 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288790 4 -rw-r--r-- 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/osd_perf_query/__init__.py 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288875 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288882 16 -rw-r--r-- 1 ubuntu ubuntu 14744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/module.py 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288884 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288887 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests/fs 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288889 12 -rw-r--r-- 1 ubuntu ubuntu 9126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests/fs/test_schedule.py 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288890 4 -rw-r--r-- 1 ubuntu ubuntu 1459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests/fs/test_schedule_client.py 2024-03-27T21:32:58.387 INFO:teuthology.orchestra.run.smithi063.stdout: 288888 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests/fs/__init__.py 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288886 4 -rw-r--r-- 1 ubuntu ubuntu 1998 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests/conftest.py 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288885 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tests/__init__.py 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288878 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/fs 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288880 20 -rw-r--r-- 1 ubuntu ubuntu 19624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/fs/schedule.py 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288879 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/fs/__init__.py 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288881 24 -rw-r--r-- 1 ubuntu ubuntu 20760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/fs/schedule_client.py 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288891 4 -rw-r--r-- 1 ubuntu ubuntu 518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/tox.ini 2024-03-27T21:32:58.388 INFO:teuthology.orchestra.run.smithi063.stdout: 288883 4 -rw-r--r-- 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/requirements.txt 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 288877 4 -rw-r--r-- 1 ubuntu ubuntu 216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/__init__.py 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 288876 4 -rw-r--r-- 1 ubuntu ubuntu 5 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/snap_schedule/.gitignore 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 286528 4 -rw-r--r-- 1 ubuntu ubuntu 1350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/CMakeLists.txt 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 286632 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 288528 24 -rw-r--r-- 1 ubuntu ubuntu 23100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/module.py 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 288621 32 -rw-r--r-- 1 ubuntu ubuntu 32179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tools.py 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 288524 8 -rw-r--r-- 1 ubuntu ubuntu 4443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/grafana.py 2024-03-27T21:32:58.389 INFO:teuthology.orchestra.run.smithi063.stdout: 288580 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288610 8 -rw-r--r-- 1 ubuntu ubuntu 6939 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_rbd_service.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288619 8 -rw-r--r-- 1 ubuntu ubuntu 7442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_tools.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288597 4 -rw-r--r-- 1 ubuntu ubuntu 2082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_feature_toggles.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288615 8 -rw-r--r-- 1 ubuntu ubuntu 7147 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_settings.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288586 4 -rw-r--r-- 1 ubuntu ubuntu 1416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_cache.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288594 12 -rw-r--r-- 1 ubuntu ubuntu 8653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_docs.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288606 4 -rw-r--r-- 1 ubuntu ubuntu 1049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_plugin_debug.py 2024-03-27T21:32:58.390 INFO:teuthology.orchestra.run.smithi063.stdout: 288608 8 -rw-r--r-- 1 ubuntu ubuntu 8102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_prometheus.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288607 8 -rw-r--r-- 1 ubuntu ubuntu 6012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_pool.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288620 4 -rw-r--r-- 1 ubuntu ubuntu 2450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_versioning.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288605 20 -rw-r--r-- 1 ubuntu ubuntu 19390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_osd.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288583 40 -rw-r--r-- 1 ubuntu ubuntu 38042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_access_control.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288613 12 -rw-r--r-- 1 ubuntu ubuntu 11406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_rgw.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288589 4 -rw-r--r-- 1 ubuntu ubuntu 1193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_cephfs.py 2024-03-27T21:32:58.391 INFO:teuthology.orchestra.run.smithi063.stdout: 288611 8 -rw-r--r-- 1 ubuntu ubuntu 4871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_rest_client.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288616 4 -rw-r--r-- 1 ubuntu ubuntu 1237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_ssl.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288617 12 -rw-r--r-- 1 ubuntu ubuntu 8867 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_sso.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288592 4 -rw-r--r-- 1 ubuntu ubuntu 2606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_crud.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288598 8 -rw-r--r-- 1 ubuntu ubuntu 4870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_grafana.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288618 20 -rw-r--r-- 1 ubuntu ubuntu 16715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_task.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288585 4 -rw-r--r-- 1 ubuntu ubuntu 2349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_auth.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288601 56 -rw-r--r-- 1 ubuntu ubuntu 53551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_iscsi.py 2024-03-27T21:32:58.392 INFO:teuthology.orchestra.run.smithi063.stdout: 288596 8 -rw-r--r-- 1 ubuntu ubuntu 4523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_exceptions.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288603 8 -rw-r--r-- 1 ubuntu ubuntu 4800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_notification.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288599 4 -rw-r--r-- 1 ubuntu ubuntu 2839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_home.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288602 12 -rw-r--r-- 1 ubuntu ubuntu 8762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_nfs.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288612 4 -rw-r--r-- 1 ubuntu ubuntu 2790 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_rest_tasks.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288581 16 -rw-r--r-- 1 ubuntu ubuntu 13889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/__init__.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288582 4 -rw-r--r-- 1 ubuntu ubuntu 1534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/helper.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288600 24 -rw-r--r-- 1 ubuntu ubuntu 21363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_host.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288604 4 -rw-r--r-- 1 ubuntu ubuntu 1363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_orchestrator.py 2024-03-27T21:32:58.393 INFO:teuthology.orchestra.run.smithi063.stdout: 288588 4 -rw-r--r-- 1 ubuntu ubuntu 1769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_ceph_users.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288593 4 -rw-r--r-- 1 ubuntu ubuntu 1488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_daemon.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288584 4 -rw-r--r-- 1 ubuntu ubuntu 2970 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_api_auditing.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288590 4 -rw-r--r-- 1 ubuntu ubuntu 2307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_cluster_upgrade.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288595 4 -rw-r--r-- 1 ubuntu ubuntu 837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_erasure_code_profile.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288609 12 -rw-r--r-- 1 ubuntu ubuntu 10907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_rbd_mirroring.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288587 8 -rw-r--r-- 1 ubuntu ubuntu 6852 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_ceph_service.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288614 16 -rw-r--r-- 1 ubuntu ubuntu 14697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_rgw_client.py 2024-03-27T21:32:58.394 INFO:teuthology.orchestra.run.smithi063.stdout: 288591 8 -rw-r--r-- 1 ubuntu ubuntu 6390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tests/test_controllers.py 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 286637 4 -rw-r--r-- 1 ubuntu ubuntu 859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/CMakeLists.txt 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 288579 12 -rw-r--r-- 1 ubuntu ubuntu 9205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/settings.py 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 286644 8 -rw-r--r-- 1 ubuntu ubuntu 6732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/awsauth.py 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 288541 4 -rw-r--r-- 1 ubuntu ubuntu 236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/requirements-lint.txt 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 288530 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 288537 4 -rw-r--r-- 1 ubuntu ubuntu 3898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/pluggy.py 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 288534 4 -rw-r--r-- 1 ubuntu ubuntu 1580 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/interfaces.py 2024-03-27T21:32:58.395 INFO:teuthology.orchestra.run.smithi063.stdout: 288539 4 -rw-r--r-- 1 ubuntu ubuntu 3486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/ttl_cache.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288531 4 -rw-r--r-- 1 ubuntu ubuntu 2420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/__init__.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288533 8 -rw-r--r-- 1 ubuntu ubuntu 5576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/feature_toggles.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288532 4 -rw-r--r-- 1 ubuntu ubuntu 2872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/debug.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288536 4 -rw-r--r-- 1 ubuntu ubuntu 3212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/motd.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288535 4 -rw-r--r-- 1 ubuntu ubuntu 1307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/lru_cache.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288538 4 -rw-r--r-- 1 ubuntu ubuntu 1253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/plugins/plugin.py 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288549 4 -rwxr-xr-x 1 ubuntu ubuntu 1367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/run-frontend-unittests.sh 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288540 4 -rw-r--r-- 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/requirements-extra.txt 2024-03-27T21:32:58.396 INFO:teuthology.orchestra.run.smithi063.stdout: 288550 4 -rw-r--r-- 1 ubuntu ubuntu 1482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/security.py 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286653 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/constraints.txt 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286710 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286724 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/babel.config.js 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286844 4 -rw-r--r-- 1 ubuntu ubuntu 242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/ngcc.config.js 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286719 4 -rw-r--r-- 1 ubuntu ubuntu 101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.prettierrc 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286845 1272 -rw-r--r-- 1 ubuntu ubuntu 1301840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/package-lock.json 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286721 8 -rw-r--r-- 1 ubuntu ubuntu 5191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/CMakeLists.txt 2024-03-27T21:32:58.397 INFO:teuthology.orchestra.run.smithi063.stdout: 286725 8 -rwxr-xr-x 1 ubuntu ubuntu 4576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cd.js 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 286720 4 -rw-r--r-- 1 ubuntu ubuntu 1137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.stylelintrc 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 286848 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 288477 4 -rw-r--r-- 1 ubuntu ubuntu 132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/jestGlobalMocks.ts 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 288478 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 288479 308 -rw-r--r-- 1 ubuntu ubuntu 313712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.cs.xlf 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 288481 308 -rw-r--r-- 1 ubuntu ubuntu 313872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.es-ES.xlf 2024-03-27T21:32:58.398 INFO:teuthology.orchestra.run.smithi063.stdout: 288490 308 -rw-r--r-- 1 ubuntu ubuntu 311502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.zh-TW.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288486 308 -rw-r--r-- 1 ubuntu ubuntu 314024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.ko-KR.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288483 308 -rw-r--r-- 1 ubuntu ubuntu 311974 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.id-ID.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288485 312 -rw-r--r-- 1 ubuntu ubuntu 315976 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.ja-JP.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288488 308 -rw-r--r-- 1 ubuntu ubuntu 313420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.pt-BR.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288484 308 -rw-r--r-- 1 ubuntu ubuntu 314101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.it-IT.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288482 308 -rw-r--r-- 1 ubuntu ubuntu 314184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.fr-FR.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288480 308 -rw-r--r-- 1 ubuntu ubuntu 313942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.de-DE.xlf 2024-03-27T21:32:58.399 INFO:teuthology.orchestra.run.smithi063.stdout: 288487 308 -rw-r--r-- 1 ubuntu ubuntu 312904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.pl-PL.xlf 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288489 308 -rw-r--r-- 1 ubuntu ubuntu 311581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/locale/messages.zh-CN.xlf 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288491 4 -rw-r--r-- 1 ubuntu ubuntu 880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/main.ts 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/environments 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288474 4 -rw-r--r-- 1 ubuntu ubuntu 458 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/environments/environment.tpl.ts 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288492 4 -rw-r--r-- 1 ubuntu ubuntu 1773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/polyfills.ts 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288476 4 -rw-r--r-- 1 ubuntu ubuntu 734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/index.html 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288475 4 -rw-r--r-- 1 ubuntu ubuntu 1150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/favicon.ico 2024-03-27T21:32:58.400 INFO:teuthology.orchestra.run.smithi063.stdout: 288495 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288513 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/vendor 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288516 4 -rw-r--r-- 1 ubuntu ubuntu 391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/vendor/_variables.scss 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288514 4 -rw-r--r-- 1 ubuntu ubuntu 528 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/vendor/_index.scss 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288515 4 -rw-r--r-- 1 ubuntu ubuntu 98 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/vendor/_style-overrides.scss 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288498 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288502 4 -rw-r--r-- 1 ubuntu ubuntu 1488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_forms.scss 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288501 4 -rw-r--r-- 1 ubuntu ubuntu 566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_dropdown.scss 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288505 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_index.scss 2024-03-27T21:32:58.401 INFO:teuthology.orchestra.run.smithi063.stdout: 288503 4 -rw-r--r-- 1 ubuntu ubuntu 103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_grid.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288506 4 -rw-r--r-- 1 ubuntu ubuntu 94 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_navs.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288504 4 -rw-r--r-- 1 ubuntu ubuntu 301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_icons.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288500 4 -rw-r--r-- 1 ubuntu ubuntu 1896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_buttons.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288507 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_toast.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288499 4 -rw-r--r-- 1 ubuntu ubuntu 1309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/ceph-custom/_basics.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288497 4 -rw-r--r-- 1 ubuntu ubuntu 1717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/bootstrap-extends.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288496 4 -rw-r--r-- 1 ubuntu ubuntu 1049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/_chart-tooltip.scss 2024-03-27T21:32:58.402 INFO:teuthology.orchestra.run.smithi063.stdout: 288508 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/defaults 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288509 4 -rw-r--r-- 1 ubuntu ubuntu 4069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/defaults/_bootstrap-defaults.scss 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288510 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/defaults/_functions.scss 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288511 4 -rw-r--r-- 1 ubuntu ubuntu 64 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/defaults/_index.scss 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288512 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles/defaults/_mixins.scss 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288493 4 -rw-r--r-- 1 ubuntu ubuntu 430 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/setupJest.ts 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288520 4 -rw-r--r-- 1 ubuntu ubuntu 104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/typings.d.ts 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288494 8 -rw-r--r-- 1 ubuntu ubuntu 4184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/styles.scss 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288517 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/testing 2024-03-27T21:32:58.403 INFO:teuthology.orchestra.run.smithi063.stdout: 288518 4 -rw-r--r-- 1 ubuntu ubuntu 746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/testing/activated-route-stub.ts 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 288519 24 -rw-r--r-- 1 ubuntu ubuntu 20809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/testing/unit-test-helper.ts 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 286849 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 287808 4 drwxr-xr-x 16 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 288112 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 288129 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-key-value 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 288130 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-key-value/table-key-value.component.html 2024-03-27T21:32:58.404 INFO:teuthology.orchestra.run.smithi063.stdout: 288132 12 -rw-r--r-- 1 ubuntu ubuntu 11424 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-key-value/table-key-value.component.spec.ts 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288131 4 -rw-r--r-- 1 ubuntu ubuntu 74 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-key-value/table-key-value.component.scss 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288133 8 -rw-r--r-- 1 ubuntu ubuntu 6160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-key-value/table-key-value.component.ts 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288139 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288142 28 -rw-r--r-- 1 ubuntu ubuntu 26419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table/table.component.spec.ts 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288141 8 -rw-r--r-- 1 ubuntu ubuntu 5744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table/table.component.scss 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288140 16 -rw-r--r-- 1 ubuntu ubuntu 13133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table/table.component.html 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288143 32 -rw-r--r-- 1 ubuntu ubuntu 28945 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table/table.component.ts 2024-03-27T21:32:58.405 INFO:teuthology.orchestra.run.smithi063.stdout: 288118 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/crud-table 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288119 4 -rw-r--r-- 1 ubuntu ubuntu 2458 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/crud-table/crud-table.component.html 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288122 8 -rw-r--r-- 1 ubuntu ubuntu 7234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/crud-table/crud-table.component.ts 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288120 4 -rw-r--r-- 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/crud-table/crud-table.component.scss 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288121 4 -rw-r--r-- 1 ubuntu ubuntu 1841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/crud-table/crud-table.component.spec.ts 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288124 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-actions 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288127 8 -rw-r--r-- 1 ubuntu ubuntu 7396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-actions/table-actions.component.spec.ts 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288126 4 -rw-r--r-- 1 ubuntu ubuntu 291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-actions/table-actions.component.scss 2024-03-27T21:32:58.406 INFO:teuthology.orchestra.run.smithi063.stdout: 288125 4 -rw-r--r-- 1 ubuntu ubuntu 1863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-actions/table-actions.component.html 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288128 8 -rw-r--r-- 1 ubuntu ubuntu 4958 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-actions/table-actions.component.ts 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288123 8 -rw-r--r-- 1 ubuntu ubuntu 4283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/datatable.module.ts 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/checked-table-form 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288114 4 -rw-r--r-- 1 ubuntu ubuntu 1947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/checked-table-form/checked-table-form.component.html 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288117 8 -rw-r--r-- 1 ubuntu ubuntu 6311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/checked-table-form/checked-table-form.component.ts 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288115 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/checked-table-form/checked-table-form.component.scss 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288116 8 -rw-r--r-- 1 ubuntu ubuntu 4756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/checked-table-form/checked-table-form.component.spec.ts 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288134 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-pagination 2024-03-27T21:32:58.407 INFO:teuthology.orchestra.run.smithi063.stdout: 288136 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-pagination/table-pagination.component.scss 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288137 4 -rw-r--r-- 1 ubuntu ubuntu 1595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-pagination/table-pagination.component.spec.ts 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288138 4 -rw-r--r-- 1 ubuntu ubuntu 2348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-pagination/table-pagination.component.ts 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288135 4 -rw-r--r-- 1 ubuntu ubuntu 1464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/datatable/table-pagination/table-pagination.component.html 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288189 4 -rw-r--r-- 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/notification-type.enum.ts 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288187 4 -rw-r--r-- 1 ubuntu ubuntu 98 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/health-label.enum.ts 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288192 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/unix_errno.enum.ts 2024-03-27T21:32:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 288193 4 -rw-r--r-- 1 ubuntu ubuntu 103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/view-cache-status.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288191 4 -rw-r--r-- 1 ubuntu ubuntu 325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/retention-frequency.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288183 4 -rw-r--r-- 1 ubuntu ubuntu 3184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/dashboard-promqls.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288186 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/health-icon.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288182 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/components.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288190 4 -rw-r--r-- 1 ubuntu ubuntu 332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/repeat-frequency.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288181 4 -rw-r--r-- 1 ubuntu ubuntu 2007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/cell-template.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288188 8 -rw-r--r-- 1 ubuntu ubuntu 4469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/icons.enum.ts 2024-03-27T21:32:58.409 INFO:teuthology.orchestra.run.smithi063.stdout: 288185 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/health-color.enum.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288184 4 -rw-r--r-- 1 ubuntu ubuntu 171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/enum/hardware.enum.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288302 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288313 4 -rw-r--r-- 1 ubuntu ubuntu 618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/ceph-short-version.pipe.spec.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288316 4 -rw-r--r-- 1 ubuntu ubuntu 1489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/dimless-binary.pipe.spec.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288373 4 -rw-r--r-- 1 ubuntu ubuntu 544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/truncate.pipe.spec.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288327 4 -rw-r--r-- 1 ubuntu ubuntu 534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/filter.pipe.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288338 4 -rw-r--r-- 1 ubuntu ubuntu 277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/join.pipe.spec.ts 2024-03-27T21:32:58.410 INFO:teuthology.orchestra.run.smithi063.stdout: 288335 4 -rw-r--r-- 1 ubuntu ubuntu 194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/iops.pipe.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288312 4 -rw-r--r-- 1 ubuntu ubuntu 679 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/ceph-release-name.pipe.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288317 4 -rw-r--r-- 1 ubuntu ubuntu 485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/dimless-binary.pipe.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288328 4 -rw-r--r-- 1 ubuntu ubuntu 1131 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/health-color.pipe.spec.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288374 4 -rw-r--r-- 1 ubuntu ubuntu 384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/truncate.pipe.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288326 4 -rw-r--r-- 1 ubuntu ubuntu 1282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/filter.pipe.spec.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288368 4 -rw-r--r-- 1 ubuntu ubuntu 250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/round.pipe.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288310 4 -rw-r--r-- 1 ubuntu ubuntu 723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/cd-date.pipe.ts 2024-03-27T21:32:58.411 INFO:teuthology.orchestra.run.smithi063.stdout: 288362 4 -rw-r--r-- 1 ubuntu ubuntu 299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/pluralize.pipe.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288311 4 -rw-r--r-- 1 ubuntu ubuntu 823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/ceph-release-name.pipe.spec.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288355 4 -rw-r--r-- 1 ubuntu ubuntu 476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/ordinal.pipe.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288366 4 -rw-r--r-- 1 ubuntu ubuntu 1721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/relative-date.pipe.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288305 4 -rw-r--r-- 1 ubuntu ubuntu 835 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/boolean-text.pipe.spec.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288369 4 -rw-r--r-- 1 ubuntu ubuntu 735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/sanitize-html.pipe.spec.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288304 4 -rwxr-xr-x 1 ubuntu ubuntu 688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/array.pipe.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288332 4 -rw-r--r-- 1 ubuntu ubuntu 610 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/health-label.pipe.spec.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288352 4 -rw-r--r-- 1 ubuntu ubuntu 1085 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/octal-to-human-readable.pipe.spec.ts 2024-03-27T21:32:58.412 INFO:teuthology.orchestra.run.smithi063.stdout: 288321 4 -rw-r--r-- 1 ubuntu ubuntu 1239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/duration.pipe.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288359 4 -rw-r--r-- 1 ubuntu ubuntu 482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/path.pipe.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288345 4 -rw-r--r-- 1 ubuntu ubuntu 1190 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/mds-summary.pipe.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288339 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/join.pipe.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288356 4 -rw-r--r-- 1 ubuntu ubuntu 969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/osd-summary.pipe.spec.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288319 4 -rw-r--r-- 1 ubuntu ubuntu 456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/dimless.pipe.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288347 4 -rw-r--r-- 1 ubuntu ubuntu 858 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/mgr-summary.pipe.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288361 4 -rw-r--r-- 1 ubuntu ubuntu 199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/pluralize.pipe.spec.ts 2024-03-27T21:32:58.413 INFO:teuthology.orchestra.run.smithi063.stdout: 288344 4 -rw-r--r-- 1 ubuntu ubuntu 1652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/mds-summary.pipe.spec.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288370 4 -rw-r--r-- 1 ubuntu ubuntu 422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/sanitize-html.pipe.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288353 4 -rw-r--r-- 1 ubuntu ubuntu 2359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/octal-to-human-readable.pipe.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288343 4 -rw-r--r-- 1 ubuntu ubuntu 311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/map.pipe.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288329 4 -rw-r--r-- 1 ubuntu ubuntu 506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/health-color.pipe.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288364 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/rbd-configuration-source.pipe.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288365 4 -rw-r--r-- 1 ubuntu ubuntu 1445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/relative-date.pipe.spec.ts 2024-03-27T21:32:58.414 INFO:teuthology.orchestra.run.smithi063.stdout: 288367 4 -rw-r--r-- 1 ubuntu ubuntu 273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/round.pipe.spec.ts 2024-03-27T21:32:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: 288308 4 -rwxr-xr-x 1 ubuntu ubuntu 472 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/boolean.pipe.ts 2024-03-27T21:32:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: 288336 4 -rw-r--r-- 1 ubuntu ubuntu 428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/iscsi-backstore.pipe.spec.ts 2024-03-27T21:32:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: 288307 4 -rwxr-xr-x 1 ubuntu ubuntu 1309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/boolean.pipe.spec.ts 2024-03-27T21:32:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: 288303 4 -rwxr-xr-x 1 ubuntu ubuntu 523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/array.pipe.spec.ts 2024-03-27T21:32:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: 288324 4 -rw-r--r-- 1 ubuntu ubuntu 348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/encode-uri.pipe.spec.ts 2024-03-27T21:32:58.415 INFO:teuthology.orchestra.run.smithi063.stdout: 288334 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/iops.pipe.spec.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288320 4 -rw-r--r-- 1 ubuntu ubuntu 517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/duration.pipe.spec.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288348 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/milliseconds.pipe.spec.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288323 4 -rw-r--r-- 1 ubuntu ubuntu 339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/empty.pipe.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288349 4 -rw-r--r-- 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/milliseconds.pipe.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288375 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/upper-first.pipe.spec.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288371 4 -rw-r--r-- 1 ubuntu ubuntu 1247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/search-highlight.pipe.spec.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288340 4 -rw-r--r-- 1 ubuntu ubuntu 753 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/log-priority.pipe.spec.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288337 4 -rw-r--r-- 1 ubuntu ubuntu 314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/iscsi-backstore.pipe.ts 2024-03-27T21:32:58.416 INFO:teuthology.orchestra.run.smithi063.stdout: 288376 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/upper-first.pipe.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288341 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/log-priority.pipe.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288363 4 -rw-r--r-- 1 ubuntu ubuntu 658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/rbd-configuration-source.pipe.spec.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288314 4 -rw-r--r-- 1 ubuntu ubuntu 482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/ceph-short-version.pipe.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288309 4 -rw-r--r-- 1 ubuntu ubuntu 609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/cd-date.pipe.spec.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288354 4 -rw-r--r-- 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/ordinal.pipe.spec.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288325 4 -rw-r--r-- 1 ubuntu ubuntu 214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/encode-uri.pipe.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288360 8 -rwxr-xr-x 1 ubuntu ubuntu 4283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/pipes.module.ts 2024-03-27T21:32:58.417 INFO:teuthology.orchestra.run.smithi063.stdout: 288315 4 -rw-r--r-- 1 ubuntu ubuntu 521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/dimless-binary-per-second.pipe.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288357 4 -rw-r--r-- 1 ubuntu ubuntu 943 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/osd-summary.pipe.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288318 4 -rw-r--r-- 1 ubuntu ubuntu 1446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/dimless.pipe.spec.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288306 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/boolean-text.pipe.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288346 4 -rw-r--r-- 1 ubuntu ubuntu 865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/mgr-summary.pipe.spec.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288358 4 -rw-r--r-- 1 ubuntu ubuntu 482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/path.pipe.spec.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288351 4 -rw-r--r-- 1 ubuntu ubuntu 318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/not-available.pipe.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288350 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/not-available.pipe.spec.ts 2024-03-27T21:32:58.418 INFO:teuthology.orchestra.run.smithi063.stdout: 288330 4 -rw-r--r-- 1 ubuntu ubuntu 573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/health-icon.pipe.spec.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 288372 4 -rw-r--r-- 1 ubuntu ubuntu 604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/search-highlight.pipe.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 288322 4 -rw-r--r-- 1 ubuntu ubuntu 404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/empty.pipe.spec.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 288342 4 -rw-r--r-- 1 ubuntu ubuntu 628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/map.pipe.spec.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 288333 4 -rw-r--r-- 1 ubuntu ubuntu 344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/health-label.pipe.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 288331 4 -rw-r--r-- 1 ubuntu ubuntu 331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/pipes/health-icon.pipe.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 287905 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 287913 4 -rw-r--r-- 1 ubuntu ubuntu 1224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/table-status-view-cache.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 287910 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/css-helper.ts 2024-03-27T21:32:58.419 INFO:teuthology.orchestra.run.smithi063.stdout: 287906 4 -rw-r--r-- 1 ubuntu ubuntu 1461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/cd-helper.class.spec.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287911 4 -rw-r--r-- 1 ubuntu ubuntu 729 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/list-with-details.class.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287908 8 -rw-r--r-- 1 ubuntu ubuntu 7717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/crush.node.selection.class.spec.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287907 4 -rw-r--r-- 1 ubuntu ubuntu 924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/cd-helper.class.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287909 8 -rw-r--r-- 1 ubuntu ubuntu 6996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/crush.node.selection.class.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287914 4 -rw-r--r-- 1 ubuntu ubuntu 433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/table-status.spec.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287912 4 -rw-r--r-- 1 ubuntu ubuntu 1582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/table-status-view-cache.spec.ts 2024-03-27T21:32:58.420 INFO:teuthology.orchestra.run.smithi063.stdout: 287915 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/classes/table-status.ts 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288245 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/helpers 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288246 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/helpers/helpers.module.ts 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288247 4 -rw-r--r-- 1 ubuntu ubuntu 757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/helpers/prometheus-list-helper.ts 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288248 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288281 4 -rw-r--r-- 1 ubuntu ubuntu 774 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/image-spec.ts 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288297 4 -rw-r--r-- 1 ubuntu ubuntu 382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/summary.model.ts 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288296 4 -rw-r--r-- 1 ubuntu ubuntu 761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/snapshot-schedule.ts 2024-03-27T21:32:58.421 INFO:teuthology.orchestra.run.smithi063.stdout: 288283 4 -rw-r--r-- 1 ubuntu ubuntu 149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/login-response.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288273 4 -rw-r--r-- 1 ubuntu ubuntu 463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/crush-rule.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288257 4 -rw-r--r-- 1 ubuntu ubuntu 1596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-action.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288291 4 -rw-r--r-- 1 ubuntu ubuntu 1747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/permissions.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288255 4 -rw-r--r-- 1 ubuntu ubuntu 397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-pwd-expiration-settings.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288250 4 -rw-r--r-- 1 ubuntu ubuntu 2179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/breadcrumbs.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288277 4 -rw-r--r-- 1 ubuntu ubuntu 375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/erasure-code-profile.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288259 4 -rw-r--r-- 1 ubuntu ubuntu 357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-column-filters-change.ts 2024-03-27T21:32:58.422 INFO:teuthology.orchestra.run.smithi063.stdout: 288265 4 -rw-r--r-- 1 ubuntu ubuntu 403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cephfs-directory-models.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288274 4 -rw-r--r-- 1 ubuntu ubuntu 113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/crush-step.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288249 4 -rw-r--r-- 1 ubuntu ubuntu 565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/alertmanager-silence.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288264 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-user-config.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288285 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/multi-cluster.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288251 4 -rw-r--r-- 1 ubuntu ubuntu 104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-details.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288280 4 -rw-r--r-- 1 ubuntu ubuntu 175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/flag.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288287 4 -rw-r--r-- 1 ubuntu ubuntu 158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/orchestrator.interface.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288267 4 -rw-r--r-- 1 ubuntu ubuntu 517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cephfs-subvolume.model.ts 2024-03-27T21:32:58.423 INFO:teuthology.orchestra.run.smithi063.stdout: 288292 4 -rw-r--r-- 1 ubuntu ubuntu 677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/pool-form-info.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288278 4 -rw-r--r-- 1 ubuntu ubuntu 118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/executing-task.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288263 4 -rw-r--r-- 1 ubuntu ubuntu 903 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-selection.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288290 4 -rw-r--r-- 1 ubuntu ubuntu 3533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/permission.spec.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288261 4 -rw-r--r-- 1 ubuntu ubuntu 1199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-fetch-data-context.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288260 4 -rw-r--r-- 1 ubuntu ubuntu 1305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-column.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288300 4 -rw-r--r-- 1 ubuntu ubuntu 301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/upgrade.interface.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288299 4 -rw-r--r-- 1 ubuntu ubuntu 188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/task.ts 2024-03-27T21:32:58.424 INFO:teuthology.orchestra.run.smithi063.stdout: 288279 4 -rw-r--r-- 1 ubuntu ubuntu 317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/finished-task.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288270 4 -rw-r--r-- 1 ubuntu ubuntu 69 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/credentials.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288276 4 -rw-r--r-- 1 ubuntu ubuntu 694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/devices.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288284 4 -rw-r--r-- 1 ubuntu ubuntu 95 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/mirroring-summary.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288295 8 -rw-r--r-- 1 ubuntu ubuntu 6914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/smart.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288275 4 -rw-r--r-- 1 ubuntu ubuntu 260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/daemon.interface.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288286 4 -rw-r--r-- 1 ubuntu ubuntu 751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/orchestrator.enum.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288252 4 -rw-r--r-- 1 ubuntu ubuntu 883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-form-modal-field-config.ts 2024-03-27T21:32:58.425 INFO:teuthology.orchestra.run.smithi063.stdout: 288298 4 -rw-r--r-- 1 ubuntu ubuntu 150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/task-exception.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288282 4 -rw-r--r-- 1 ubuntu ubuntu 259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/inventory-device-type.model.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288268 4 -rw-r--r-- 1 ubuntu ubuntu 3630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/chart-tooltip.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288256 4 -rw-r--r-- 1 ubuntu ubuntu 1213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-pwd-policy-settings.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288293 4 -rw-r--r-- 1 ubuntu ubuntu 1894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/prometheus-alerts.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288266 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cephfs-subvolume-group.model.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288301 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/wizard-steps.ts 2024-03-27T21:32:58.426 INFO:teuthology.orchestra.run.smithi063.stdout: 288269 4 -rw-r--r-- 1 ubuntu ubuntu 1008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/configuration.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288262 4 -rw-r--r-- 1 ubuntu ubuntu 601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-paging.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288294 4 -rw-r--r-- 1 ubuntu ubuntu 1138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/service.interface.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288288 4 -rw-r--r-- 1 ubuntu ubuntu 513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/osd-deployment-options.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288271 4 -rw-r--r-- 1 ubuntu ubuntu 418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/crud-table-metadata.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288258 4 -rw-r--r-- 1 ubuntu ubuntu 264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-table-column-filter.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288272 4 -rw-r--r-- 1 ubuntu ubuntu 394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/crush-node.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288254 4 -rw-r--r-- 1 ubuntu ubuntu 1675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-notification.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288253 4 -rw-r--r-- 1 ubuntu ubuntu 2771 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/cd-notification.spec.ts 2024-03-27T21:32:58.427 INFO:teuthology.orchestra.run.smithi063.stdout: 288289 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/models/osd-settings.ts 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288110 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/constants 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288111 12 -rw-r--r-- 1 ubuntu ubuntu 8547 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/constants/app.constants.ts 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288147 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288159 4 -rw-r--r-- 1 ubuntu ubuntu 2814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/form-loading.directive.spec.ts 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288165 4 -rw-r--r-- 1 ubuntu ubuntu 258 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/milliseconds.directive.spec.ts 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288164 4 -rw-r--r-- 1 ubuntu ubuntu 841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/iops.directive.ts 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288160 4 -rw-r--r-- 1 ubuntu ubuntu 1432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/form-loading.directive.ts 2024-03-27T21:32:58.428 INFO:teuthology.orchestra.run.smithi063.stdout: 288174 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/password-button.directive.spec.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288176 4 -rw-r--r-- 1 ubuntu ubuntu 1489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/stateful-tab.directive.spec.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288175 4 -rw-r--r-- 1 ubuntu ubuntu 1440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/password-button.directive.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288157 4 -rw-r--r-- 1 ubuntu ubuntu 2204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/form-input-disable.directive.spec.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288177 4 -rw-r--r-- 1 ubuntu ubuntu 994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/stateful-tab.directive.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288154 4 -rw-r--r-- 1 ubuntu ubuntu 345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/dimless-binary.directive.spec.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288150 4 -rw-r--r-- 1 ubuntu ubuntu 2565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/autofocus.directive.spec.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288156 4 -rw-r--r-- 1 ubuntu ubuntu 2033 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/directives.module.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288151 4 -rw-r--r-- 1 ubuntu ubuntu 667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/autofocus.directive.ts 2024-03-27T21:32:58.429 INFO:teuthology.orchestra.run.smithi063.stdout: 288167 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288169 4 -rw-r--r-- 1 ubuntu ubuntu 2684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation/cd-form-control.directive.ts 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288170 4 -rw-r--r-- 1 ubuntu ubuntu 1521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation/cd-form-group.directive.spec.ts 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288171 4 -rw-r--r-- 1 ubuntu ubuntu 2346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation/cd-form-group.directive.ts 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288172 4 -rw-r--r-- 1 ubuntu ubuntu 1476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation/cd-form-validation.directive.spec.ts 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288173 4 -rw-r--r-- 1 ubuntu ubuntu 2333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation/cd-form-validation.directive.ts 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288168 4 -rw-r--r-- 1 ubuntu ubuntu 1524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/ng-bootstrap-form-validation/cd-form-control.directive.spec.ts 2024-03-27T21:32:58.430 INFO:teuthology.orchestra.run.smithi063.stdout: 288163 4 -rw-r--r-- 1 ubuntu ubuntu 226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/iops.directive.spec.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288161 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/form-scope.directive.spec.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288178 4 -rw-r--r-- 1 ubuntu ubuntu 1581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/trim.directive.spec.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288158 4 -rw-r--r-- 1 ubuntu ubuntu 964 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/form-input-disable.directive.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288149 4 -rw-r--r-- 1 ubuntu ubuntu 1500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/auth-storage.directive.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288179 4 -rw-r--r-- 1 ubuntu ubuntu 489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/trim.directive.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288162 4 -rw-r--r-- 1 ubuntu ubuntu 160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/form-scope.directive.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288148 4 -rw-r--r-- 1 ubuntu ubuntu 3535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/auth-storage.directive.spec.ts 2024-03-27T21:32:58.431 INFO:teuthology.orchestra.run.smithi063.stdout: 288155 4 -rw-r--r-- 1 ubuntu ubuntu 3497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/dimless-binary.directive.ts 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 288166 4 -rw-r--r-- 1 ubuntu ubuntu 851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/milliseconds.directive.ts 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 288152 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/dimless-binary-per-second.directive.spec.ts 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 288153 4 -rw-r--r-- 1 ubuntu ubuntu 3647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/directives/dimless-binary-per-second.directive.ts 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 287916 4 drwxr-xr-x 39 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 287937 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 287939 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card/card.component.scss 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 287940 4 -rw-r--r-- 1 ubuntu ubuntu 954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card/card.component.spec.ts 2024-03-27T21:32:58.432 INFO:teuthology.orchestra.run.smithi063.stdout: 287941 4 -rw-r--r-- 1 ubuntu ubuntu 552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card/card.component.ts 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 287938 4 -rw-r--r-- 1 ubuntu ubuntu 948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card/card.component.html 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 288007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-modal 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 288009 0 -rwxr-xr-x 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-modal/form-modal.component.scss 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 288008 4 -rwxr-xr-x 1 ubuntu ubuntu 2956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-modal/form-modal.component.html 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 288011 4 -rwxr-xr-x 1 ubuntu ubuntu 3587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-modal/form-modal.component.ts 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 288010 8 -rwxr-xr-x 1 ubuntu ubuntu 4646 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-modal/form-modal.component.spec.ts 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 287977 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/custom-login-banner 2024-03-27T21:32:58.433 INFO:teuthology.orchestra.run.smithi063.stdout: 287980 4 -rw-r--r-- 1 ubuntu ubuntu 794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/custom-login-banner/custom-login-banner.component.spec.ts 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287979 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/custom-login-banner/custom-login-banner.component.scss 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287981 4 -rw-r--r-- 1 ubuntu ubuntu 635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/custom-login-banner/custom-login-banner.component.ts 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287978 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/custom-login-banner/custom-login-banner.component.html 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287932 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-row 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287935 4 -rw-r--r-- 1 ubuntu ubuntu 582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-row/card-row.component.spec.ts 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287936 4 -rw-r--r-- 1 ubuntu ubuntu 1156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-row/card-row.component.ts 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287933 8 -rw-r--r-- 1 ubuntu ubuntu 6594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-row/card-row.component.html 2024-03-27T21:32:58.434 INFO:teuthology.orchestra.run.smithi063.stdout: 287934 4 -rw-r--r-- 1 ubuntu ubuntu 322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-row/card-row.component.scss 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 287972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/critical-confirmation-modal 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 287974 4 -rw-r--r-- 1 ubuntu ubuntu 148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/critical-confirmation-modal/critical-confirmation-modal.component.scss 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 287976 4 -rw-r--r-- 1 ubuntu ubuntu 2245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/critical-confirmation-modal/critical-confirmation-modal.component.ts 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 287973 4 -rw-r--r-- 1 ubuntu ubuntu 2649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/critical-confirmation-modal/critical-confirmation-modal.component.html 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 287975 12 -rw-r--r-- 1 ubuntu ubuntu 8300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/critical-confirmation-modal/critical-confirmation-modal.component.spec.ts 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 288002 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-button-panel 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 288006 4 -rw-r--r-- 1 ubuntu ubuntu 1711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-button-panel/form-button-panel.component.ts 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 288003 4 -rw-r--r-- 1 ubuntu ubuntu 494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-button-panel/form-button-panel.component.html 2024-03-27T21:32:58.435 INFO:teuthology.orchestra.run.smithi063.stdout: 288004 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-button-panel/form-button-panel.component.scss 2024-03-27T21:32:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: 288005 4 -rw-r--r-- 1 ubuntu ubuntu 751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-button-panel/form-button-panel.component.spec.ts 2024-03-27T21:32:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: 288090 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/telemetry-notification 2024-03-27T21:32:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: 288091 4 -rw-r--r-- 1 ubuntu ubuntu 596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/telemetry-notification/telemetry-notification.component.html 2024-03-27T21:32:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: 288094 4 -rw-r--r-- 1 ubuntu ubuntu 2264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/telemetry-notification/telemetry-notification.component.ts 2024-03-27T21:32:58.436 INFO:teuthology.orchestra.run.smithi063.stdout: 288093 8 -rw-r--r-- 1 ubuntu ubuntu 4314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/telemetry-notification/telemetry-notification.component.spec.ts 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 288092 4 -rw-r--r-- 1 ubuntu ubuntu 380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/telemetry-notification/telemetry-notification.component.scss 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 287922 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/back-button 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 287924 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/back-button/back-button.component.scss 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 287925 4 -rw-r--r-- 1 ubuntu ubuntu 731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/back-button/back-button.component.spec.ts 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 287926 4 -rw-r--r-- 1 ubuntu ubuntu 774 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/back-button/back-button.component.ts 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 287923 4 -rw-r--r-- 1 ubuntu ubuntu 141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/back-button/back-button.component.html 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 288012 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/grafana 2024-03-27T21:32:58.437 INFO:teuthology.orchestra.run.smithi063.stdout: 288016 8 -rw-r--r-- 1 ubuntu ubuntu 5092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/grafana/grafana.component.ts 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 288015 8 -rw-r--r-- 1 ubuntu ubuntu 4172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/grafana/grafana.component.spec.ts 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 288013 4 -rw-r--r-- 1 ubuntu ubuntu 2955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/grafana/grafana.component.html 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 288014 4 -rw-r--r-- 1 ubuntu ubuntu 318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/grafana/grafana.component.scss 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 287992 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/download-button 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 287996 4 -rw-r--r-- 1 ubuntu ubuntu 975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/download-button/download-button.component.ts 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 287993 4 -rw-r--r-- 1 ubuntu ubuntu 618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/download-button/download-button.component.html 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 287995 4 -rw-r--r-- 1 ubuntu ubuntu 1259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/download-button/download-button.component.spec.ts 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 287994 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/download-button/download-button.component.scss 2024-03-27T21:32:58.438 INFO:teuthology.orchestra.run.smithi063.stdout: 288017 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/help-text 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 288018 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/help-text/help-text.component.html 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 288020 4 -rw-r--r-- 1 ubuntu ubuntu 607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/help-text/help-text.component.spec.ts 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 288021 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/help-text/help-text.component.ts 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 288019 4 -rw-r--r-- 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/help-text/help-text.component.scss 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 287997 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-advanced-fieldset 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 287998 4 -rw-r--r-- 1 ubuntu ubuntu 673 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-advanced-fieldset/form-advanced-fieldset.component.html 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 287999 4 -rw-r--r-- 1 ubuntu ubuntu 596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-advanced-fieldset/form-advanced-fieldset.component.scss 2024-03-27T21:32:58.439 INFO:teuthology.orchestra.run.smithi063.stdout: 288000 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-advanced-fieldset/form-advanced-fieldset.component.spec.ts 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 288001 4 -rw-r--r-- 1 ubuntu ubuntu 296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/form-advanced-fieldset/form-advanced-fieldset.component.ts 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287987 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/doc 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287989 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/doc/doc.component.scss 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287988 4 -rw-r--r-- 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/doc/doc.component.html 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287990 4 -rw-r--r-- 1 ubuntu ubuntu 813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/doc/doc.component.spec.ts 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287991 4 -rw-r--r-- 1 ubuntu ubuntu 701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/doc/doc.component.ts 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287942 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/cd-label 2024-03-27T21:32:58.440 INFO:teuthology.orchestra.run.smithi063.stdout: 287943 4 -rw-r--r-- 1 ubuntu ubuntu 328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/cd-label/cd-label.component.html 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287944 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/cd-label/cd-label.component.scss 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287945 4 -rw-r--r-- 1 ubuntu ubuntu 706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/cd-label/cd-label.component.spec.ts 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287946 4 -rw-r--r-- 1 ubuntu ubuntu 297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/cd-label/cd-label.component.ts 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287947 4 -rw-r--r-- 1 ubuntu ubuntu 735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/cd-label/color-class-from-text.pipe.ts 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287953 8 -rw-r--r-- 1 ubuntu ubuntu 6245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/components.module.ts 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287948 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/code-block 2024-03-27T21:32:58.441 INFO:teuthology.orchestra.run.smithi063.stdout: 287950 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/code-block/code-block.component.scss 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 287949 4 -rw-r--r-- 1 ubuntu ubuntu 769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/code-block/code-block.component.html 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 287952 4 -rw-r--r-- 1 ubuntu ubuntu 333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/code-block/code-block.component.ts 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 287951 4 -rw-r--r-- 1 ubuntu ubuntu 1263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/code-block/code-block.component.spec.ts 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 288100 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/vertical-navigation 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 288101 4 -rw-r--r-- 1 ubuntu ubuntu 807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/vertical-navigation/vertical-navigation.component.html 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 288103 4 -rw-r--r-- 1 ubuntu ubuntu 2067 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/vertical-navigation/vertical-navigation.component.spec.ts 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 288104 4 -rw-r--r-- 1 ubuntu ubuntu 1082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/vertical-navigation/vertical-navigation.component.ts 2024-03-27T21:32:58.442 INFO:teuthology.orchestra.run.smithi063.stdout: 288102 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/vertical-navigation/vertical-navigation.component.scss 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/motd 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288044 4 -rw-r--r-- 1 ubuntu ubuntu 312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/motd/motd.component.html 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288046 4 -rw-r--r-- 1 ubuntu ubuntu 829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/motd/motd.component.spec.ts 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288047 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/motd/motd.component.ts 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288045 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/motd/motd.component.scss 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/refresh-selector 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288066 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/refresh-selector/refresh-selector.component.spec.ts 2024-03-27T21:32:58.443 INFO:teuthology.orchestra.run.smithi063.stdout: 288065 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/refresh-selector/refresh-selector.component.scss 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288067 4 -rw-r--r-- 1 ubuntu ubuntu 910 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/refresh-selector/refresh-selector.component.ts 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288064 4 -rw-r--r-- 1 ubuntu ubuntu 653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/refresh-selector/refresh-selector.component.html 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288080 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/sparkline 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288081 4 -rw-r--r-- 1 ubuntu ubuntu 283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/sparkline/sparkline.component.html 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288084 4 -rw-r--r-- 1 ubuntu ubuntu 3180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/sparkline/sparkline.component.ts 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288083 4 -rw-r--r-- 1 ubuntu ubuntu 2041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/sparkline/sparkline.component.spec.ts 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288082 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/sparkline/sparkline.component.scss 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288048 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar 2024-03-27T21:32:58.444 INFO:teuthology.orchestra.run.smithi063.stdout: 288050 4 -rw-r--r-- 1 ubuntu ubuntu 760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.scss 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 288051 8 -rw-r--r-- 1 ubuntu ubuntu 7483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.spec.ts 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 288049 8 -rw-r--r-- 1 ubuntu ubuntu 5251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.html 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 288052 8 -rw-r--r-- 1 ubuntu ubuntu 7056 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/notifications-sidebar/notifications-sidebar.component.ts 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 287982 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/date-time-picker 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 287985 4 -rw-r--r-- 1 ubuntu ubuntu 2002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/date-time-picker/date-time-picker.component.spec.ts 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 287984 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/date-time-picker/date-time-picker.component.scss 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 287983 4 -rw-r--r-- 1 ubuntu ubuntu 439 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/date-time-picker/date-time-picker.component.html 2024-03-27T21:32:58.445 INFO:teuthology.orchestra.run.smithi063.stdout: 287986 4 -rw-r--r-- 1 ubuntu ubuntu 1661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/date-time-picker/date-time-picker.component.ts 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288058 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/pwd-expiration-notification 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288061 8 -rw-r--r-- 1 ubuntu ubuntu 4126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/pwd-expiration-notification/pwd-expiration-notification.component.spec.ts 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288062 4 -rw-r--r-- 1 ubuntu ubuntu 2068 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/pwd-expiration-notification/pwd-expiration-notification.component.ts 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288059 4 -rw-r--r-- 1 ubuntu ubuntu 738 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/pwd-expiration-notification/pwd-expiration-notification.component.html 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288060 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/pwd-expiration-notification/pwd-expiration-notification.component.scss 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288033 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/loading-panel 2024-03-27T21:32:58.446 INFO:teuthology.orchestra.run.smithi063.stdout: 288037 4 -rw-r--r-- 1 ubuntu ubuntu 300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/loading-panel/loading-panel.component.ts 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288036 4 -rw-r--r-- 1 ubuntu ubuntu 739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/loading-panel/loading-panel.component.spec.ts 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288034 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/loading-panel/loading-panel.component.html 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288035 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/loading-panel/loading-panel.component.scss 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288038 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/modal 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288039 4 -rw-r--r-- 1 ubuntu ubuntu 532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/modal/modal.component.html 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288042 4 -rw-r--r-- 1 ubuntu ubuntu 728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/modal/modal.component.ts 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288040 4 -rw-r--r-- 1 ubuntu ubuntu 378 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/modal/modal.component.scss 2024-03-27T21:32:58.447 INFO:teuthology.orchestra.run.smithi063.stdout: 288041 4 -rw-r--r-- 1 ubuntu ubuntu 1749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/modal/modal.component.spec.ts 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287967 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/copy2clipboard-button 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287970 4 -rw-r--r-- 1 ubuntu ubuntu 1919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/copy2clipboard-button/copy2clipboard-button.component.spec.ts 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287969 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/copy2clipboard-button/copy2clipboard-button.component.scss 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287971 4 -rw-r--r-- 1 ubuntu ubuntu 1801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/copy2clipboard-button/copy2clipboard-button.component.ts 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287968 4 -rw-r--r-- 1 ubuntu ubuntu 419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/copy2clipboard-button/copy2clipboard-button.component.html 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287917 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/alert-panel 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287918 4 -rw-r--r-- 1 ubuntu ubuntu 1273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/alert-panel/alert-panel.component.html 2024-03-27T21:32:58.448 INFO:teuthology.orchestra.run.smithi063.stdout: 287919 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/alert-panel/alert-panel.component.scss 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287920 4 -rw-r--r-- 1 ubuntu ubuntu 725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/alert-panel/alert-panel.component.spec.ts 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287921 4 -rw-r--r-- 1 ubuntu ubuntu 1995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/alert-panel/alert-panel.component.ts 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287927 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-group 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287931 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-group/card-group.component.ts 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287929 4 -rw-r--r-- 1 ubuntu ubuntu 65 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-group/card-group.component.scss 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287928 4 -rw-r--r-- 1 ubuntu ubuntu 184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-group/card-group.component.html 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 287930 4 -rw-r--r-- 1 ubuntu ubuntu 614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/card-group/card-group.component.spec.ts 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 288027 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/language-selector 2024-03-27T21:32:58.449 INFO:teuthology.orchestra.run.smithi063.stdout: 288032 4 -rw-r--r-- 1 ubuntu ubuntu 473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/language-selector/supported-languages.enum.ts 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288030 4 -rw-r--r-- 1 ubuntu ubuntu 2176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/language-selector/language-selector.component.spec.ts 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288031 4 -rw-r--r-- 1 ubuntu ubuntu 1138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/language-selector/language-selector.component.ts 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288029 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/language-selector/language-selector.component.scss 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288028 4 -rw-r--r-- 1 ubuntu ubuntu 591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/language-selector/language-selector.component.html 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288073 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288074 4 -rw-r--r-- 1 ubuntu ubuntu 608 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select/select-messages.model.ts 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288079 4 -rw-r--r-- 1 ubuntu ubuntu 3869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select/select.component.ts 2024-03-27T21:32:58.450 INFO:teuthology.orchestra.run.smithi063.stdout: 288078 12 -rw-r--r-- 1 ubuntu ubuntu 8583 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select/select.component.spec.ts 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 288075 4 -rw-r--r-- 1 ubuntu ubuntu 317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select/select-option.model.ts 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 288077 4 -rw-r--r-- 1 ubuntu ubuntu 395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select/select.component.scss 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 288076 4 -rw-r--r-- 1 ubuntu ubuntu 2565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select/select.component.html 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 287954 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 287956 4 -rw-r--r-- 1 ubuntu ubuntu 106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.component.scss 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 287961 8 -rw-r--r-- 1 ubuntu ubuntu 4426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.types.ts 2024-03-27T21:32:58.451 INFO:teuthology.orchestra.run.smithi063.stdout: 287959 4 -rw-r--r-- 1 ubuntu ubuntu 213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.model.ts 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 287955 4 -rw-r--r-- 1 ubuntu ubuntu 3046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.component.html 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 287958 4 -rw-r--r-- 1 ubuntu ubuntu 3973 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.component.ts 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 287957 12 -rw-r--r-- 1 ubuntu ubuntu 9069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.component.spec.ts 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 287960 12 -rw-r--r-- 1 ubuntu ubuntu 9811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/config-option/config-option.types.spec.ts 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 288085 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/submit-button 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 288086 4 -rw-r--r-- 1 ubuntu ubuntu 336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/submit-button/submit-button.component.html 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 288087 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/submit-button/submit-button.component.scss 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 288089 4 -rw-r--r-- 1 ubuntu ubuntu 2569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/submit-button/submit-button.component.ts 2024-03-27T21:32:58.452 INFO:teuthology.orchestra.run.smithi063.stdout: 288088 4 -rw-r--r-- 1 ubuntu ubuntu 736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/submit-button/submit-button.component.spec.ts 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288068 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select-badges 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288071 4 -rw-r--r-- 1 ubuntu ubuntu 2136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select-badges/select-badges.component.spec.ts 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288070 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select-badges/select-badges.component.scss 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288069 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select-badges/select-badges.component.html 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288072 4 -rw-r--r-- 1 ubuntu ubuntu 960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/select-badges/select-badges.component.ts 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288053 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/orchestrator-doc-panel 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288055 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/orchestrator-doc-panel/orchestrator-doc-panel.component.scss 2024-03-27T21:32:58.453 INFO:teuthology.orchestra.run.smithi063.stdout: 288057 4 -rw-r--r-- 1 ubuntu ubuntu 401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/orchestrator-doc-panel/orchestrator-doc-panel.component.ts 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288054 4 -rw-r--r-- 1 ubuntu ubuntu 432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/orchestrator-doc-panel/orchestrator-doc-panel.component.html 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288056 4 -rw-r--r-- 1 ubuntu ubuntu 1130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/orchestrator-doc-panel/orchestrator-doc-panel.component.spec.ts 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288105 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/wizard 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288106 4 -rw-r--r-- 1 ubuntu ubuntu 642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/wizard/wizard.component.html 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288108 4 -rw-r--r-- 1 ubuntu ubuntu 706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/wizard/wizard.component.spec.ts 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288107 4 -rw-r--r-- 1 ubuntu ubuntu 514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/wizard/wizard.component.scss 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288109 4 -rw-r--r-- 1 ubuntu ubuntu 1114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/wizard/wizard.component.ts 2024-03-27T21:32:58.454 INFO:teuthology.orchestra.run.smithi063.stdout: 288022 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/helper 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288024 4 -rw-r--r-- 1 ubuntu ubuntu 113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/helper/helper.component.scss 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288023 4 -rw-r--r-- 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/helper/helper.component.html 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288025 4 -rw-r--r-- 1 ubuntu ubuntu 700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/helper/helper.component.spec.ts 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288026 4 -rw-r--r-- 1 ubuntu ubuntu 364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/helper/helper.component.ts 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288095 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/usage-bar 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288099 4 -rw-r--r-- 1 ubuntu ubuntu 1184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/usage-bar/usage-bar.component.ts 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288096 4 -rw-r--r-- 1 ubuntu ubuntu 1962 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/usage-bar/usage-bar.component.html 2024-03-27T21:32:58.455 INFO:teuthology.orchestra.run.smithi063.stdout: 288098 4 -rw-r--r-- 1 ubuntu ubuntu 791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/usage-bar/usage-bar.component.spec.ts 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 288097 4 -rw-r--r-- 1 ubuntu ubuntu 529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/usage-bar/usage-bar.component.scss 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 287962 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/confirmation-modal 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 287963 4 -rw-r--r-- 1 ubuntu ubuntu 1073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/confirmation-modal/confirmation-modal.component.html 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 287965 8 -rw-r--r-- 1 ubuntu ubuntu 5754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/confirmation-modal/confirmation-modal.component.spec.ts 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 287966 4 -rw-r--r-- 1 ubuntu ubuntu 1698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/confirmation-modal/confirmation-modal.component.ts 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 287964 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/components/confirmation-modal/confirmation-modal.component.scss 2024-03-27T21:32:58.456 INFO:teuthology.orchestra.run.smithi063.stdout: 288463 4 -rw-r--r-- 1 ubuntu ubuntu 1971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/shared.module.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288380 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288434 4 -rw-r--r-- 1 ubuntu ubuntu 2264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-silence-matcher.service.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288450 4 -rw-r--r-- 1 ubuntu ubuntu 346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/telemetry-notification.service.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288383 4 -rw-r--r-- 1 ubuntu ubuntu 1828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/auth-guard.service.spec.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288413 4 -rw-r--r-- 1 ubuntu ubuntu 620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/modal.service.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288462 4 -rw-r--r-- 1 ubuntu ubuntu 1590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/wizard-steps.service.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288424 4 -rw-r--r-- 1 ubuntu ubuntu 1786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/number-formatter.service.ts 2024-03-27T21:32:58.457 INFO:teuthology.orchestra.run.smithi063.stdout: 288396 4 -rw-r--r-- 1 ubuntu ubuntu 3004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/data-gateway.service.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288458 4 -rw-r--r-- 1 ubuntu ubuntu 891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/timer.service.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288418 4 -rw-r--r-- 1 ubuntu ubuntu 1124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/ngzone-scheduler.service.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288451 4 -rw-r--r-- 1 ubuntu ubuntu 435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/text-area-json-formatter.service.spec.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288402 4 -rw-r--r-- 1 ubuntu ubuntu 2233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/favicon.service.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288443 4 -rw-r--r-- 1 ubuntu ubuntu 2188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-manager.service.spec.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288432 4 -rw-r--r-- 1 ubuntu ubuntu 1601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-notification.service.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288415 4 -rw-r--r-- 1 ubuntu ubuntu 3456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/module-status-guard.service.ts 2024-03-27T21:32:58.458 INFO:teuthology.orchestra.run.smithi063.stdout: 288393 4 -rw-r--r-- 1 ubuntu ubuntu 509 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/crud-form-adapter.service.spec.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288456 4 -rw-r--r-- 1 ubuntu ubuntu 1732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/time-diff.service.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288401 4 -rw-r--r-- 1 ubuntu ubuntu 629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/favicon.service.spec.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288423 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/number-formatter.service.spec.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288408 8 -rw-r--r-- 1 ubuntu ubuntu 4218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/formatter.service.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288436 8 -rw-r--r-- 1 ubuntu ubuntu 5021 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/rbd-configuration.service.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288441 8 -rw-r--r-- 1 ubuntu ubuntu 4288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-list.service.spec.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288455 4 -rw-r--r-- 1 ubuntu ubuntu 2689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/time-diff.service.spec.ts 2024-03-27T21:32:58.459 INFO:teuthology.orchestra.run.smithi063.stdout: 288405 4 -rw-r--r-- 1 ubuntu ubuntu 1507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/feature-toggles.service.spec.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288430 4 -rw-r--r-- 1 ubuntu ubuntu 3586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-alert.service.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288425 8 -rw-r--r-- 1 ubuntu ubuntu 7678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/password-policy.service.spec.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288437 4 -rw-r--r-- 1 ubuntu ubuntu 1482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/refresh-interval.service.spec.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288420 4 -rw-r--r-- 1 ubuntu ubuntu 744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/no-sso-guard.service.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288412 4 -rw-r--r-- 1 ubuntu ubuntu 1673 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/modal.service.spec.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288447 4 -rw-r--r-- 1 ubuntu ubuntu 3677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-wrapper.service.spec.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288400 4 -rw-r--r-- 1 ubuntu ubuntu 2584 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/doc.service.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288438 4 -rw-r--r-- 1 ubuntu ubuntu 1320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/refresh-interval.service.ts 2024-03-27T21:32:58.460 INFO:teuthology.orchestra.run.smithi063.stdout: 288448 4 -rw-r--r-- 1 ubuntu ubuntu 2140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-wrapper.service.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288419 4 -rw-r--r-- 1 ubuntu ubuntu 1629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/no-sso-guard.service.spec.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288444 4 -rw-r--r-- 1 ubuntu ubuntu 1914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-manager.service.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288426 4 -rw-r--r-- 1 ubuntu ubuntu 2436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/password-policy.service.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288387 4 -rw-r--r-- 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/cd-table-server-side.service.spec.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288429 8 -rw-r--r-- 1 ubuntu ubuntu 7446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-alert.service.spec.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288404 4 -rw-r--r-- 1 ubuntu ubuntu 941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/feature-toggles-guard.service.ts 2024-03-27T21:32:58.461 INFO:teuthology.orchestra.run.smithi063.stdout: 288384 4 -rw-r--r-- 1 ubuntu ubuntu 837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/auth-guard.service.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288459 4 -rw-r--r-- 1 ubuntu ubuntu 1115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/url-builder.service.spec.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288406 4 -rw-r--r-- 1 ubuntu ubuntu 969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/feature-toggles.service.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288394 4 -rw-r--r-- 1 ubuntu ubuntu 1645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/crud-form-adapter.service.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288388 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/cd-table-server-side.service.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288452 4 -rw-r--r-- 1 ubuntu ubuntu 647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/text-area-json-formatter.service.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288461 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/wizard-steps.service.spec.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288445 12 -rw-r--r-- 1 ubuntu ubuntu 10908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-message.service.spec.ts 2024-03-27T21:32:58.462 INFO:teuthology.orchestra.run.smithi063.stdout: 288414 4 -rw-r--r-- 1 ubuntu ubuntu 3375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/module-status-guard.service.spec.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288435 4 -rw-r--r-- 1 ubuntu ubuntu 1435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/rbd-configuration.service.spec.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288389 4 -rw-r--r-- 1 ubuntu ubuntu 2666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/change-password-guard.service.spec.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288391 4 -rw-r--r-- 1 ubuntu ubuntu 360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/cookie.service.spec.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288446 20 -rw-r--r-- 1 ubuntu ubuntu 18161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-message.service.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288411 4 -rw-r--r-- 1 ubuntu ubuntu 568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/language.service.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288398 4 -rw-r--r-- 1 ubuntu ubuntu 1730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/device.service.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288407 8 -rw-r--r-- 1 ubuntu ubuntu 4757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/formatter.service.spec.ts 2024-03-27T21:32:58.463 INFO:teuthology.orchestra.run.smithi063.stdout: 288421 12 -rw-r--r-- 1 ubuntu ubuntu 9478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/notification.service.spec.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288386 4 -rw-r--r-- 1 ubuntu ubuntu 1645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/auth-storage.service.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288390 4 -rw-r--r-- 1 ubuntu ubuntu 1351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/change-password-guard.service.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288417 4 -rw-r--r-- 1 ubuntu ubuntu 2757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/motd-notification.service.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288440 4 -rw-r--r-- 1 ubuntu ubuntu 2702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/summary.service.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288433 8 -rw-r--r-- 1 ubuntu ubuntu 4134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-silence-matcher.service.spec.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288416 4 -rw-r--r-- 1 ubuntu ubuntu 3620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/motd-notification.service.spec.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288454 4 -rw-r--r-- 1 ubuntu ubuntu 266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/text-to-download.service.ts 2024-03-27T21:32:58.464 INFO:teuthology.orchestra.run.smithi063.stdout: 288460 4 -rw-r--r-- 1 ubuntu ubuntu 1491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/url-builder.service.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288381 8 -rw-r--r-- 1 ubuntu ubuntu 7151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/api-interceptor.service.spec.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288453 4 -rw-r--r-- 1 ubuntu ubuntu 489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/text-to-download.service.spec.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288439 8 -rw-r--r-- 1 ubuntu ubuntu 4982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/summary.service.spec.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288427 4 -rw-r--r-- 1 ubuntu ubuntu 3223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-alert-formatter.spec.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288422 8 -rw-r--r-- 1 ubuntu ubuntu 7101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/notification.service.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288449 4 -rw-r--r-- 1 ubuntu ubuntu 967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/telemetry-notification.service.spec.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288382 8 -rw-r--r-- 1 ubuntu ubuntu 5497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/api-interceptor.service.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288442 4 -rw-r--r-- 1 ubuntu ubuntu 3835 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/task-list.service.ts 2024-03-27T21:32:58.465 INFO:teuthology.orchestra.run.smithi063.stdout: 288399 4 -rw-r--r-- 1 ubuntu ubuntu 2091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/doc.service.spec.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288409 4 -rw-r--r-- 1 ubuntu ubuntu 1014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/js-error-handler.service.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288457 4 -rw-r--r-- 1 ubuntu ubuntu 2017 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/timer.service.spec.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288392 4 -rw-r--r-- 1 ubuntu ubuntu 497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/cookie.service.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288403 4 -rw-r--r-- 1 ubuntu ubuntu 2369 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/feature-toggles-guard.service.spec.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288397 4 -rw-r--r-- 1 ubuntu ubuntu 3065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/device.service.spec.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288395 4 -rw-r--r-- 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/data-gateway.service.spec.ts 2024-03-27T21:32:58.466 INFO:teuthology.orchestra.run.smithi063.stdout: 288410 4 -rw-r--r-- 1 ubuntu ubuntu 919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/language.service.spec.ts 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288385 4 -rw-r--r-- 1 ubuntu ubuntu 1189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/auth-storage.service.spec.ts 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288431 8 -rw-r--r-- 1 ubuntu ubuntu 8087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-notification.service.spec.ts 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288428 4 -rw-r--r-- 1 ubuntu ubuntu 2418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/services/prometheus-alert-formatter.ts 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288377 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/rxjs 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288378 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/rxjs/operators 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288379 4 -rw-r--r-- 1 ubuntu ubuntu 573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/rxjs/operators/page-visibility.operator.ts 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288194 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms 2024-03-27T21:32:58.467 INFO:teuthology.orchestra.run.smithi063.stdout: 288195 4 -rw-r--r-- 1 ubuntu ubuntu 845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-form-builder.spec.ts 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288198 4 -rw-r--r-- 1 ubuntu ubuntu 2042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-form-group.ts 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288201 28 -rw-r--r-- 1 ubuntu ubuntu 27740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-validators.spec.ts 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288202 24 -rw-r--r-- 1 ubuntu ubuntu 22900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-validators.ts 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288203 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-type 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288221 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-type/formly-input-type.component.html 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288222 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-type/formly-input-type.component.scss 2024-03-27T21:32:58.468 INFO:teuthology.orchestra.run.smithi063.stdout: 288224 4 -rw-r--r-- 1 ubuntu ubuntu 340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-type/formly-input-type.component.ts 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288223 4 -rw-r--r-- 1 ubuntu ubuntu 1251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-type/formly-input-type.component.spec.ts 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288214 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-file-type 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288218 4 -rw-r--r-- 1 ubuntu ubuntu 1025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-file-type/formly-file-type.component.spec.ts 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288216 4 -rw-r--r-- 1 ubuntu ubuntu 98 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-file-type/formly-file-type.component.html 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288219 4 -rw-r--r-- 1 ubuntu ubuntu 302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-file-type/formly-file-type.component.ts 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288217 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-file-type/formly-file-type.component.scss 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288215 4 -rw-r--r-- 1 ubuntu ubuntu 826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-file-type/formly-file-type-accessor.ts 2024-03-27T21:32:58.469 INFO:teuthology.orchestra.run.smithi063.stdout: 288209 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-array-type 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288213 4 -rw-r--r-- 1 ubuntu ubuntu 1031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-array-type/formly-array-type.component.ts 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288212 4 -rw-r--r-- 1 ubuntu ubuntu 1250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-array-type/formly-array-type.component.spec.ts 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288210 4 -rw-r--r-- 1 ubuntu ubuntu 1251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-array-type/formly-array-type.component.html 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288211 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-array-type/formly-array-type.component.scss 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-wrapper 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288229 4 -rw-r--r-- 1 ubuntu ubuntu 483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-wrapper/formly-input-wrapper.component.ts 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288226 4 -rw-r--r-- 1 ubuntu ubuntu 1209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-wrapper/formly-input-wrapper.component.html 2024-03-27T21:32:58.470 INFO:teuthology.orchestra.run.smithi063.stdout: 288228 4 -rw-r--r-- 1 ubuntu ubuntu 1266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-wrapper/formly-input-wrapper.component.spec.ts 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288227 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-input-wrapper/formly-input-wrapper.component.scss 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288241 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/validators 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288244 4 -rw-r--r-- 1 ubuntu ubuntu 882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/validators/rgw-role-validator.ts 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288243 4 -rw-r--r-- 1 ubuntu ubuntu 306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/validators/json-validator.ts 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288242 4 -rw-r--r-- 1 ubuntu ubuntu 426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/validators/file-validator.ts 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288206 4 -rw-r--r-- 1 ubuntu ubuntu 1244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/crud-form.component.spec.ts 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288235 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-textarea-type 2024-03-27T21:32:58.471 INFO:teuthology.orchestra.run.smithi063.stdout: 288239 4 -rw-r--r-- 1 ubuntu ubuntu 723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-textarea-type/formly-textarea-type.component.ts 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288238 4 -rw-r--r-- 1 ubuntu ubuntu 1282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-textarea-type/formly-textarea-type.component.spec.ts 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288236 4 -rw-r--r-- 1 ubuntu ubuntu 272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-textarea-type/formly-textarea-type.component.html 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288237 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-textarea-type/formly-textarea-type.component.scss 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288240 4 -rw-r--r-- 1 ubuntu ubuntu 1486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/helpers.ts 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288204 4 -rw-r--r-- 1 ubuntu ubuntu 1007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/crud-form.component.html 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288230 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-object-type 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288232 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-object-type/formly-object-type.component.scss 2024-03-27T21:32:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: 288231 4 -rw-r--r-- 1 ubuntu ubuntu 567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-object-type/formly-object-type.component.html 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288233 4 -rw-r--r-- 1 ubuntu ubuntu 1270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-object-type/formly-object-type.component.spec.ts 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288234 4 -rw-r--r-- 1 ubuntu ubuntu 852 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/formly-object-type/formly-object-type.component.ts 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288205 4 -rw-r--r-- 1 ubuntu ubuntu 384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/crud-form.component.scss 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288208 4 -rw-r--r-- 1 ubuntu ubuntu 309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/crud-form.model.ts 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288207 4 -rw-r--r-- 1 ubuntu ubuntu 3494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/crud-form/crud-form.component.ts 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288197 8 -rw-r--r-- 1 ubuntu ubuntu 6011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-form-group.spec.ts 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288196 4 -rw-r--r-- 1 ubuntu ubuntu 604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-form-builder.ts 2024-03-27T21:32:58.473 INFO:teuthology.orchestra.run.smithi063.stdout: 288200 4 -rw-r--r-- 1 ubuntu ubuntu 382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-form.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 288199 4 -rw-r--r-- 1 ubuntu ubuntu 863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/forms/cd-form.spec.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287809 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287842 4 -rw-r--r-- 1 ubuntu ubuntu 1119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/health.service.spec.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287813 4 -rw-r--r-- 1 ubuntu ubuntu 1547 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/auth.service.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287882 4 -rw-r--r-- 1 ubuntu ubuntu 1130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-multisite.service.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287825 4 -rw-r--r-- 1 ubuntu ubuntu 630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cluster.service.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287824 4 -rw-r--r-- 1 ubuntu ubuntu 1240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cluster.service.spec.ts 2024-03-27T21:32:58.474 INFO:teuthology.orchestra.run.smithi063.stdout: 287860 4 -rw-r--r-- 1 ubuntu ubuntu 2392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/nfs.service.spec.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287883 4 -rw-r--r-- 1 ubuntu ubuntu 570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-realm.service.spec.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287854 4 -rw-r--r-- 1 ubuntu ubuntu 914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/monitor.service.spec.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287898 4 -rw-r--r-- 1 ubuntu ubuntu 2010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/settings.service.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287904 4 -rw-r--r-- 1 ubuntu ubuntu 1708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/user.service.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287832 4 -rw-r--r-- 1 ubuntu ubuntu 1055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/daemon.service.spec.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287829 4 -rw-r--r-- 1 ubuntu ubuntu 921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/crush-rule.service.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287827 4 -rw-r--r-- 1 ubuntu ubuntu 1623 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/configuration.service.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287877 8 -rw-r--r-- 1 ubuntu ubuntu 5712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rbd.service.ts 2024-03-27T21:32:58.475 INFO:teuthology.orchestra.run.smithi063.stdout: 287831 4 -rw-r--r-- 1 ubuntu ubuntu 339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/custom-login-banner.service.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287814 4 -rw-r--r-- 1 ubuntu ubuntu 2170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/ceph-service.service.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287879 8 -rw-r--r-- 1 ubuntu ubuntu 6118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-bucket.service.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287828 4 -rw-r--r-- 1 ubuntu ubuntu 1380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/crush-rule.service.spec.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287851 4 -rw-r--r-- 1 ubuntu ubuntu 369 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/logs.service.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287817 8 -rw-r--r-- 1 ubuntu ubuntu 5626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs-snapshot-schedule.service.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287871 8 -rw-r--r-- 1 ubuntu ubuntu 6817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/prometheus.service.spec.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287892 4 -rw-r--r-- 1 ubuntu ubuntu 3038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-zonegroup.service.ts 2024-03-27T21:32:58.476 INFO:teuthology.orchestra.run.smithi063.stdout: 287849 4 -rw-r--r-- 1 ubuntu ubuntu 419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/logging.service.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287846 4 -rw-r--r-- 1 ubuntu ubuntu 2993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/iscsi.service.spec.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287857 4 -rw-r--r-- 1 ubuntu ubuntu 550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/motd.service.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287884 4 -rw-r--r-- 1 ubuntu ubuntu 2388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-realm.service.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287873 8 -rw-r--r-- 1 ubuntu ubuntu 4861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rbd-mirroring.service.spec.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287821 8 -rw-r--r-- 1 ubuntu ubuntu 4938 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs-subvolume.service.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287818 4 -rw-r--r-- 1 ubuntu ubuntu 677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs-subvolume-group.service.spec.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287897 8 -rw-r--r-- 1 ubuntu ubuntu 4884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/settings.service.spec.ts 2024-03-27T21:32:58.477 INFO:teuthology.orchestra.run.smithi063.stdout: 287820 4 -rw-r--r-- 1 ubuntu ubuntu 1832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs-subvolume.service.spec.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287902 4 -rw-r--r-- 1 ubuntu ubuntu 2170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/upgrade.service.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287835 4 -rw-r--r-- 1 ubuntu ubuntu 1859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/directory-store.service.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287822 4 -rw-r--r-- 1 ubuntu ubuntu 4075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs.service.spec.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287872 12 -rw-r--r-- 1 ubuntu ubuntu 8855 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/prometheus.service.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287850 4 -rw-r--r-- 1 ubuntu ubuntu 891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/logs.service.spec.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287880 4 -rw-r--r-- 1 ubuntu ubuntu 3365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-daemon.service.spec.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287900 4 -rw-r--r-- 1 ubuntu ubuntu 506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/telemetry.service.ts 2024-03-27T21:32:58.478 INFO:teuthology.orchestra.run.smithi063.stdout: 287895 4 -rw-r--r-- 1 ubuntu ubuntu 891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/scope.service.spec.ts 2024-03-27T21:32:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: 287839 4 -rw-r--r-- 1 ubuntu ubuntu 775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/feedback.service.ts 2024-03-27T21:32:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: 287901 4 -rw-r--r-- 1 ubuntu ubuntu 2105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/upgrade.service.spec.ts 2024-03-27T21:32:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: 287823 4 -rw-r--r-- 1 ubuntu ubuntu 3236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs.service.ts 2024-03-27T21:32:58.479 INFO:teuthology.orchestra.run.smithi063.stdout: 287841 4 -rw-r--r-- 1 ubuntu ubuntu 460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/hardware.service.ts 2024-03-27T21:32:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: 287852 4 -rw-r--r-- 1 ubuntu ubuntu 1997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/mgr-module.service.spec.ts 2024-03-27T21:32:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: 287819 4 -rw-r--r-- 1 ubuntu ubuntu 1934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs-subvolume-group.service.ts 2024-03-27T21:32:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: 287844 4 -rw-r--r-- 1 ubuntu ubuntu 3148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/host.service.spec.ts 2024-03-27T21:32:58.481 INFO:teuthology.orchestra.run.smithi063.stdout: 287816 4 -rw-r--r-- 1 ubuntu ubuntu 649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/cephfs-snapshot-schedule.service.spec.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287867 4 -rw-r--r-- 1 ubuntu ubuntu 1312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/performance-counter.service.spec.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287868 4 -rw-r--r-- 1 ubuntu ubuntu 686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/performance-counter.service.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287887 8 -rw-r--r-- 1 ubuntu ubuntu 5579 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-user.service.spec.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287815 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/ceph-user.service.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287810 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/api-client.spec.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287876 8 -rw-r--r-- 1 ubuntu ubuntu 6761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rbd.service.spec.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287866 4 -rw-r--r-- 1 ubuntu ubuntu 390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/paginate.model.ts 2024-03-27T21:32:58.482 INFO:teuthology.orchestra.run.smithi063.stdout: 287893 4 -rw-r--r-- 1 ubuntu ubuntu 2204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/role.service.spec.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287859 8 -rw-r--r-- 1 ubuntu ubuntu 6229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/multi-cluster.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287886 4 -rw-r--r-- 1 ubuntu ubuntu 1123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-site.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287870 4 -rw-r--r-- 1 ubuntu ubuntu 1976 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/pool.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287890 8 -rw-r--r-- 1 ubuntu ubuntu 4990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-zone.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287848 4 -rw-r--r-- 1 ubuntu ubuntu 1046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/logging.service.spec.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287888 8 -rw-r--r-- 1 ubuntu ubuntu 5621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-user.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287896 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/scope.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287855 4 -rw-r--r-- 1 ubuntu ubuntu 272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/monitor.service.ts 2024-03-27T21:32:58.483 INFO:teuthology.orchestra.run.smithi063.stdout: 287899 4 -rw-r--r-- 1 ubuntu ubuntu 1863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/telemetry.service.spec.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287837 8 -rw-r--r-- 1 ubuntu ubuntu 5663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/erasure-code-profile.service.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287891 4 -rw-r--r-- 1 ubuntu ubuntu 590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-zonegroup.service.spec.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287833 4 -rw-r--r-- 1 ubuntu ubuntu 868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/daemon.service.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287889 4 -rw-r--r-- 1 ubuntu ubuntu 565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-zone.service.spec.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287836 4 -rw-r--r-- 1 ubuntu ubuntu 1721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/erasure-code-profile.service.spec.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287885 4 -rw-r--r-- 1 ubuntu ubuntu 1260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-site.service.spec.ts 2024-03-27T21:32:58.484 INFO:teuthology.orchestra.run.smithi063.stdout: 287862 4 -rw-r--r-- 1 ubuntu ubuntu 987 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/orchestrator.service.spec.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287843 4 -rw-r--r-- 1 ubuntu ubuntu 621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/health.service.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287864 8 -rw-r--r-- 1 ubuntu ubuntu 5832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/osd.service.spec.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287847 4 -rw-r--r-- 1 ubuntu ubuntu 1350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/iscsi.service.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287811 4 -rw-r--r-- 1 ubuntu ubuntu 159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/api-client.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287861 4 -rw-r--r-- 1 ubuntu ubuntu 2750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/nfs.service.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287878 8 -rw-r--r-- 1 ubuntu ubuntu 4107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-bucket.service.spec.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287863 4 -rw-r--r-- 1 ubuntu ubuntu 1406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/orchestrator.service.ts 2024-03-27T21:32:58.485 INFO:teuthology.orchestra.run.smithi063.stdout: 287834 4 -rw-r--r-- 1 ubuntu ubuntu 682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/directory-store.service.spec.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287826 4 -rw-r--r-- 1 ubuntu ubuntu 3396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/configuration.service.spec.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287856 4 -rw-r--r-- 1 ubuntu ubuntu 897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/motd.service.spec.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287894 4 -rw-r--r-- 1 ubuntu ubuntu 1192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/role.service.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287853 4 -rw-r--r-- 1 ubuntu ubuntu 1740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/mgr-module.service.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287858 4 -rw-r--r-- 1 ubuntu ubuntu 506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/multi-cluster.service.spec.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287830 4 -rw-r--r-- 1 ubuntu ubuntu 1028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/custom-login-banner.service.spec.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287881 4 -rw-r--r-- 1 ubuntu ubuntu 2814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rgw-daemon.service.ts 2024-03-27T21:32:58.486 INFO:teuthology.orchestra.run.smithi063.stdout: 287903 4 -rw-r--r-- 1 ubuntu ubuntu 3479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/user.service.spec.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287838 4 -rw-r--r-- 1 ubuntu ubuntu 1352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/feedback.service.spec.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287840 4 -rw-r--r-- 1 ubuntu ubuntu 603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/hardware.service.spec.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287874 4 -rw-r--r-- 1 ubuntu ubuntu 3463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rbd-mirroring.service.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287875 4 -rw-r--r-- 1 ubuntu ubuntu 618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/rbd.model.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287812 4 -rw-r--r-- 1 ubuntu ubuntu 1948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/auth.service.spec.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287865 8 -rw-r--r-- 1 ubuntu ubuntu 5236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/osd.service.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287869 4 -rw-r--r-- 1 ubuntu ubuntu 3838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/pool.service.spec.ts 2024-03-27T21:32:58.487 INFO:teuthology.orchestra.run.smithi063.stdout: 287845 8 -rw-r--r-- 1 ubuntu ubuntu 5182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/api/host.service.ts 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 288144 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/decorators 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 288145 4 -rw-r--r-- 1 ubuntu ubuntu 848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/decorators/cd-encode.spec.ts 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 288146 4 -rw-r--r-- 1 ubuntu ubuntu 2320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/shared/decorators/cd-encode.ts 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 286850 20 -rw-r--r-- 1 ubuntu ubuntu 16689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/app-routing.module.ts 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 286851 4 -rw-r--r-- 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/app.component.html 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 286852 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/app.component.scss 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 286856 4 drwxr-xr-x 12 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 287371 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3 2024-03-27T21:32:58.488 INFO:teuthology.orchestra.run.smithi063.stdout: 287394 4 -rw-r--r-- 1 ubuntu ubuntu 806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/pg-summary.pipe.ts 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287388 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287392 8 -rw-r--r-- 1 ubuntu ubuntu 6536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard/dashboard-v3.component.ts 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287390 4 -rw-r--r-- 1 ubuntu ubuntu 523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard/dashboard-v3.component.scss 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287389 16 -rw-r--r-- 1 ubuntu ubuntu 13734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard/dashboard-v3.component.html 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287391 12 -rw-r--r-- 1 ubuntu ubuntu 11668 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard/dashboard-v3.component.spec.ts 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287382 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-time-selector 2024-03-27T21:32:58.489 INFO:teuthology.orchestra.run.smithi063.stdout: 287383 4 -rw-r--r-- 1 ubuntu ubuntu 300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-time-selector/dashboard-time-selector.component.html 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287384 4 -rw-r--r-- 1 ubuntu ubuntu 84 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-time-selector/dashboard-time-selector.component.scss 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287385 4 -rw-r--r-- 1 ubuntu ubuntu 764 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-time-selector/dashboard-time-selector.component.spec.ts 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287386 4 -rw-r--r-- 1 ubuntu ubuntu 1698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-time-selector/dashboard-time-selector.component.ts 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287377 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-pie 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287379 4 -rw-r--r-- 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-pie/dashboard-pie.component.scss 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287381 8 -rw-r--r-- 1 ubuntu ubuntu 6782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-pie/dashboard-pie.component.ts 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287378 4 -rw-r--r-- 1 ubuntu ubuntu 464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-pie/dashboard-pie.component.html 2024-03-27T21:32:58.490 INFO:teuthology.orchestra.run.smithi063.stdout: 287380 4 -rw-r--r-- 1 ubuntu ubuntu 884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-pie/dashboard-pie.component.spec.ts 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287387 4 -rw-r--r-- 1 ubuntu ubuntu 1547 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-v3.module.ts 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287393 4 -rw-r--r-- 1 ubuntu ubuntu 786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/pg-summary.pipe.spec.ts 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287372 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-area-chart 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287374 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-area-chart/dashboard-area-chart.component.scss 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287376 12 -rw-r--r-- 1 ubuntu ubuntu 9908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-area-chart/dashboard-area-chart.component.ts 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287375 4 -rw-r--r-- 1 ubuntu ubuntu 3273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-area-chart/dashboard-area-chart.component.spec.ts 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287373 4 -rw-r--r-- 1 ubuntu ubuntu 1329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard-v3/dashboard-area-chart/dashboard-area-chart.component.html 2024-03-27T21:32:58.491 INFO:teuthology.orchestra.run.smithi063.stdout: 287038 4 drwxr-xr-x 18 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287084 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-list 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287088 12 -rw-r--r-- 1 ubuntu ubuntu 11014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-list/cephfs-snapshotschedule-list.component.ts 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287086 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-list/cephfs-snapshotschedule-list.component.scss 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287087 4 -rw-r--r-- 1 ubuntu ubuntu 1175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-list/cephfs-snapshotschedule-list.component.spec.ts 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287085 4 -rw-r--r-- 1 ubuntu ubuntu 2382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-list/cephfs-snapshotschedule-list.component.html 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-mount-details 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287077 4 -rw-r--r-- 1 ubuntu ubuntu 1127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-mount-details/cephfs-mount-details.component.spec.ts 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287075 4 -rw-r--r-- 1 ubuntu ubuntu 919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-mount-details/cephfs-mount-details.component.html 2024-03-27T21:32:58.492 INFO:teuthology.orchestra.run.smithi063.stdout: 287078 4 -rw-r--r-- 1 ubuntu ubuntu 1297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-mount-details/cephfs-mount-details.component.ts 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287076 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-mount-details/cephfs-mount-details.component.scss 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-form 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287066 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-form/cephfs-form.component.scss 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287067 8 -rw-r--r-- 1 ubuntu ubuntu 4438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-form/cephfs-form.component.spec.ts 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287065 8 -rw-r--r-- 1 ubuntu ubuntu 4814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-form/cephfs-form.component.html 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287068 8 -rw-r--r-- 1 ubuntu ubuntu 7259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-form/cephfs-form.component.ts 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287094 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-group 2024-03-27T21:32:58.493 INFO:teuthology.orchestra.run.smithi063.stdout: 287095 4 -rw-r--r-- 1 ubuntu ubuntu 1812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-group/cephfs-subvolume-group.component.html 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287096 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-group/cephfs-subvolume-group.component.scss 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287098 8 -rw-r--r-- 1 ubuntu ubuntu 5618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-group/cephfs-subvolume-group.component.ts 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287097 4 -rw-r--r-- 1 ubuntu ubuntu 1039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-group/cephfs-subvolume-group.component.spec.ts 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287044 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-chart 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287046 4 -rw-r--r-- 1 ubuntu ubuntu 134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-chart/cephfs-chart.component.scss 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287048 8 -rw-r--r-- 1 ubuntu ubuntu 4469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-chart/cephfs-chart.component.ts 2024-03-27T21:32:58.494 INFO:teuthology.orchestra.run.smithi063.stdout: 287047 4 -rw-r--r-- 1 ubuntu ubuntu 2009 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-chart/cephfs-chart.component.spec.ts 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287045 4 -rw-r--r-- 1 ubuntu ubuntu 284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-chart/cephfs-chart.component.html 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287054 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-detail 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287055 4 -rw-r--r-- 1 ubuntu ubuntu 1172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-detail/cephfs-detail.component.html 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287058 4 -rw-r--r-- 1 ubuntu ubuntu 2569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-detail/cephfs-detail.component.ts 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287056 4 -rw-r--r-- 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-detail/cephfs-detail.component.scss 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287057 4 -rw-r--r-- 1 ubuntu ubuntu 1450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-detail/cephfs-detail.component.spec.ts 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287089 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-form 2024-03-27T21:32:58.495 INFO:teuthology.orchestra.run.smithi063.stdout: 287093 8 -rw-r--r-- 1 ubuntu ubuntu 7556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-form/cephfs-subvolume-form.component.ts 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287090 8 -rw-r--r-- 1 ubuntu ubuntu 7206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-form/cephfs-subvolume-form.component.html 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287091 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-form/cephfs-subvolume-form.component.scss 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287092 4 -rw-r--r-- 1 ubuntu ubuntu 2717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-form/cephfs-subvolume-form.component.spec.ts 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287114 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolumegroup-form 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287117 4 -rw-r--r-- 1 ubuntu ubuntu 1298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolumegroup-form/cephfs-subvolumegroup-form.component.spec.ts 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287118 8 -rw-r--r-- 1 ubuntu ubuntu 6377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolumegroup-form/cephfs-subvolumegroup-form.component.ts 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287116 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolumegroup-form/cephfs-subvolumegroup-form.component.scss 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287115 8 -rw-r--r-- 1 ubuntu ubuntu 5693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolumegroup-form/cephfs-subvolumegroup-form.component.html 2024-03-27T21:32:58.496 INFO:teuthology.orchestra.run.smithi063.stdout: 287049 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-clients 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287052 4 -rw-r--r-- 1 ubuntu ubuntu 2859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-clients/cephfs-clients.component.spec.ts 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287050 4 -rw-r--r-- 1 ubuntu ubuntu 479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-clients/cephfs-clients.component.html 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287053 4 -rw-r--r-- 1 ubuntu ubuntu 3374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-clients/cephfs-clients.component.ts 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287051 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-clients/cephfs-clients.component.scss 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287079 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-form 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287083 16 -rw-r--r-- 1 ubuntu ubuntu 15511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-form/cephfs-snapshotschedule-form.component.ts 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287082 4 -rw-r--r-- 1 ubuntu ubuntu 2440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-form/cephfs-snapshotschedule-form.component.spec.ts 2024-03-27T21:32:58.497 INFO:teuthology.orchestra.run.smithi063.stdout: 287081 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-form/cephfs-snapshotschedule-form.component.scss 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287080 8 -rw-r--r-- 1 ubuntu ubuntu 7828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-snapshotschedule-form/cephfs-snapshotschedule-form.component.html 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287119 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-tabs 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287122 8 -rw-r--r-- 1 ubuntu ubuntu 6457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-tabs/cephfs-tabs.component.spec.ts 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287121 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-tabs/cephfs-tabs.component.scss 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287120 4 -rw-r--r-- 1 ubuntu ubuntu 2879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-tabs/cephfs-tabs.component.html 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287123 4 -rw-r--r-- 1 ubuntu ubuntu 3252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-tabs/cephfs-tabs.component.ts 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287059 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-directories 2024-03-27T21:32:58.498 INFO:teuthology.orchestra.run.smithi063.stdout: 287061 4 -rw-r--r-- 1 ubuntu ubuntu 298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-directories/cephfs-directories.component.scss 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287062 40 -rw-r--r-- 1 ubuntu ubuntu 38629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-directories/cephfs-directories.component.spec.ts 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287063 24 -rw-r--r-- 1 ubuntu ubuntu 23828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-directories/cephfs-directories.component.ts 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287060 4 -rw-r--r-- 1 ubuntu ubuntu 2662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-directories/cephfs-directories.component.html 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287104 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287111 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-list.component.scss 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287110 4 -rw-r--r-- 1 ubuntu ubuntu 1802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-list.component.html 2024-03-27T21:32:58.499 INFO:teuthology.orchestra.run.smithi063.stdout: 287113 12 -rw-r--r-- 1 ubuntu ubuntu 10184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-list.component.ts 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287105 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-form 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287107 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-form/cephfs-subvolume-snapshots-form.component.scss 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287109 8 -rw-r--r-- 1 ubuntu ubuntu 4224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-form/cephfs-subvolume-snapshots-form.component.ts 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287108 4 -rw-r--r-- 1 ubuntu ubuntu 1472 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-form/cephfs-subvolume-snapshots-form.component.spec.ts 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287106 4 -rw-r--r-- 1 ubuntu ubuntu 3791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-form/cephfs-subvolume-snapshots-form.component.html 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287112 4 -rw-r--r-- 1 ubuntu ubuntu 1477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-snapshots-list/cephfs-subvolume-snapshots-list.component.spec.ts 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287099 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-list 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287103 12 -rw-r--r-- 1 ubuntu ubuntu 8775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-list/cephfs-subvolume-list.component.ts 2024-03-27T21:32:58.500 INFO:teuthology.orchestra.run.smithi063.stdout: 287102 4 -rw-r--r-- 1 ubuntu ubuntu 1126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-list/cephfs-subvolume-list.component.spec.ts 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287101 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-list/cephfs-subvolume-list.component.scss 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287100 4 -rw-r--r-- 1 ubuntu ubuntu 3983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-subvolume-list/cephfs-subvolume-list.component.html 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287069 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-list 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287070 4 -rw-r--r-- 1 ubuntu ubuntu 787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-list/cephfs-list.component.html 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287072 4 -rw-r--r-- 1 ubuntu ubuntu 3415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-list/cephfs-list.component.spec.ts 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287073 8 -rw-r--r-- 1 ubuntu ubuntu 7022 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-list/cephfs-list.component.ts 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287071 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-list/cephfs-list.component.scss 2024-03-27T21:32:58.501 INFO:teuthology.orchestra.run.smithi063.stdout: 287039 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-auth-modal 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287042 4 -rw-r--r-- 1 ubuntu ubuntu 1082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-auth-modal/cephfs-auth-modal.component.spec.ts 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287041 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-auth-modal/cephfs-auth-modal.component.scss 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287040 8 -rw-r--r-- 1 ubuntu ubuntu 6169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-auth-modal/cephfs-auth-modal.component.html 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287043 8 -rw-r--r-- 1 ubuntu ubuntu 4128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs-auth-modal/cephfs-auth-modal.component.ts 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287124 4 -rw-r--r-- 1 ubuntu ubuntu 3332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cephfs/cephfs.module.ts 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287395 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287428 4 -rw-r--r-- 1 ubuntu ubuntu 348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/mon-summary.pipe.ts 2024-03-27T21:32:58.502 INFO:teuthology.orchestra.run.smithi063.stdout: 287397 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/dashboard 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287401 4 -rw-r--r-- 1 ubuntu ubuntu 496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/dashboard/dashboard.component.ts 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287398 4 -rw-r--r-- 1 ubuntu ubuntu 417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/dashboard/dashboard.component.html 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287400 4 -rw-r--r-- 1 ubuntu ubuntu 1020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/dashboard/dashboard.component.spec.ts 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287399 4 -rw-r--r-- 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/dashboard/dashboard.component.scss 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287402 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health-pie 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287405 4 -rw-r--r-- 1 ubuntu ubuntu 2695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health-pie/health-pie.component.spec.ts 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287403 4 -rw-r--r-- 1 ubuntu ubuntu 395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health-pie/health-pie.component.html 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287404 4 -rw-r--r-- 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health-pie/health-pie.component.scss 2024-03-27T21:32:58.503 INFO:teuthology.orchestra.run.smithi063.stdout: 287406 8 -rw-r--r-- 1 ubuntu ubuntu 5416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health-pie/health-pie.component.ts 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287424 4 -rw-r--r-- 1 ubuntu ubuntu 2297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/mds-summary.pipe.ts 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287429 8 -rw-r--r-- 1 ubuntu ubuntu 4206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/osd-summary.pipe.spec.ts 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287426 4 -rw-r--r-- 1 ubuntu ubuntu 1280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/mgr-summary.pipe.ts 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287423 4 -rw-r--r-- 1 ubuntu ubuntu 2297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/mds-summary.pipe.spec.ts 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287396 4 -rw-r--r-- 1 ubuntu ubuntu 1664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/dashboard.module.ts 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287418 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-group 2024-03-27T21:32:58.504 INFO:teuthology.orchestra.run.smithi063.stdout: 287419 4 -rw-r--r-- 1 ubuntu ubuntu 491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-group/info-group.component.html 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287422 4 -rw-r--r-- 1 ubuntu ubuntu 328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-group/info-group.component.ts 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287420 4 -rw-r--r-- 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-group/info-group.component.scss 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287421 4 -rw-r--r-- 1 ubuntu ubuntu 1180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-group/info-group.component.spec.ts 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287430 4 -rw-r--r-- 1 ubuntu ubuntu 2067 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/osd-summary.pipe.ts 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287412 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-card 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287416 4 -rw-r--r-- 1 ubuntu ubuntu 2036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-card/info-card.component.spec.ts 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287414 4 -rw-r--r-- 1 ubuntu ubuntu 475 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-card/info-card.component.html 2024-03-27T21:32:58.505 INFO:teuthology.orchestra.run.smithi063.stdout: 287415 4 -rw-r--r-- 1 ubuntu ubuntu 751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-card/info-card.component.scss 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287417 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-card/info-card.component.ts 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287413 4 -rw-r--r-- 1 ubuntu ubuntu 988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/info-card/info-card-popover.scss 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287425 4 -rw-r--r-- 1 ubuntu ubuntu 1482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/mgr-summary.pipe.spec.ts 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287407 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287410 12 -rw-r--r-- 1 ubuntu ubuntu 11713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health/health.component.spec.ts 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287409 4 -rw-r--r-- 1 ubuntu ubuntu 656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health/health.component.scss 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287411 12 -rw-r--r-- 1 ubuntu ubuntu 9308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health/health.component.ts 2024-03-27T21:32:58.506 INFO:teuthology.orchestra.run.smithi063.stdout: 287408 12 -rw-r--r-- 1 ubuntu ubuntu 9536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/health/health.component.html 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 287427 4 -rw-r--r-- 1 ubuntu ubuntu 938 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/dashboard/mon-summary.pipe.spec.ts 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 286857 4 drwxr-xr-x 27 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 286884 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-image-settings-modal 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 286887 4 -rw-r--r-- 1 ubuntu ubuntu 2806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-image-settings-modal/iscsi-target-image-settings-modal.component.spec.ts 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 286888 4 -rw-r--r-- 1 ubuntu ubuntu 3194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-image-settings-modal/iscsi-target-image-settings-modal.component.ts 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 286886 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-image-settings-modal/iscsi-target-image-settings-modal.component.scss 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 286885 4 -rw-r--r-- 1 ubuntu ubuntu 3275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-image-settings-modal/iscsi-target-image-settings-modal.component.html 2024-03-27T21:32:58.507 INFO:teuthology.orchestra.run.smithi063.stdout: 287017 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-list 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 287018 4 -rw-r--r-- 1 ubuntu ubuntu 1558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-list/rbd-trash-list.component.html 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 287020 8 -rw-r--r-- 1 ubuntu ubuntu 5541 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-list/rbd-trash-list.component.spec.ts 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 287021 8 -rw-r--r-- 1 ubuntu ubuntu 7443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-list/rbd-trash-list.component.ts 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 287019 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-list/rbd-trash-list.component.scss 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 286960 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-details 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 286963 4 -rw-r--r-- 1 ubuntu ubuntu 1172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-details/rbd-details.component.spec.ts 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 286962 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-details/rbd-details.component.scss 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 286964 4 -rw-r--r-- 1 ubuntu ubuntu 829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-details/rbd-details.component.ts 2024-03-27T21:32:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: 286961 8 -rw-r--r-- 1 ubuntu ubuntu 6689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-details/rbd-details.component.html 2024-03-27T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: 286859 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-setting 2024-03-27T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: 286863 4 -rw-r--r-- 1 ubuntu ubuntu 860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-setting/iscsi-setting.component.ts 2024-03-27T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: 286860 4 -rw-r--r-- 1 ubuntu ubuntu 2016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-setting/iscsi-setting.component.html 2024-03-27T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: 286861 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-setting/iscsi-setting.component.scss 2024-03-27T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: 286862 4 -rw-r--r-- 1 ubuntu ubuntu 1160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-setting/iscsi-setting.component.spec.ts 2024-03-27T21:32:58.509 INFO:teuthology.orchestra.run.smithi063.stdout: 286899 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286901 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi/iscsi.component.scss 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286900 4 -rw-r--r-- 1 ubuntu ubuntu 1247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi/iscsi.component.html 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286902 4 -rw-r--r-- 1 ubuntu ubuntu 2519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi/iscsi.component.spec.ts 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286903 4 -rw-r--r-- 1 ubuntu ubuntu 3157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi/iscsi.component.ts 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286874 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-discovery-modal 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286876 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-discovery-modal/iscsi-target-discovery-modal.component.scss 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286878 8 -rw-r--r-- 1 ubuntu ubuntu 4196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-discovery-modal/iscsi-target-discovery-modal.component.ts 2024-03-27T21:32:58.510 INFO:teuthology.orchestra.run.smithi063.stdout: 286875 8 -rw-r--r-- 1 ubuntu ubuntu 5101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-discovery-modal/iscsi-target-discovery-modal.component.html 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286877 8 -rw-r--r-- 1 ubuntu ubuntu 4545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-discovery-modal/iscsi-target-discovery-modal.component.spec.ts 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286965 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286969 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form-create-request.model.ts 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286970 4 -rw-r--r-- 1 ubuntu ubuntu 374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form-edit-request.model.ts 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286967 4 -rw-r--r-- 1 ubuntu ubuntu 363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form-clone-request.model.ts 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286973 20 -rw-r--r-- 1 ubuntu ubuntu 18092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form.component.html 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286968 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form-copy-request.model.ts 2024-03-27T21:32:58.511 INFO:teuthology.orchestra.run.smithi063.stdout: 286975 20 -rw-r--r-- 1 ubuntu ubuntu 17938 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form.component.spec.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286972 4 -rw-r--r-- 1 ubuntu ubuntu 215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form-response.model.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286966 4 -rw-r--r-- 1 ubuntu ubuntu 216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-feature.interface.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286976 32 -rw-r--r-- 1 ubuntu ubuntu 29143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form.component.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286974 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form.component.scss 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286971 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form-mode.enum.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286978 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-parent.model.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286977 4 -rw-r--r-- 1 ubuntu ubuntu 500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-form/rbd-form.model.ts 2024-03-27T21:32:58.512 INFO:teuthology.orchestra.run.smithi063.stdout: 286869 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-details 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286870 4 -rw-r--r-- 1 ubuntu ubuntu 1248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-details/iscsi-target-details.component.html 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286872 8 -rw-r--r-- 1 ubuntu ubuntu 6432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-details/iscsi-target-details.component.spec.ts 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286873 12 -rw-r--r-- 1 ubuntu ubuntu 9658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-details/iscsi-target-details.component.ts 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286871 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-details/iscsi-target-details.component.scss 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286864 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-tabs 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286865 4 -rw-r--r-- 1 ubuntu ubuntu 414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-tabs/iscsi-tabs.component.html 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286866 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-tabs/iscsi-tabs.component.scss 2024-03-27T21:32:58.513 INFO:teuthology.orchestra.run.smithi063.stdout: 286867 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-tabs/iscsi-tabs.component.spec.ts 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 286868 4 -rw-r--r-- 1 ubuntu ubuntu 215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-tabs/iscsi-tabs.component.ts 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 286995 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-performance 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 286997 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-performance/rbd-performance.component.scss 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 286999 4 -rw-r--r-- 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-performance/rbd-performance.component.ts 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 286998 4 -rw-r--r-- 1 ubuntu ubuntu 1088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-performance/rbd-performance.component.spec.ts 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 286996 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-performance/rbd-performance.component.html 2024-03-27T21:32:58.514 INFO:teuthology.orchestra.run.smithi063.stdout: 287032 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-restore-modal 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 287035 4 -rw-r--r-- 1 ubuntu ubuntu 2646 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-restore-modal/rbd-trash-restore-modal.component.spec.ts 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 287036 4 -rw-r--r-- 1 ubuntu ubuntu 2080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-restore-modal/rbd-trash-restore-modal.component.ts 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 287033 4 -rw-r--r-- 1 ubuntu ubuntu 1364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-restore-modal/rbd-trash-restore-modal.component.html 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 287034 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-restore-modal/rbd-trash-restore-modal.component.scss 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 286955 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-list 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 286959 4 -rw-r--r-- 1 ubuntu ubuntu 2288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-list/rbd-configuration-list.component.ts 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 286956 4 -rw-r--r-- 1 ubuntu ubuntu 887 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-list/rbd-configuration-list.component.html 2024-03-27T21:32:58.515 INFO:teuthology.orchestra.run.smithi063.stdout: 286958 4 -rw-r--r-- 1 ubuntu ubuntu 3217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-list/rbd-configuration-list.component.spec.ts 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 286957 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-list/rbd-configuration-list.component.scss 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 287027 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-purge-modal 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 287029 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-purge-modal/rbd-trash-purge-modal.component.scss 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 287028 4 -rw-r--r-- 1 ubuntu ubuntu 1525 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-purge-modal/rbd-trash-purge-modal.component.html 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 287031 4 -rw-r--r-- 1 ubuntu ubuntu 2360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-purge-modal/rbd-trash-purge-modal.component.ts 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 287030 4 -rw-r--r-- 1 ubuntu ubuntu 3364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-purge-modal/rbd-trash-purge-modal.component.spec.ts 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 286990 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-list 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 286993 4 -rw-r--r-- 1 ubuntu ubuntu 1426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-list/rbd-namespace-list.component.spec.ts 2024-03-27T21:32:58.516 INFO:teuthology.orchestra.run.smithi063.stdout: 286991 4 -rw-r--r-- 1 ubuntu ubuntu 572 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-list/rbd-namespace-list.component.html 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 286994 8 -rw-r--r-- 1 ubuntu ubuntu 5279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-list/rbd-namespace-list.component.ts 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 286992 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-list/rbd-namespace-list.component.scss 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 287012 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-tabs 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 287013 4 -rw-r--r-- 1 ubuntu ubuntu 1026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-tabs/rbd-tabs.component.html 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 287014 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-tabs/rbd-tabs.component.scss 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 287015 4 -rw-r--r-- 1 ubuntu ubuntu 784 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-tabs/rbd-tabs.component.spec.ts 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 287016 4 -rw-r--r-- 1 ubuntu ubuntu 548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-tabs/rbd-tabs.component.ts 2024-03-27T21:32:58.517 INFO:teuthology.orchestra.run.smithi063.stdout: 286904 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286905 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-create-modal 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286907 4 -rw-r--r-- 1 ubuntu ubuntu 63 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-create-modal/bootstrap-create-modal.component.scss 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286909 8 -rw-r--r-- 1 ubuntu ubuntu 4709 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-create-modal/bootstrap-create-modal.component.ts 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286906 4 -rwxr-xr-x 1 ubuntu ubuntu 3171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-create-modal/bootstrap-create-modal.component.html 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286908 4 -rw-r--r-- 1 ubuntu ubuntu 4091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-create-modal/bootstrap-create-modal.component.spec.ts 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286933 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-mode-modal 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286937 4 -rw-r--r-- 1 ubuntu ubuntu 3496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-mode-modal/pool-edit-mode-modal.component.ts 2024-03-27T21:32:58.518 INFO:teuthology.orchestra.run.smithi063.stdout: 286935 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-mode-modal/pool-edit-mode-modal.component.scss 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286936 4 -rw-r--r-- 1 ubuntu ubuntu 2965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-mode-modal/pool-edit-mode-modal.component.spec.ts 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286938 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-mode-modal/pool-edit-mode-response.model.ts 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286934 4 -rw-r--r-- 1 ubuntu ubuntu 1598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-mode-modal/pool-edit-mode-modal.component.html 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286910 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-import-modal 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286911 4 -rw-r--r-- 1 ubuntu ubuntu 3686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-import-modal/bootstrap-import-modal.component.html 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286912 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-import-modal/bootstrap-import-modal.component.scss 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286913 8 -rw-r--r-- 1 ubuntu ubuntu 4552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-import-modal/bootstrap-import-modal.component.spec.ts 2024-03-27T21:32:58.519 INFO:teuthology.orchestra.run.smithi063.stdout: 286914 8 -rw-r--r-- 1 ubuntu ubuntu 5524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/bootstrap-import-modal/bootstrap-import-modal.component.ts 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286915 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/daemon-list 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286916 4 -rw-r--r-- 1 ubuntu ubuntu 366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/daemon-list/daemon-list.component.html 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286918 4 -rw-r--r-- 1 ubuntu ubuntu 1014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/daemon-list/daemon-list.component.spec.ts 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286917 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/daemon-list/daemon-list.component.scss 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286919 4 -rw-r--r-- 1 ubuntu ubuntu 1712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/daemon-list/daemon-list.component.ts 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286926 4 -rw-r--r-- 1 ubuntu ubuntu 441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/mirror-health-color.pipe.ts 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286945 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-list 2024-03-27T21:32:58.520 INFO:teuthology.orchestra.run.smithi063.stdout: 286949 8 -rw-r--r-- 1 ubuntu ubuntu 6112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-list/pool-list.component.ts 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286947 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-list/pool-list.component.scss 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286948 4 -rw-r--r-- 1 ubuntu ubuntu 1188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-list/pool-list.component.spec.ts 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286946 4 -rw-r--r-- 1 ubuntu ubuntu 1029 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-list/pool-list.component.html 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286925 4 -rw-r--r-- 1 ubuntu ubuntu 661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/mirror-health-color.pipe.spec.ts 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286927 4 -rw-r--r-- 1 ubuntu ubuntu 1666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/mirroring.module.ts 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286939 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-peer-modal 2024-03-27T21:32:58.521 INFO:teuthology.orchestra.run.smithi063.stdout: 286943 8 -rw-r--r-- 1 ubuntu ubuntu 4378 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-peer-modal/pool-edit-peer-modal.component.ts 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286942 8 -rw-r--r-- 1 ubuntu ubuntu 4848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-peer-modal/pool-edit-peer-modal.component.spec.ts 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286940 4 -rw-r--r-- 1 ubuntu ubuntu 3722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-peer-modal/pool-edit-peer-modal.component.html 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286941 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-peer-modal/pool-edit-peer-modal.component.scss 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286944 4 -rw-r--r-- 1 ubuntu ubuntu 139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/pool-edit-peer-modal/pool-edit-peer-response.model.ts 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286928 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/overview 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286929 4 -rw-r--r-- 1 ubuntu ubuntu 1756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/overview/overview.component.html 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286932 8 -rw-r--r-- 1 ubuntu ubuntu 4165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/overview/overview.component.ts 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286930 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/overview/overview.component.scss 2024-03-27T21:32:58.522 INFO:teuthology.orchestra.run.smithi063.stdout: 286931 4 -rw-r--r-- 1 ubuntu ubuntu 2709 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/overview/overview.component.spec.ts 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 286920 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/image-list 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 286923 4 -rw-r--r-- 1 ubuntu ubuntu 1161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/image-list/image-list.component.spec.ts 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 286922 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/image-list/image-list.component.scss 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 286924 4 -rw-r--r-- 1 ubuntu ubuntu 3095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/image-list/image-list.component.ts 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 286921 4 -rw-r--r-- 1 ubuntu ubuntu 2376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/mirroring/image-list/image-list.component.html 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 287000 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-form 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 287003 4 -rw-r--r-- 1 ubuntu ubuntu 3354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-form/rbd-snapshot-form-modal.component.spec.ts 2024-03-27T21:32:58.523 INFO:teuthology.orchestra.run.smithi063.stdout: 287001 4 -rw-r--r-- 1 ubuntu ubuntu 2896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-form/rbd-snapshot-form-modal.component.html 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 287002 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-form/rbd-snapshot-form-modal.component.scss 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 287004 8 -rw-r--r-- 1 ubuntu ubuntu 5014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-form/rbd-snapshot-form-modal.component.ts 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 286889 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-iqn-settings-modal 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 286892 4 -rw-r--r-- 1 ubuntu ubuntu 2317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-iqn-settings-modal/iscsi-target-iqn-settings-modal.component.spec.ts 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 286890 4 -rw-r--r-- 1 ubuntu ubuntu 1182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-iqn-settings-modal/iscsi-target-iqn-settings-modal.component.html 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 286891 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-iqn-settings-modal/iscsi-target-iqn-settings-modal.component.scss 2024-03-27T21:32:58.524 INFO:teuthology.orchestra.run.smithi063.stdout: 286893 4 -rw-r--r-- 1 ubuntu ubuntu 1810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-iqn-settings-modal/iscsi-target-iqn-settings-modal.component.ts 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 286858 8 -rw-r--r-- 1 ubuntu ubuntu 7991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/block.module.ts 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 286879 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-form 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 286880 28 -rw-r--r-- 1 ubuntu ubuntu 28650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-form/iscsi-target-form.component.html 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 286882 20 -rw-r--r-- 1 ubuntu ubuntu 18776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-form/iscsi-target-form.component.spec.ts 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 286881 4 -rw-r--r-- 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-form/iscsi-target-form.component.scss 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 286883 28 -rw-r--r-- 1 ubuntu ubuntu 27729 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-form/iscsi-target-form.component.ts 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 287022 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-move-modal 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 287024 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-move-modal/rbd-trash-move-modal.component.scss 2024-03-27T21:32:58.525 INFO:teuthology.orchestra.run.smithi063.stdout: 287025 4 -rw-r--r-- 1 ubuntu ubuntu 3140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-move-modal/rbd-trash-move-modal.component.spec.ts 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 287023 4 -rw-r--r-- 1 ubuntu ubuntu 2134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-move-modal/rbd-trash-move-modal.component.html 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 287026 4 -rw-r--r-- 1 ubuntu ubuntu 2744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-trash-move-modal/rbd-trash-move-modal.component.ts 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 286979 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-list 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 286983 24 -rw-r--r-- 1 ubuntu ubuntu 21959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-list/rbd-list.component.ts 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 286984 4 -rw-r--r-- 1 ubuntu ubuntu 226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-list/rbd-model.ts 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 286982 12 -rw-r--r-- 1 ubuntu ubuntu 12089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-list/rbd-list.component.spec.ts 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 286980 8 -rw-r--r-- 1 ubuntu ubuntu 4422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-list/rbd-list.component.html 2024-03-27T21:32:58.526 INFO:teuthology.orchestra.run.smithi063.stdout: 286981 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-list/rbd-list.component.scss 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286894 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-list 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286896 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-list/iscsi-target-list.component.scss 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286898 8 -rw-r--r-- 1 ubuntu ubuntu 7330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-list/iscsi-target-list.component.ts 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286895 4 -rw-r--r-- 1 ubuntu ubuntu 1812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-list/iscsi-target-list.component.html 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286897 12 -rw-r--r-- 1 ubuntu ubuntu 9946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/iscsi-target-list/iscsi-target-list.component.spec.ts 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286985 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-form 2024-03-27T21:32:58.527 INFO:teuthology.orchestra.run.smithi063.stdout: 286986 4 -rw-r--r-- 1 ubuntu ubuntu 3012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-form/rbd-namespace-form-modal.component.html 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286989 8 -rw-r--r-- 1 ubuntu ubuntu 4463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-form/rbd-namespace-form-modal.component.ts 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286988 4 -rw-r--r-- 1 ubuntu ubuntu 1377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-form/rbd-namespace-form-modal.component.spec.ts 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286987 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-namespace-form/rbd-namespace-form-modal.component.scss 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286950 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-form 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286952 4 -rw-r--r-- 1 ubuntu ubuntu 57 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-form/rbd-configuration-form.component.scss 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286954 8 -rw-r--r-- 1 ubuntu ubuntu 5692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-form/rbd-configuration-form.component.ts 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286951 4 -rw-r--r-- 1 ubuntu ubuntu 3075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-form/rbd-configuration-form.component.html 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 286953 12 -rw-r--r-- 1 ubuntu ubuntu 10069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-configuration-form/rbd-configuration-form.component.spec.ts 2024-03-27T21:32:58.528 INFO:teuthology.orchestra.run.smithi063.stdout: 287005 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287009 12 -rw-r--r-- 1 ubuntu ubuntu 11963 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list/rbd-snapshot-list.component.spec.ts 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287010 12 -rw-r--r-- 1 ubuntu ubuntu 11644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list/rbd-snapshot-list.component.ts 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287007 4 -rw-r--r-- 1 ubuntu ubuntu 557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list/rbd-snapshot-list.component.html 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287011 4 -rw-r--r-- 1 ubuntu ubuntu 150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list/rbd-snapshot.model.ts 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287008 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list/rbd-snapshot-list.component.scss 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287006 8 -rw-r--r-- 1 ubuntu ubuntu 4433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/block/rbd-snapshot-list/rbd-snapshot-actions.model.ts 2024-03-27T21:32:58.529 INFO:teuthology.orchestra.run.smithi063.stdout: 287497 4 drwxr-xr-x 31 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287550 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-details 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287554 4 -rw-r--r-- 1 ubuntu ubuntu 1277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-details/rgw-daemon-details.component.ts 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287552 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-details/rgw-daemon-details.component.scss 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287553 4 -rw-r--r-- 1 ubuntu ubuntu 1512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-details/rgw-daemon-details.component.spec.ts 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287551 4 -rw-r--r-- 1 ubuntu ubuntu 1386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-details/rgw-daemon-details.component.html 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287570 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-import 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287571 8 -rw-r--r-- 1 ubuntu ubuntu 7539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-import/rgw-multisite-import.component.html 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287572 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-import/rgw-multisite-import.component.scss 2024-03-27T21:32:58.530 INFO:teuthology.orchestra.run.smithi063.stdout: 287574 8 -rw-r--r-- 1 ubuntu ubuntu 5692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-import/rgw-multisite-import.component.ts 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287573 4 -rw-r--r-- 1 ubuntu ubuntu 1230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-import/rgw-multisite-import.component.spec.ts 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287606 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-metadata-info 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287607 4 -rw-r--r-- 1 ubuntu ubuntu 2356 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-metadata-info/rgw-sync-metadata-info.component.html 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287608 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-metadata-info/rgw-sync-metadata-info.component.scss 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287609 4 -rw-r--r-- 1 ubuntu ubuntu 3014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-metadata-info/rgw-sync-metadata-info.component.spec.ts 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287610 4 -rw-r--r-- 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-metadata-info/rgw-sync-metadata-info.component.ts 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287565 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-export 2024-03-27T21:32:58.531 INFO:teuthology.orchestra.run.smithi063.stdout: 287568 4 -rw-r--r-- 1 ubuntu ubuntu 1230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-export/rgw-multisite-export.component.spec.ts 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287566 4 -rw-r--r-- 1 ubuntu ubuntu 2175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-export/rgw-multisite-export.component.html 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287567 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-export/rgw-multisite-export.component.scss 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287569 4 -rw-r--r-- 1 ubuntu ubuntu 1936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-export/rgw-multisite-export.component.ts 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287646 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-subuser-modal 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287649 4 -rw-r--r-- 1 ubuntu ubuntu 2381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-subuser-modal/rgw-user-subuser-modal.component.spec.ts 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287648 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-subuser-modal/rgw-user-subuser-modal.component.scss 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287647 8 -rw-r--r-- 1 ubuntu ubuntu 4714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-subuser-modal/rgw-user-subuser-modal.component.html 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287650 4 -rw-r--r-- 1 ubuntu ubuntu 3886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-subuser-modal/rgw-user-subuser-modal.component.ts 2024-03-27T21:32:58.532 INFO:teuthology.orchestra.run.smithi063.stdout: 287590 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zonegroup-form 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287593 4 -rw-r--r-- 1 ubuntu ubuntu 3835 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zonegroup-form/rgw-multisite-zonegroup-form.component.spec.ts 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287594 12 -rw-r--r-- 1 ubuntu ubuntu 11613 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zonegroup-form/rgw-multisite-zonegroup-form.component.ts 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287591 12 -rw-r--r-- 1 ubuntu ubuntu 9034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zonegroup-form/rgw-multisite-zonegroup-form.component.html 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287592 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zonegroup-form/rgw-multisite-zonegroup-form.component.scss 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287534 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-form 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287537 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-form/rgw-bucket-form.component.scss 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287535 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-form/rgw-bucket-acl-permissions.enum.ts 2024-03-27T21:32:58.533 INFO:teuthology.orchestra.run.smithi063.stdout: 287539 20 -rw-r--r-- 1 ubuntu ubuntu 18767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-form/rgw-bucket-form.component.ts 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287536 28 -rw-r--r-- 1 ubuntu ubuntu 25804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-form/rgw-bucket-form.component.html 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287538 12 -rw-r--r-- 1 ubuntu ubuntu 10267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-form/rgw-bucket-form.component.spec.ts 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-list 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287639 8 -rw-r--r-- 1 ubuntu ubuntu 5277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-list/rgw-user-list.component.spec.ts 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287637 4 -rw-r--r-- 1 ubuntu ubuntu 1532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-list/rgw-user-list.component.html 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287638 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-list/rgw-user-list.component.scss 2024-03-27T21:32:58.534 INFO:teuthology.orchestra.run.smithi063.stdout: 287640 8 -rw-r--r-- 1 ubuntu ubuntu 6179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-list/rgw-user-list.component.ts 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-system-user 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287617 4 -rw-r--r-- 1 ubuntu ubuntu 1465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-system-user/rgw-system-user.component.html 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287618 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-system-user/rgw-system-user.component.scss 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287619 4 -rw-r--r-- 1 ubuntu ubuntu 1195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-system-user/rgw-system-user.component.spec.ts 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287620 4 -rw-r--r-- 1 ubuntu ubuntu 1692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-system-user/rgw-system-user.component.ts 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287575 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-migrate 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287577 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-migrate/rgw-multisite-migrate.component.scss 2024-03-27T21:32:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: 287579 8 -rw-r--r-- 1 ubuntu ubuntu 7025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-migrate/rgw-multisite-migrate.component.ts 2024-03-27T21:32:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: 287576 8 -rw-r--r-- 1 ubuntu ubuntu 6672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-migrate/rgw-multisite-migrate.component.html 2024-03-27T21:32:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: 287578 4 -rw-r--r-- 1 ubuntu ubuntu 1237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-migrate/rgw-multisite-migrate.component.spec.ts 2024-03-27T21:32:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: 287580 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-realm-form 2024-03-27T21:32:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: 287582 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-realm-form/rgw-multisite-realm-form.component.scss 2024-03-27T21:32:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: 287581 4 -rw-r--r-- 1 ubuntu ubuntu 2554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-realm-form/rgw-multisite-realm-form.component.html 2024-03-27T21:32:58.536 INFO:teuthology.orchestra.run.smithi063.stdout: 287584 8 -rw-r--r-- 1 ubuntu ubuntu 4621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-realm-form/rgw-multisite-realm-form.component.ts 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287583 4 -rw-r--r-- 1 ubuntu ubuntu 3305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-realm-form/rgw-multisite-realm-form.component.spec.ts 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287626 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-details 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287630 4 -rw-r--r-- 1 ubuntu ubuntu 3573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-details/rgw-user-details.component.ts 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287628 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-details/rgw-user-details.component.scss 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287629 4 -rw-r--r-- 1 ubuntu ubuntu 2228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-details/rgw-user-details.component.spec.ts 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287627 8 -rw-r--r-- 1 ubuntu ubuntu 5483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-details/rgw-user-details.component.html 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287585 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zone-form 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287586 16 -rw-r--r-- 1 ubuntu ubuntu 12770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zone-form/rgw-multisite-zone-form.component.html 2024-03-27T21:32:58.537 INFO:teuthology.orchestra.run.smithi063.stdout: 287587 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zone-form/rgw-multisite-zone-form.component.scss 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287589 16 -rw-r--r-- 1 ubuntu ubuntu 12984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zone-form/rgw-multisite-zone-form.component.ts 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287588 4 -rw-r--r-- 1 ubuntu ubuntu 1245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-zone-form/rgw-multisite-zone-form.component.spec.ts 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287560 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287564 24 -rw-r--r-- 1 ubuntu ubuntu 20624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details/rgw-multisite-details.component.ts 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287562 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details/rgw-multisite-details.component.scss 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287563 4 -rw-r--r-- 1 ubuntu ubuntu 1442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details/rgw-multisite-details.component.spec.ts 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287561 8 -rw-r--r-- 1 ubuntu ubuntu 5108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-multisite-details/rgw-multisite-details.component.html 2024-03-27T21:32:58.538 INFO:teuthology.orchestra.run.smithi063.stdout: 287651 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-swift-key-modal 2024-03-27T21:32:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: 287655 4 -rw-r--r-- 1 ubuntu ubuntu 827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-swift-key-modal/rgw-user-swift-key-modal.component.ts 2024-03-27T21:32:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: 287654 4 -rw-r--r-- 1 ubuntu ubuntu 1098 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-swift-key-modal/rgw-user-swift-key-modal.component.spec.ts 2024-03-27T21:32:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: 287653 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-swift-key-modal/rgw-user-swift-key-modal.component.scss 2024-03-27T21:32:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: 287652 4 -rw-r--r-- 1 ubuntu ubuntu 1714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-swift-key-modal/rgw-user-swift-key-modal.component.html 2024-03-27T21:32:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: 287545 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-config-modal 2024-03-27T21:32:58.539 INFO:teuthology.orchestra.run.smithi063.stdout: 287548 4 -rw-r--r-- 1 ubuntu ubuntu 1203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-config-modal/rgw-config-modal.component.spec.ts 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287547 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-config-modal/rgw-config-modal.component.scss 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287546 12 -rw-r--r-- 1 ubuntu ubuntu 9675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-config-modal/rgw-config-modal.component.html 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287549 8 -rw-r--r-- 1 ubuntu ubuntu 4432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-config-modal/rgw-config-modal.component.ts 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287656 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-tabs 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287657 4 -rw-r--r-- 1 ubuntu ubuntu 485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-tabs/rgw-user-tabs.component.html 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287659 4 -rw-r--r-- 1 ubuntu ubuntu 640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-tabs/rgw-user-tabs.component.spec.ts 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287658 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-tabs/rgw-user-tabs.component.scss 2024-03-27T21:32:58.540 INFO:teuthology.orchestra.run.smithi063.stdout: 287660 4 -rw-r--r-- 1 ubuntu ubuntu 226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-tabs/rgw-user-tabs.component.ts 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287498 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/bucket-tag-modal 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287500 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/bucket-tag-modal/bucket-tag-modal.component.scss 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287499 4 -rw-r--r-- 1 ubuntu ubuntu 2328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/bucket-tag-modal/bucket-tag-modal.component.html 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287501 4 -rw-r--r-- 1 ubuntu ubuntu 935 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/bucket-tag-modal/bucket-tag-modal.component.spec.ts 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287502 4 -rw-r--r-- 1 ubuntu ubuntu 2080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/bucket-tag-modal/bucket-tag-modal.component.ts 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287611 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-primary-zone 2024-03-27T21:32:58.541 INFO:teuthology.orchestra.run.smithi063.stdout: 287615 4 -rw-r--r-- 1 ubuntu ubuntu 446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-primary-zone/rgw-sync-primary-zone.component.ts 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287614 4 -rw-r--r-- 1 ubuntu ubuntu 1380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-primary-zone/rgw-sync-primary-zone.component.spec.ts 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287613 4 -rw-r--r-- 1 ubuntu ubuntu 189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-primary-zone/rgw-sync-primary-zone.component.scss 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287612 4 -rw-r--r-- 1 ubuntu ubuntu 590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-primary-zone/rgw-sync-primary-zone.component.html 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287508 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287527 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-user-subuser.ts 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287512 4 -rw-r--r-- 1 ubuntu ubuntu 218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-daemon.ts 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287524 4 -rw-r--r-- 1 ubuntu ubuntu 339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-user-capabilities.ts 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287526 4 -rw-r--r-- 1 ubuntu ubuntu 116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-user-s3-key.ts 2024-03-27T21:32:58.542 INFO:teuthology.orchestra.run.smithi063.stdout: 287509 4 -rw-r--r-- 1 ubuntu ubuntu 187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-bucket-encryption.ts 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287528 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-user-swift-key.ts 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287513 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zone-deletion-form 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287515 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zone-deletion-form/rgw-multisite-zone-deletion-form.component.scss 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287516 4 -rw-r--r-- 1 ubuntu ubuntu 1271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zone-deletion-form/rgw-multisite-zone-deletion-form.component.spec.ts 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287514 4 -rw-r--r-- 1 ubuntu ubuntu 2032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zone-deletion-form/rgw-multisite-zone-deletion-form.component.html 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287517 4 -rw-r--r-- 1 ubuntu ubuntu 3296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zone-deletion-form/rgw-multisite-zone-deletion-form.component.ts 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287525 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-user-capability.ts 2024-03-27T21:32:58.543 INFO:teuthology.orchestra.run.smithi063.stdout: 287511 4 -rw-r--r-- 1 ubuntu ubuntu 85 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-bucket-versioning.ts 2024-03-27T21:32:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: 287518 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zonegroup-deletion-form 2024-03-27T21:32:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: 287520 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zonegroup-deletion-form/rgw-multisite-zonegroup-deletion-form.component.scss 2024-03-27T21:32:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: 287519 4 -rw-r--r-- 1 ubuntu ubuntu 2847 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zonegroup-deletion-form/rgw-multisite-zonegroup-deletion-form.component.html 2024-03-27T21:32:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: 287522 4 -rw-r--r-- 1 ubuntu ubuntu 3756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zonegroup-deletion-form/rgw-multisite-zonegroup-deletion-form.component.ts 2024-03-27T21:32:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: 287521 4 -rw-r--r-- 1 ubuntu ubuntu 1321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite-zonegroup-deletion-form/rgw-multisite-zonegroup-deletion-form.component.spec.ts 2024-03-27T21:32:58.544 INFO:teuthology.orchestra.run.smithi063.stdout: 287510 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-bucket-mfa-delete.ts 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287523 4 -rw-r--r-- 1 ubuntu ubuntu 1023 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/models/rgw-multisite.ts 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287555 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-list 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287559 4 -rw-r--r-- 1 ubuntu ubuntu 2531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-list/rgw-daemon-list.component.ts 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287557 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-list/rgw-daemon-list.component.scss 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287558 4 -rw-r--r-- 1 ubuntu ubuntu 3791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-list/rgw-daemon-list.component.spec.ts 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287556 4 -rw-r--r-- 1 ubuntu ubuntu 1574 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-daemon-list/rgw-daemon-list.component.html 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-data-info 2024-03-27T21:32:58.545 INFO:teuthology.orchestra.run.smithi063.stdout: 287605 4 -rw-r--r-- 1 ubuntu ubuntu 374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-data-info/rgw-sync-data-info.component.ts 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287603 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-data-info/rgw-sync-data-info.component.scss 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287604 4 -rw-r--r-- 1 ubuntu ubuntu 2949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-data-info/rgw-sync-data-info.component.spec.ts 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287602 4 -rw-r--r-- 1 ubuntu ubuntu 1902 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-sync-data-info/rgw-sync-data-info.component.html 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287595 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287596 4 -rw-r--r-- 1 ubuntu ubuntu 314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard/rgw-overview-card-popover.scss 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287599 8 -rw-r--r-- 1 ubuntu ubuntu 4827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard/rgw-overview-dashboard.component.spec.ts 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287597 8 -rw-r--r-- 1 ubuntu ubuntu 7575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard/rgw-overview-dashboard.component.html 2024-03-27T21:32:58.546 INFO:teuthology.orchestra.run.smithi063.stdout: 287598 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard/rgw-overview-dashboard.component.scss 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287600 8 -rw-r--r-- 1 ubuntu ubuntu 5755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-overview-dashboard/rgw-overview-dashboard.component.ts 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287631 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287634 12 -rw-r--r-- 1 ubuntu ubuntu 11388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.spec.ts 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287632 28 -rw-r--r-- 1 ubuntu ubuntu 27954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.html 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287635 28 -rw-r--r-- 1 ubuntu ubuntu 26346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.ts 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287633 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-form/rgw-user-form.component.scss 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287540 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-list 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287543 8 -rw-r--r-- 1 ubuntu ubuntu 5797 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-list/rgw-bucket-list.component.spec.ts 2024-03-27T21:32:58.547 INFO:teuthology.orchestra.run.smithi063.stdout: 287541 4 -rw-r--r-- 1 ubuntu ubuntu 1708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-list/rgw-bucket-list.component.html 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287544 8 -rw-r--r-- 1 ubuntu ubuntu 7363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-list/rgw-bucket-list.component.ts 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287542 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-list/rgw-bucket-list.component.scss 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287529 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-details 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287533 4 -rw-r--r-- 1 ubuntu ubuntu 2150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-details/rgw-bucket-details.component.ts 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287530 8 -rw-r--r-- 1 ubuntu ubuntu 5441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-details/rgw-bucket-details.component.html 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287531 4 -rw-r--r-- 1 ubuntu ubuntu 72 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-details/rgw-bucket-details.component.scss 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287532 4 -rw-r--r-- 1 ubuntu ubuntu 1692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-bucket-details/rgw-bucket-details.component.spec.ts 2024-03-27T21:32:58.548 INFO:teuthology.orchestra.run.smithi063.stdout: 287503 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/create-rgw-service-entities 2024-03-27T21:32:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: 287504 4 -rw-r--r-- 1 ubuntu ubuntu 2712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/create-rgw-service-entities/create-rgw-service-entities.component.html 2024-03-27T21:32:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: 287505 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/create-rgw-service-entities/create-rgw-service-entities.component.scss 2024-03-27T21:32:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: 287506 4 -rw-r--r-- 1 ubuntu ubuntu 1273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/create-rgw-service-entities/create-rgw-service-entities.component.spec.ts 2024-03-27T21:32:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: 287507 4 -rw-r--r-- 1 ubuntu ubuntu 3621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/create-rgw-service-entities/create-rgw-service-entities.component.ts 2024-03-27T21:32:58.549 INFO:teuthology.orchestra.run.smithi063.stdout: 287621 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-capability-modal 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287622 4 -rw-r--r-- 1 ubuntu ubuntu 2605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-capability-modal/rgw-user-capability-modal.component.html 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287625 4 -rw-r--r-- 1 ubuntu ubuntu 2625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-capability-modal/rgw-user-capability-modal.component.ts 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287624 4 -rw-r--r-- 1 ubuntu ubuntu 1060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-capability-modal/rgw-user-capability-modal.component.spec.ts 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287623 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-capability-modal/rgw-user-capability-modal.component.scss 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287661 8 -rw-r--r-- 1 ubuntu ubuntu 7798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw.module.ts 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-s3-key-modal 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287643 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-s3-key-modal/rgw-user-s3-key-modal.component.scss 2024-03-27T21:32:58.550 INFO:teuthology.orchestra.run.smithi063.stdout: 287644 4 -rw-r--r-- 1 ubuntu ubuntu 1026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-s3-key-modal/rgw-user-s3-key-modal.component.spec.ts 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287645 4 -rw-r--r-- 1 ubuntu ubuntu 2476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-s3-key-modal/rgw-user-s3-key-modal.component.ts 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287642 8 -rw-r--r-- 1 ubuntu ubuntu 4615 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/rgw/rgw-user-s3-key-modal/rgw-user-s3-key-modal.component.html 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287662 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287674 4 -rw-r--r-- 1 ubuntu ubuntu 1709 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/pg-category.model.ts 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287669 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/feedback 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287672 4 -rw-r--r-- 1 ubuntu ubuntu 2454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/feedback/feedback.component.spec.ts 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287671 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/feedback/feedback.component.scss 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287670 8 -rw-r--r-- 1 ubuntu ubuntu 4717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/feedback/feedback.component.html 2024-03-27T21:32:58.551 INFO:teuthology.orchestra.run.smithi063.stdout: 287673 4 -rw-r--r-- 1 ubuntu ubuntu 3404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/feedback/feedback.component.ts 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287664 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/device-list 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287667 4 -rw-r--r-- 1 ubuntu ubuntu 817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/device-list/device-list.component.spec.ts 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287668 4 -rw-r--r-- 1 ubuntu ubuntu 2974 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/device-list/device-list.component.ts 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287666 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/device-list/device-list.component.scss 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287665 4 -rw-r--r-- 1 ubuntu ubuntu 1779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/device-list/device-list.component.html 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287676 4 -rw-r--r-- 1 ubuntu ubuntu 1611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/pg-category.service.ts 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287663 4 -rw-r--r-- 1 ubuntu ubuntu 747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/ceph-shared.module.ts 2024-03-27T21:32:58.552 INFO:teuthology.orchestra.run.smithi063.stdout: 287677 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287685 8 -rw-r--r-- 1 ubuntu ubuntu 6774 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/smart-list.component.ts 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287683 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/smart-list.component.scss 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287678 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/fixtures 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287680 8 -rw-r--r-- 1 ubuntu ubuntu 5866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/fixtures/smart_data_version_1_0_nvme_response.json 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287679 16 -rw-r--r-- 1 ubuntu ubuntu 13993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/fixtures/smart_data_version_1_0_ata_response.json 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287681 8 -rw-r--r-- 1 ubuntu ubuntu 8161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/fixtures/smart_data_version_1_0_scsi_response.json 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287682 8 -rw-r--r-- 1 ubuntu ubuntu 5596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/smart-list.component.html 2024-03-27T21:32:58.553 INFO:teuthology.orchestra.run.smithi063.stdout: 287684 12 -rw-r--r-- 1 ubuntu ubuntu 8773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/smart-list/smart-list.component.spec.ts 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287675 4 -rw-r--r-- 1 ubuntu ubuntu 1734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/shared/pg-category.service.spec.ts 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287467 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287478 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-details 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287482 4 -rw-r--r-- 1 ubuntu ubuntu 2330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-details/pool-details.component.ts 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287481 8 -rw-r--r-- 1 ubuntu ubuntu 5809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-details/pool-details.component.spec.ts 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287480 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-details/pool-details.component.scss 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287479 4 -rw-r--r-- 1 ubuntu ubuntu 1848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-details/pool-details.component.html 2024-03-27T21:32:58.554 INFO:teuthology.orchestra.run.smithi063.stdout: 287473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/erasure-code-profile-form 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287476 24 -rw-r--r-- 1 ubuntu ubuntu 23142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/erasure-code-profile-form/erasure-code-profile-form-modal.component.spec.ts 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287475 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/erasure-code-profile-form/erasure-code-profile-form-modal.component.scss 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287474 20 -rw-r--r-- 1 ubuntu ubuntu 16589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/erasure-code-profile-form/erasure-code-profile-form-modal.component.html 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287477 16 -rw-r--r-- 1 ubuntu ubuntu 14256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/erasure-code-profile-form/erasure-code-profile-form-modal.component.ts 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287496 4 -rw-r--r-- 1 ubuntu ubuntu 1931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool.ts 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287495 4 -rw-r--r-- 1 ubuntu ubuntu 1836 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool.module.ts 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287489 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-list 2024-03-27T21:32:58.555 INFO:teuthology.orchestra.run.smithi063.stdout: 287493 12 -rw-r--r-- 1 ubuntu ubuntu 11017 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-list/pool-list.component.ts 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287491 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-list/pool-list.component.scss 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287492 20 -rw-r--r-- 1 ubuntu ubuntu 17495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-list/pool-list.component.spec.ts 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287490 4 -rw-r--r-- 1 ubuntu ubuntu 2055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-list/pool-list.component.html 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287483 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287485 28 -rw-r--r-- 1 ubuntu ubuntu 26660 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form.component.html 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287484 4 -rw-r--r-- 1 ubuntu ubuntu 1179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form-data.ts 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287487 48 -rw-r--r-- 1 ubuntu ubuntu 48474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form.component.spec.ts 2024-03-27T21:32:58.556 INFO:teuthology.orchestra.run.smithi063.stdout: 287486 4 -rw-r--r-- 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form.component.scss 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287488 32 -rw-r--r-- 1 ubuntu ubuntu 29503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-form/pool-form.component.ts 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287494 4 -rw-r--r-- 1 ubuntu ubuntu 287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/pool-stat.ts 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/crush-rule-form-modal 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287469 8 -rw-r--r-- 1 ubuntu ubuntu 4708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/crush-rule-form-modal/crush-rule-form-modal.component.html 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287470 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/crush-rule-form-modal/crush-rule-form-modal.component.scss 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287472 4 -rw-r--r-- 1 ubuntu ubuntu 3338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/crush-rule-form-modal/crush-rule-form-modal.component.ts 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287471 8 -rw-r--r-- 1 ubuntu ubuntu 7849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/pool/crush-rule-form-modal/crush-rule-form-modal.component.spec.ts 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287037 4 -rw-r--r-- 1 ubuntu ubuntu 681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/ceph.module.ts 2024-03-27T21:32:58.557 INFO:teuthology.orchestra.run.smithi063.stdout: 287125 4 drwxr-xr-x 16 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287210 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/monitor 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287211 4 -rw-r--r-- 1 ubuntu ubuntu 1837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/monitor/monitor.component.html 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287214 4 -rw-r--r-- 1 ubuntu ubuntu 2232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/monitor/monitor.component.ts 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287213 4 -rw-r--r-- 1 ubuntu ubuntu 2917 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/monitor/monitor.component.spec.ts 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287212 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/monitor/monitor.component.scss 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287126 8 -rw-r--r-- 1 ubuntu ubuntu 6569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/cluster.module.ts 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287152 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/crushmap 2024-03-27T21:32:58.558 INFO:teuthology.orchestra.run.smithi063.stdout: 287155 8 -rw-r--r-- 1 ubuntu ubuntu 4440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/crushmap/crushmap.component.spec.ts 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287153 4 -rw-r--r-- 1 ubuntu ubuntu 1534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/crushmap/crushmap.component.html 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287154 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/crushmap/crushmap.component.scss 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287156 4 -rw-r--r-- 1 ubuntu ubuntu 3080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/crushmap/crushmap.component.ts 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287149 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster.component.scss 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287146 4 -rw-r--r-- 1 ubuntu ubuntu 1024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster-review.component.spec.ts 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287144 4 -rw-r--r-- 1 ubuntu ubuntu 1314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster-review.component.html 2024-03-27T21:32:58.559 INFO:teuthology.orchestra.run.smithi063.stdout: 287148 4 -rw-r--r-- 1 ubuntu ubuntu 3801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster.component.html 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287150 8 -rw-r--r-- 1 ubuntu ubuntu 6659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster.component.spec.ts 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287147 4 -rw-r--r-- 1 ubuntu ubuntu 2736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster-review.component.ts 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287145 4 -rw-r--r-- 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster-review.component.scss 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287151 12 -rw-r--r-- 1 ubuntu ubuntu 8323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/create-cluster/create-cluster.component.ts 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287215 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287229 16 -rw-r--r-- 1 ubuntu ubuntu 14062 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster.component.ts 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287227 4 -rw-r--r-- 1 ubuntu ubuntu 124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster.component.scss 2024-03-27T21:32:58.560 INFO:teuthology.orchestra.run.smithi063.stdout: 287216 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-form 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287219 4 -rw-r--r-- 1 ubuntu ubuntu 1452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-form/multi-cluster-form.component.spec.ts 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287218 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-form/multi-cluster-form.component.scss 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287220 12 -rw-r--r-- 1 ubuntu ubuntu 11018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-form/multi-cluster-form.component.ts 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287217 12 -rw-r--r-- 1 ubuntu ubuntu 11739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-form/multi-cluster-form.component.html 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287226 12 -rw-r--r-- 1 ubuntu ubuntu 10703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster.component.html 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287221 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-list 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287223 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-list/multi-cluster-list.component.scss 2024-03-27T21:32:58.561 INFO:teuthology.orchestra.run.smithi063.stdout: 287222 4 -rw-r--r-- 1 ubuntu ubuntu 1099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-list/multi-cluster-list.component.html 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287224 4 -rw-r--r-- 1 ubuntu ubuntu 1209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-list/multi-cluster-list.component.spec.ts 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287225 8 -rw-r--r-- 1 ubuntu ubuntu 8041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster-list/multi-cluster-list.component.ts 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287228 4 -rw-r--r-- 1 ubuntu ubuntu 1012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/multi-cluster/multi-cluster.component.spec.ts 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287127 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287128 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-details 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287129 4 -rwxr-xr-x 1 ubuntu ubuntu 2727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-details/configuration-details.component.html 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287130 0 -rwxr-xr-x 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-details/configuration-details.component.scss 2024-03-27T21:32:58.562 INFO:teuthology.orchestra.run.smithi063.stdout: 287131 4 -rwxr-xr-x 1 ubuntu ubuntu 882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-details/configuration-details.component.spec.ts 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287132 4 -rwxr-xr-x 1 ubuntu ubuntu 1014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-details/configuration-details.component.ts 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287142 8 -rw-r--r-- 1 ubuntu ubuntu 4498 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration.component.ts 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287133 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-form 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287137 4 -rw-r--r-- 1 ubuntu ubuntu 3194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-form/configuration-form.component.spec.ts 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287138 8 -rw-r--r-- 1 ubuntu ubuntu 5785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-form/configuration-form.component.ts 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287135 8 -rw-r--r-- 1 ubuntu ubuntu 5920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-form/configuration-form.component.html 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287134 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-form/configuration-form-create-request.model.ts 2024-03-27T21:32:58.563 INFO:teuthology.orchestra.run.smithi063.stdout: 287136 4 -rw-r--r-- 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration-form/configuration-form.component.scss 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287141 4 -rw-r--r-- 1 ubuntu ubuntu 1619 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration.component.spec.ts 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287139 4 -rw-r--r-- 1 ubuntu ubuntu 911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration.component.html 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287140 4 -rw-r--r-- 1 ubuntu ubuntu 218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/configuration/configuration.component.scss 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287356 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287368 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade.component.scss 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287370 8 -rw-r--r-- 1 ubuntu ubuntu 4775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade.component.ts 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-form 2024-03-27T21:32:58.564 INFO:teuthology.orchestra.run.smithi063.stdout: 287361 4 -rw-r--r-- 1 ubuntu ubuntu 3623 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-form/upgrade-start-modal.component.ts 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287358 4 -rw-r--r-- 1 ubuntu ubuntu 3594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-form/upgrade-start-modal.component.html 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287360 4 -rw-r--r-- 1 ubuntu ubuntu 1130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-form/upgrade-start-modal.component.spec.ts 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287359 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-form/upgrade-start-modal.component.scss 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287362 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-progress 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287366 8 -rw-r--r-- 1 ubuntu ubuntu 4593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-progress/upgrade-progress.component.ts 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287363 4 -rw-r--r-- 1 ubuntu ubuntu 2890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-progress/upgrade-progress.component.html 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287365 4 -rw-r--r-- 1 ubuntu ubuntu 1077 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-progress/upgrade-progress.component.spec.ts 2024-03-27T21:32:58.565 INFO:teuthology.orchestra.run.smithi063.stdout: 287364 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade-progress/upgrade-progress.component.scss 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287367 12 -rw-r--r-- 1 ubuntu ubuntu 8218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade.component.html 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287369 8 -rw-r--r-- 1 ubuntu ubuntu 8110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/upgrade/upgrade.component.spec.ts 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287193 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287199 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-form 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287202 4 -rw-r--r-- 1 ubuntu ubuntu 2660 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-form/mgr-module-form.component.spec.ts 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287200 8 -rw-r--r-- 1 ubuntu ubuntu 5185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-form/mgr-module-form.component.html 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287203 8 -rw-r--r-- 1 ubuntu ubuntu 4162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-form/mgr-module-form.component.ts 2024-03-27T21:32:58.566 INFO:teuthology.orchestra.run.smithi063.stdout: 287201 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-form/mgr-module-form.component.scss 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287204 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-list 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287208 8 -rw-r--r-- 1 ubuntu ubuntu 6249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-list/mgr-module-list.component.ts 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287207 8 -rw-r--r-- 1 ubuntu ubuntu 6020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-list/mgr-module-list.component.spec.ts 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287206 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-list/mgr-module-list.component.scss 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287205 4 -rw-r--r-- 1 ubuntu ubuntu 714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-list/mgr-module-list.component.html 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287194 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-details 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287196 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-details/mgr-module-details.component.scss 2024-03-27T21:32:58.567 INFO:teuthology.orchestra.run.smithi063.stdout: 287198 4 -rw-r--r-- 1 ubuntu ubuntu 659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-details/mgr-module-details.component.ts 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287197 4 -rw-r--r-- 1 ubuntu ubuntu 897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-details/mgr-module-details.component.spec.ts 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287195 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-module-details/mgr-module-details.component.html 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287209 4 -rw-r--r-- 1 ubuntu ubuntu 827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/mgr-modules/mgr-modules.module.ts 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287230 4 drwxr-xr-x 14 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287248 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-modal 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287251 4 -rw-r--r-- 1 ubuntu ubuntu 3638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-modal/osd-devices-selection-modal.component.spec.ts 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287252 4 -rw-r--r-- 1 ubuntu ubuntu 3243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-modal/osd-devices-selection-modal.component.ts 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287250 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-modal/osd-devices-selection-modal.component.scss 2024-03-27T21:32:58.568 INFO:teuthology.orchestra.run.smithi063.stdout: 287249 4 -rw-r--r-- 1 ubuntu ubuntu 1791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-modal/osd-devices-selection-modal.component.html 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287236 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-details 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287240 4 -rw-r--r-- 1 ubuntu ubuntu 1094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-details/osd-details.component.ts 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287239 4 -rw-r--r-- 1 ubuntu ubuntu 1198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-details/osd-details.component.spec.ts 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287238 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-details/osd-details.component.scss 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287237 4 -rw-r--r-- 1 ubuntu ubuntu 2524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-details/osd-details.component.html 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287241 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups 2024-03-27T21:32:58.569 INFO:teuthology.orchestra.run.smithi063.stdout: 287243 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups/devices-selection-clear-event.interface.ts 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287245 4 -rw-r--r-- 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups/osd-devices-selection-groups.component.scss 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287242 4 -rw-r--r-- 1 ubuntu ubuntu 198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups/devices-selection-change-event.interface.ts 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287244 4 -rw-r--r-- 1 ubuntu ubuntu 2364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups/osd-devices-selection-groups.component.html 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287246 8 -rw-r--r-- 1 ubuntu ubuntu 4189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups/osd-devices-selection-groups.component.spec.ts 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287247 8 -rw-r--r-- 1 ubuntu ubuntu 4575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-devices-selection-groups/osd-devices-selection-groups.component.ts 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287288 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-reweight-modal 2024-03-27T21:32:58.570 INFO:teuthology.orchestra.run.smithi063.stdout: 287291 4 -rw-r--r-- 1 ubuntu ubuntu 2078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-reweight-modal/osd-reweight-modal.component.spec.ts 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287289 4 -rw-r--r-- 1 ubuntu ubuntu 1367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-reweight-modal/osd-reweight-modal.component.html 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287290 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-reweight-modal/osd-reweight-modal.component.scss 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287292 4 -rw-r--r-- 1 ubuntu ubuntu 1241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-reweight-modal/osd-reweight-modal.component.ts 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287277 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-pg-scrub-modal 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287280 4 -rw-r--r-- 1 ubuntu ubuntu 2254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-pg-scrub-modal/osd-pg-scrub-modal.component.spec.ts 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287279 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-pg-scrub-modal/osd-pg-scrub-modal.component.scss 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287281 4 -rw-r--r-- 1 ubuntu ubuntu 2359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-pg-scrub-modal/osd-pg-scrub-modal.component.ts 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287278 4 -rw-r--r-- 1 ubuntu ubuntu 1873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-pg-scrub-modal/osd-pg-scrub-modal.component.html 2024-03-27T21:32:58.571 INFO:teuthology.orchestra.run.smithi063.stdout: 287282 4 -rw-r--r-- 1 ubuntu ubuntu 1165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-pg-scrub-modal/osd-pg-scrub-modal.options.ts 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287231 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-creation-preview-modal 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287232 4 -rw-r--r-- 1 ubuntu ubuntu 658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-creation-preview-modal/osd-creation-preview-modal.component.html 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287233 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-creation-preview-modal/osd-creation-preview-modal.component.scss 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287234 4 -rw-r--r-- 1 ubuntu ubuntu 1267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-creation-preview-modal/osd-creation-preview-modal.component.spec.ts 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287235 4 -rw-r--r-- 1 ubuntu ubuntu 1872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-creation-preview-modal/osd-creation-preview-modal.component.ts 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-scrub-modal 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287295 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-scrub-modal/osd-scrub-modal.component.scss 2024-03-27T21:32:58.572 INFO:teuthology.orchestra.run.smithi063.stdout: 287297 4 -rw-r--r-- 1 ubuntu ubuntu 1625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-scrub-modal/osd-scrub-modal.component.ts 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287294 4 -rw-r--r-- 1 ubuntu ubuntu 767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-scrub-modal/osd-scrub-modal.component.html 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287296 4 -rw-r--r-- 1 ubuntu ubuntu 1515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-scrub-modal/osd-scrub-modal.component.spec.ts 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-indiv-modal 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287256 16 -rw-r--r-- 1 ubuntu ubuntu 13627 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-indiv-modal/osd-flags-indiv-modal.component.spec.ts 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287254 4 -rw-r--r-- 1 ubuntu ubuntu 1810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-indiv-modal/osd-flags-indiv-modal.component.html 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287255 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-indiv-modal/osd-flags-indiv-modal.component.scss 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287257 8 -rw-r--r-- 1 ubuntu ubuntu 4220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-indiv-modal/osd-flags-indiv-modal.component.ts 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287263 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form 2024-03-27T21:32:58.573 INFO:teuthology.orchestra.run.smithi063.stdout: 287269 12 -rw-r--r-- 1 ubuntu ubuntu 9870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form/osd-form.component.ts 2024-03-27T21:32:58.574 INFO:teuthology.orchestra.run.smithi063.stdout: 287265 4 -rw-r--r-- 1 ubuntu ubuntu 64 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form/osd-feature.interface.ts 2024-03-27T21:32:58.574 INFO:teuthology.orchestra.run.smithi063.stdout: 287264 4 -rw-r--r-- 1 ubuntu ubuntu 2320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form/drive-group.model.ts 2024-03-27T21:32:58.574 INFO:teuthology.orchestra.run.smithi063.stdout: 287267 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form/osd-form.component.scss 2024-03-27T21:32:58.574 INFO:teuthology.orchestra.run.smithi063.stdout: 287268 12 -rw-r--r-- 1 ubuntu ubuntu 10853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form/osd-form.component.spec.ts 2024-03-27T21:32:58.574 INFO:teuthology.orchestra.run.smithi063.stdout: 287266 12 -rw-r--r-- 1 ubuntu ubuntu 10052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-form/osd-form.component.html 2024-03-27T21:32:58.574 INFO:teuthology.orchestra.run.smithi063.stdout: 287270 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287273 8 -rw-r--r-- 1 ubuntu ubuntu 5469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/osd-list.component.html 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287276 24 -rw-r--r-- 1 ubuntu ubuntu 21481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/osd-list.component.ts 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287271 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/fixtures 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287272 20 -rw-r--r-- 1 ubuntu ubuntu 17788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/fixtures/osd_list_response.json 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287274 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/osd-list.component.scss 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287275 24 -rw-r--r-- 1 ubuntu ubuntu 21454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-list/osd-list.component.spec.ts 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287258 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-modal 2024-03-27T21:32:58.575 INFO:teuthology.orchestra.run.smithi063.stdout: 287260 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-modal/osd-flags-modal.component.scss 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287259 4 -rw-r--r-- 1 ubuntu ubuntu 1484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-modal/osd-flags-modal.component.html 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287262 8 -rw-r--r-- 1 ubuntu ubuntu 4611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-modal/osd-flags-modal.component.ts 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287261 4 -rw-r--r-- 1 ubuntu ubuntu 3403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-flags-modal/osd-flags-modal.component.spec.ts 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287283 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-recv-speed-modal 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287285 0 -rwxr-xr-x 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-recv-speed-modal/osd-recv-speed-modal.component.scss 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287287 8 -rwxr-xr-x 1 ubuntu ubuntu 7939 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-recv-speed-modal/osd-recv-speed-modal.component.ts 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287286 12 -rwxr-xr-x 1 ubuntu ubuntu 11202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-recv-speed-modal/osd-recv-speed-modal.component.spec.ts 2024-03-27T21:32:58.576 INFO:teuthology.orchestra.run.smithi063.stdout: 287284 4 -rwxr-xr-x 1 ubuntu ubuntu 4085 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/osd/osd-recv-speed-modal/osd-recv-speed-modal.component.html 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287188 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/logs 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287189 8 -rw-r--r-- 1 ubuntu ubuntu 6755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/logs/logs.component.html 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287192 8 -rw-r--r-- 1 ubuntu ubuntu 5303 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/logs/logs.component.ts 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287191 8 -rw-r--r-- 1 ubuntu ubuntu 5192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/logs/logs.component.spec.ts 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287190 4 -rw-r--r-- 1 ubuntu ubuntu 684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/logs/logs.component.scss 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287329 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287337 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-details 2024-03-27T21:32:58.577 INFO:teuthology.orchestra.run.smithi063.stdout: 287339 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-details/service-details.component.scss 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287338 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-details/service-details.component.html 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287341 4 -rw-r--r-- 1 ubuntu ubuntu 464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-details/service-details.component.ts 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287340 4 -rw-r--r-- 1 ubuntu ubuntu 1604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-details/service-details.component.spec.ts 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287350 12 -rw-r--r-- 1 ubuntu ubuntu 8692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/services.component.ts 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287348 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/services.component.scss 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287330 4 -rw-r--r-- 1 ubuntu ubuntu 1507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/placement.pipe.spec.ts 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287331 4 -rw-r--r-- 1 ubuntu ubuntu 1289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/placement.pipe.ts 2024-03-27T21:32:58.578 INFO:teuthology.orchestra.run.smithi063.stdout: 287342 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287344 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.scss 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287345 20 -rw-r--r-- 1 ubuntu ubuntu 20236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.spec.ts 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287343 36 -rw-r--r-- 1 ubuntu ubuntu 36863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.html 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287346 32 -rw-r--r-- 1 ubuntu ubuntu 30773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-form/service-form.component.ts 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287349 4 -rw-r--r-- 1 ubuntu ubuntu 3549 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/services.component.spec.ts 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287347 4 -rw-r--r-- 1 ubuntu ubuntu 1419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/services.component.html 2024-03-27T21:32:58.579 INFO:teuthology.orchestra.run.smithi063.stdout: 287332 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-daemon-list 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287336 12 -rw-r--r-- 1 ubuntu ubuntu 9692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-daemon-list/service-daemon-list.component.ts 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287333 4 -rw-r--r-- 1 ubuntu ubuntu 3122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-daemon-list/service-daemon-list.component.html 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287335 12 -rw-r--r-- 1 ubuntu ubuntu 8949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-daemon-list/service-daemon-list.component.spec.ts 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287334 4 -rw-r--r-- 1 ubuntu ubuntu 209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/services/service-daemon-list/service-daemon-list.component.scss 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287174 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287185 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory.component.scss 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287184 4 -rw-r--r-- 1 ubuntu ubuntu 575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory.component.html 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287187 4 -rw-r--r-- 1 ubuntu ubuntu 2691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory.component.ts 2024-03-27T21:32:58.580 INFO:teuthology.orchestra.run.smithi063.stdout: 287186 4 -rw-r--r-- 1 ubuntu ubuntu 2490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory.component.spec.ts 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287183 4 -rw-r--r-- 1 ubuntu ubuntu 156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-host.model.ts 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287175 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287180 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/inventory-devices.component.scss 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287178 4 -rw-r--r-- 1 ubuntu ubuntu 358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/inventory-device.model.ts 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/fixtures 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287177 12 -rw-r--r-- 1 ubuntu ubuntu 8815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/fixtures/inventory_list_response.json 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287182 8 -rw-r--r-- 1 ubuntu ubuntu 7928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/inventory-devices.component.ts 2024-03-27T21:32:58.581 INFO:teuthology.orchestra.run.smithi063.stdout: 287181 8 -rw-r--r-- 1 ubuntu ubuntu 6518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/inventory-devices.component.spec.ts 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287179 4 -rw-r--r-- 1 ubuntu ubuntu 596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/inventory/inventory-devices/inventory-devices.component.html 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287351 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/telemetry 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287353 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/telemetry/telemetry.component.scss 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287352 16 -rw-r--r-- 1 ubuntu ubuntu 15628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/telemetry/telemetry.component.html 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287354 12 -rw-r--r-- 1 ubuntu ubuntu 9011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/telemetry/telemetry.component.spec.ts 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287355 12 -rw-r--r-- 1 ubuntu ubuntu 9037 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/telemetry/telemetry.component.ts 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287298 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus 2024-03-27T21:32:58.582 INFO:teuthology.orchestra.run.smithi063.stdout: 287324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-matcher-modal 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287328 4 -rw-r--r-- 1 ubuntu ubuntu 3503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-matcher-modal/silence-matcher-modal.component.ts 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287325 4 -rw-r--r-- 1 ubuntu ubuntu 3139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-matcher-modal/silence-matcher-modal.component.html 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287327 8 -rw-r--r-- 1 ubuntu ubuntu 6262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-matcher-modal/silence-matcher-modal.component.spec.ts 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287326 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-matcher-modal/silence-matcher-modal.component.scss 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287304 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/prometheus-tabs 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287306 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/prometheus-tabs/prometheus-tabs.component.scss 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287305 4 -rw-r--r-- 1 ubuntu ubuntu 1087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/prometheus-tabs/prometheus-tabs.component.html 2024-03-27T21:32:58.583 INFO:teuthology.orchestra.run.smithi063.stdout: 287308 4 -rw-r--r-- 1 ubuntu ubuntu 398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/prometheus-tabs/prometheus-tabs.component.ts 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287307 4 -rw-r--r-- 1 ubuntu ubuntu 1002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/prometheus-tabs/prometheus-tabs.component.spec.ts 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287314 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-form 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287318 12 -rw-r--r-- 1 ubuntu ubuntu 11005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-form/silence-form.component.ts 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287315 8 -rw-r--r-- 1 ubuntu ubuntu 7499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-form/silence-form.component.html 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287317 24 -rw-r--r-- 1 ubuntu ubuntu 21066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-form/silence-form.component.spec.ts 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287316 4 -rw-r--r-- 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-form/silence-form.component.scss 2024-03-27T21:32:58.584 INFO:teuthology.orchestra.run.smithi063.stdout: 287319 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-list 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287320 4 -rw-r--r-- 1 ubuntu ubuntu 1296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-list/silence-list.component.html 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287321 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-list/silence-list.component.scss 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287323 12 -rw-r--r-- 1 ubuntu ubuntu 8253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-list/silence-list.component.ts 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287322 8 -rw-r--r-- 1 ubuntu ubuntu 5848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/silence-list/silence-list.component.spec.ts 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287299 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287302 4 -rw-r--r-- 1 ubuntu ubuntu 3389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list/active-alert-list.component.spec.ts 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287300 4 -rw-r--r-- 1 ubuntu ubuntu 1501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list/active-alert-list.component.html 2024-03-27T21:32:58.585 INFO:teuthology.orchestra.run.smithi063.stdout: 287301 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list/active-alert-list.component.scss 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287303 4 -rw-r--r-- 1 ubuntu ubuntu 3838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/active-alert-list/active-alert-list.component.ts 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287309 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/rules-list 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287312 4 -rw-r--r-- 1 ubuntu ubuntu 1379 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/rules-list/rules-list.component.spec.ts 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287311 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/rules-list/rules-list.component.scss 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287313 4 -rw-r--r-- 1 ubuntu ubuntu 2380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/rules-list/rules-list.component.ts 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287310 4 -rw-r--r-- 1 ubuntu ubuntu 851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/prometheus/rules-list/rules-list.component.html 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287157 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts 2024-03-27T21:32:58.586 INFO:teuthology.orchestra.run.smithi063.stdout: 287165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-form 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287169 8 -rw-r--r-- 1 ubuntu ubuntu 6160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-form/host-form.component.ts 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287168 8 -rw-r--r-- 1 ubuntu ubuntu 5259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-form/host-form.component.spec.ts 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287167 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-form/host-form.component.scss 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287166 8 -rw-r--r-- 1 ubuntu ubuntu 4270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-form/host-form.component.html 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287158 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/fixtures 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287159 4 -rw-r--r-- 1 ubuntu ubuntu 821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/fixtures/host_list_response.json 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287172 16 -rw-r--r-- 1 ubuntu ubuntu 14893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/hosts.component.spec.ts 2024-03-27T21:32:58.587 INFO:teuthology.orchestra.run.smithi063.stdout: 287171 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/hosts.component.scss 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287160 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-details 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287162 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-details/host-details.component.scss 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287164 4 -rw-r--r-- 1 ubuntu ubuntu 481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-details/host-details.component.ts 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287163 4 -rw-r--r-- 1 ubuntu ubuntu 2051 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-details/host-details.component.spec.ts 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287161 4 -rw-r--r-- 1 ubuntu ubuntu 2108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/host-details/host-details.component.html 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287170 4 -rw-r--r-- 1 ubuntu ubuntu 3588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/hosts.component.html 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287173 20 -rw-r--r-- 1 ubuntu ubuntu 18127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/cluster/hosts/hosts.component.ts 2024-03-27T21:32:58.588 INFO:teuthology.orchestra.run.smithi063.stdout: 287455 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/table-performance-counter 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287465 4 -rw-r--r-- 1 ubuntu ubuntu 2150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/table-performance-counter/table-performance-counter.component.spec.ts 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287466 4 -rw-r--r-- 1 ubuntu ubuntu 1813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/table-performance-counter/table-performance-counter.component.ts 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287464 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/table-performance-counter/table-performance-counter.component.scss 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287463 4 -rw-r--r-- 1 ubuntu ubuntu 476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/table-performance-counter/table-performance-counter.component.html 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287457 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/performance-counter 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287461 4 -rw-r--r-- 1 ubuntu ubuntu 799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/performance-counter/performance-counter.component.ts 2024-03-27T21:32:58.589 INFO:teuthology.orchestra.run.smithi063.stdout: 287458 4 -rw-r--r-- 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/performance-counter/performance-counter.component.html 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287459 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/performance-counter/performance-counter.component.scss 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287460 4 -rw-r--r-- 1 ubuntu ubuntu 1213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/performance-counter/performance-counter.component.spec.ts 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287456 4 -rw-r--r-- 1 ubuntu ubuntu 652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/performance-counter/performance-counter.module.ts 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287431 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287454 4 -rw-r--r-- 1 ubuntu ubuntu 943 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs.module.ts 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287439 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form-client 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287442 4 -rw-r--r-- 1 ubuntu ubuntu 2410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form-client/nfs-form-client.component.spec.ts 2024-03-27T21:32:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 287440 8 -rw-r--r-- 1 ubuntu ubuntu 4119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form-client/nfs-form-client.component.html 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287443 4 -rw-r--r-- 1 ubuntu ubuntu 3174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form-client/nfs-form-client.component.ts 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287441 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form-client/nfs-form-client.component.scss 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/models 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287433 4 -rw-r--r-- 1 ubuntu ubuntu 98 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/models/nfs.fsal.ts 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287434 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-details 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287437 4 -rw-r--r-- 1 ubuntu ubuntu 2933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-details/nfs-details.component.spec.ts 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287438 4 -rw-r--r-- 1 ubuntu ubuntu 2052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-details/nfs-details.component.ts 2024-03-27T21:32:58.591 INFO:teuthology.orchestra.run.smithi063.stdout: 287436 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-details/nfs-details.component.scss 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287435 4 -rw-r--r-- 1 ubuntu ubuntu 887 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-details/nfs-details.component.html 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287444 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287448 20 -rw-r--r-- 1 ubuntu ubuntu 16783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form/nfs-form.component.ts 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287446 4 -rw-r--r-- 1 ubuntu ubuntu 128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form/nfs-form.component.scss 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287447 12 -rw-r--r-- 1 ubuntu ubuntu 8832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form/nfs-form.component.spec.ts 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287445 20 -rw-r--r-- 1 ubuntu ubuntu 17746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-form/nfs-form.component.html 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287449 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-list 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287453 8 -rw-r--r-- 1 ubuntu ubuntu 6066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-list/nfs-list.component.ts 2024-03-27T21:32:58.592 INFO:teuthology.orchestra.run.smithi063.stdout: 287450 4 -rw-r--r-- 1 ubuntu ubuntu 954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-list/nfs-list.component.html 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287451 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-list/nfs-list.component.scss 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287452 8 -rw-r--r-- 1 ubuntu ubuntu 6608 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/ceph/nfs/nfs-list/nfs-list.component.spec.ts 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287686 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287751 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287757 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/login-layout 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287758 4 -rw-r--r-- 1 ubuntu ubuntu 1095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/login-layout/login-layout.component.html 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287759 4 -rw-r--r-- 1 ubuntu ubuntu 1073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/login-layout/login-layout.component.scss 2024-03-27T21:32:58.593 INFO:teuthology.orchestra.run.smithi063.stdout: 287761 4 -rw-r--r-- 1 ubuntu ubuntu 414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/login-layout/login-layout.component.ts 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287760 4 -rw-r--r-- 1 ubuntu ubuntu 1013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/login-layout/login-layout.component.spec.ts 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287762 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/workbench-layout 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287763 4 -rw-r--r-- 1 ubuntu ubuntu 409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/workbench-layout/workbench-layout.component.html 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287766 4 -rw-r--r-- 1 ubuntu ubuntu 1350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/workbench-layout/workbench-layout.component.ts 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287765 4 -rw-r--r-- 1 ubuntu ubuntu 1351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/workbench-layout/workbench-layout.component.spec.ts 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287764 4 -rw-r--r-- 1 ubuntu ubuntu 243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/workbench-layout/workbench-layout.component.scss 2024-03-27T21:32:58.594 INFO:teuthology.orchestra.run.smithi063.stdout: 287752 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/blank-layout 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287755 4 -rw-r--r-- 1 ubuntu ubuntu 740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/blank-layout/blank-layout.component.spec.ts 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287753 4 -rw-r--r-- 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/blank-layout/blank-layout.component.html 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287754 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/blank-layout/blank-layout.component.scss 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287756 4 -rw-r--r-- 1 ubuntu ubuntu 223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/layouts/blank-layout/blank-layout.component.ts 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287744 4 -rw-r--r-- 1 ubuntu ubuntu 1140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/core.module.ts 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287745 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/error 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287749 4 -rw-r--r-- 1 ubuntu ubuntu 3252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/error/error.component.ts 2024-03-27T21:32:58.595 INFO:teuthology.orchestra.run.smithi063.stdout: 287748 4 -rw-r--r-- 1 ubuntu ubuntu 1929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/error/error.component.spec.ts 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287747 4 -rw-r--r-- 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/error/error.component.scss 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287750 4 -rw-r--r-- 1 ubuntu ubuntu 893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/error/error.ts 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287746 4 -rw-r--r-- 1 ubuntu ubuntu 2149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/error/error.component.html 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287687 4 drwxr-xr-x 11 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287711 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-list 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287713 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-list/role-list.component.scss 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287714 4 -rw-r--r-- 1 ubuntu ubuntu 3065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-list/role-list.component.spec.ts 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287712 4 -rw-r--r-- 1 ubuntu ubuntu 701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-list/role-list.component.html 2024-03-27T21:32:58.596 INFO:teuthology.orchestra.run.smithi063.stdout: 287715 8 -rw-r--r-- 1 ubuntu ubuntu 5720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-list/role-list.component.ts 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287704 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287710 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form/role-form.model.ts 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287708 8 -rw-r--r-- 1 ubuntu ubuntu 5351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form/role-form.component.spec.ts 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287706 4 -rw-r--r-- 1 ubuntu ubuntu 2798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form/role-form.component.html 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287705 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form/role-form-mode.enum.ts 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287707 4 -rw-r--r-- 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form/role-form.component.scss 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287709 8 -rw-r--r-- 1 ubuntu ubuntu 5308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-form/role-form.component.ts 2024-03-27T21:32:58.597 INFO:teuthology.orchestra.run.smithi063.stdout: 287734 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-tabs 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287735 4 -rw-r--r-- 1 ubuntu ubuntu 510 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-tabs/user-tabs.component.html 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287737 4 -rw-r--r-- 1 ubuntu ubuntu 961 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-tabs/user-tabs.component.spec.ts 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287738 4 -rw-r--r-- 1 ubuntu ubuntu 310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-tabs/user-tabs.component.ts 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287736 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-tabs/user-tabs.component.scss 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287688 4 -rw-r--r-- 1 ubuntu ubuntu 2681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/auth.module.ts 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287724 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-list 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287727 4 -rw-r--r-- 1 ubuntu ubuntu 3610 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-list/user-list.component.spec.ts 2024-03-27T21:32:58.598 INFO:teuthology.orchestra.run.smithi063.stdout: 287725 4 -rwxr-xr-x 1 ubuntu ubuntu 1707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-list/user-list.component.html 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287726 4 -rwxr-xr-x 1 ubuntu ubuntu 297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-list/user-list.component.scss 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287728 8 -rwxr-xr-x 1 ubuntu ubuntu 7360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-list/user-list.component.ts 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287699 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-details 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287702 4 -rw-r--r-- 1 ubuntu ubuntu 2304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-details/role-details.component.spec.ts 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287700 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-details/role-details.component.html 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287701 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-details/role-details.component.scss 2024-03-27T21:32:58.599 INFO:teuthology.orchestra.run.smithi063.stdout: 287703 4 -rw-r--r-- 1 ubuntu ubuntu 2175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/role-details/role-details.component.ts 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287694 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287698 4 -rw-r--r-- 1 ubuntu ubuntu 2570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login/login.component.ts 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287697 4 -rw-r--r-- 1 ubuntu ubuntu 2013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login/login.component.spec.ts 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287695 4 -rw-r--r-- 1 ubuntu ubuntu 2195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login/login.component.html 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287696 4 -rw-r--r-- 1 ubuntu ubuntu 1092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login/login.component.scss 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287689 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login-password-form 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287693 4 -rwxr-xr-x 1 ubuntu ubuntu 1840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login-password-form/login-password-form.component.ts 2024-03-27T21:32:58.600 INFO:teuthology.orchestra.run.smithi063.stdout: 287692 4 -rwxr-xr-x 1 ubuntu ubuntu 2755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login-password-form/login-password-form.component.spec.ts 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287690 4 -rwxr-xr-x 1 ubuntu ubuntu 3523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login-password-form/login-password-form.component.html 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287691 4 -rwxr-xr-x 1 ubuntu ubuntu 1367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/login-password-form/login-password-form.component.scss 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287729 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-password-form 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287732 4 -rw-r--r-- 1 ubuntu ubuntu 3004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-password-form/user-password-form.component.spec.ts 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287731 4 -rw-r--r-- 1 ubuntu ubuntu 128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-password-form/user-password-form.component.scss 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287730 8 -rw-r--r-- 1 ubuntu ubuntu 4719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-password-form/user-password-form.component.html 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287733 4 -rw-r--r-- 1 ubuntu ubuntu 3999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-password-form/user-password-form.component.ts 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287716 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form 2024-03-27T21:32:58.601 INFO:teuthology.orchestra.run.smithi063.stdout: 287723 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form.model.ts 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287717 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form-mode.enum.ts 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287718 4 -rw-r--r-- 1 ubuntu ubuntu 364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form-role.model.ts 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287722 12 -rw-r--r-- 1 ubuntu ubuntu 10530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form.component.ts 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287720 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form.component.scss 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287719 12 -rw-r--r-- 1 ubuntu ubuntu 10282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form.component.html 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287721 12 -rw-r--r-- 1 ubuntu ubuntu 8831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/auth/user-form/user-form.component.spec.ts 2024-03-27T21:32:58.602 INFO:teuthology.orchestra.run.smithi063.stdout: 287767 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287778 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/api-docs 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287781 4 -rw-r--r-- 1 ubuntu ubuntu 434 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/api-docs/api-docs.component.ts 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287779 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/api-docs/api-docs.component.html 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287780 4 -rw-r--r-- 1 ubuntu ubuntu 148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/api-docs/api-docs.component.scss 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287792 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/identity 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287794 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/identity/identity.component.scss 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287793 4 -rw-r--r-- 1 ubuntu ubuntu 780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/identity/identity.component.html 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287795 4 -rw-r--r-- 1 ubuntu ubuntu 886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/identity/identity.component.spec.ts 2024-03-27T21:32:58.603 INFO:teuthology.orchestra.run.smithi063.stdout: 287796 4 -rw-r--r-- 1 ubuntu ubuntu 761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/identity/identity.component.ts 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287787 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/dashboard-help 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287788 4 -rw-r--r-- 1 ubuntu ubuntu 824 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/dashboard-help/dashboard-help.component.html 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287791 4 -rw-r--r-- 1 ubuntu ubuntu 1164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/dashboard-help/dashboard-help.component.ts 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287789 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/dashboard-help/dashboard-help.component.scss 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287790 4 -rw-r--r-- 1 ubuntu ubuntu 922 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/dashboard-help/dashboard-help.component.spec.ts 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287773 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/administration 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287774 4 -rw-r--r-- 1 ubuntu ubuntu 670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/administration/administration.component.html 2024-03-27T21:32:58.604 INFO:teuthology.orchestra.run.smithi063.stdout: 287777 4 -rw-r--r-- 1 ubuntu ubuntu 746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/administration/administration.component.ts 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287776 4 -rw-r--r-- 1 ubuntu ubuntu 747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/administration/administration.component.spec.ts 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287775 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/administration/administration.component.scss 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287782 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/breadcrumbs 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287783 4 -rw-r--r-- 1 ubuntu ubuntu 388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/breadcrumbs/breadcrumbs.component.html 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287785 8 -rw-r--r-- 1 ubuntu ubuntu 5348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/breadcrumbs/breadcrumbs.component.spec.ts 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287786 8 -rw-r--r-- 1 ubuntu ubuntu 5134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/breadcrumbs/breadcrumbs.component.ts 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287784 4 -rw-r--r-- 1 ubuntu ubuntu 215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/breadcrumbs/breadcrumbs.component.scss 2024-03-27T21:32:58.605 INFO:teuthology.orchestra.run.smithi063.stdout: 287797 4 -rw-r--r-- 1 ubuntu ubuntu 1554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation.module.ts 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287768 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/about 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287772 4 -rw-r--r-- 1 ubuntu ubuntu 2427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/about/about.component.ts 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287769 4 -rw-r--r-- 1 ubuntu ubuntu 1246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/about/about.component.html 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287770 4 -rw-r--r-- 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/about/about.component.scss 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287771 4 -rw-r--r-- 1 ubuntu ubuntu 1968 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/about/about.component.spec.ts 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287803 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/notifications 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287807 4 -rw-r--r-- 1 ubuntu ubuntu 1304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/notifications/notifications.component.ts 2024-03-27T21:32:58.606 INFO:teuthology.orchestra.run.smithi063.stdout: 287805 4 -rw-r--r-- 1 ubuntu ubuntu 425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/notifications/notifications.component.scss 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287806 4 -rw-r--r-- 1 ubuntu ubuntu 2310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/notifications/notifications.component.spec.ts 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287804 4 -rw-r--r-- 1 ubuntu ubuntu 299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/notifications/notifications.component.html 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287798 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287799 16 -rw-r--r-- 1 ubuntu ubuntu 16199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.html 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287801 12 -rw-r--r-- 1 ubuntu ubuntu 9997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.spec.ts 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287800 8 -rw-r--r-- 1 ubuntu ubuntu 5886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.scss 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287802 8 -rw-r--r-- 1 ubuntu ubuntu 8031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/navigation/navigation/navigation.component.ts 2024-03-27T21:32:58.607 INFO:teuthology.orchestra.run.smithi063.stdout: 287739 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/context 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 287741 4 -rw-r--r-- 1 ubuntu ubuntu 106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/context/context.component.scss 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 287742 4 -rw-r--r-- 1 ubuntu ubuntu 3741 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/context/context.component.spec.ts 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 287740 4 -rw-r--r-- 1 ubuntu ubuntu 1211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/context/context.component.html 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 287743 4 -rw-r--r-- 1 ubuntu ubuntu 2785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/core/context/context.component.ts 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 286855 4 -rw-r--r-- 1 ubuntu ubuntu 1511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/app.module.ts 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 286854 4 -rw-r--r-- 1 ubuntu ubuntu 516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/app.component.ts 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 286853 4 -rw-r--r-- 1 ubuntu ubuntu 681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/app/app.component.spec.ts 2024-03-27T21:32:58.608 INFO:teuthology.orchestra.run.smithi063.stdout: 288464 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288471 4 -rw-r--r-- 1 ubuntu ubuntu 1811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/logo-mini.png 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288466 12 -rw-r--r-- 1 ubuntu ubuntu 9901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/Ceph_Ceph_Logo_with_text_red_white.svg 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288472 4 -rw-r--r-- 1 ubuntu ubuntu 2777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/prometheus_logo.svg 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288469 96 -rw-r--r-- 1 ubuntu ubuntu 98115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/ceph_background.gif 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288468 8 -rw-r--r-- 1 ubuntu ubuntu 6130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/Ceph_Logo.svg 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288470 36 -rwxr-xr-x 1 ubuntu ubuntu 35386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/loading.gif 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288467 12 -rw-r--r-- 1 ubuntu ubuntu 9897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/Ceph_Ceph_Logo_with_text_white.svg 2024-03-27T21:32:58.609 INFO:teuthology.orchestra.run.smithi063.stdout: 288465 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/src/assets/.gitkeep 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 286712 4 -rw-r--r-- 1 ubuntu ubuntu 245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.editorconfig 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 288522 4 -rw-r--r-- 1 ubuntu ubuntu 1004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/tsconfig.json 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 286723 4 -rw-r--r-- 1 ubuntu ubuntu 625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/applitools.config.js 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 286842 4 -rw-r--r-- 1 ubuntu ubuntu 357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/i18n.config.json 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 286846 8 -rw-r--r-- 1 ubuntu ubuntu 5569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/package.json 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 286714 4 -rw-r--r-- 1 ubuntu ubuntu 1014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.gherkin-lintrc 2024-03-27T21:32:58.610 INFO:teuthology.orchestra.run.smithi063.stdout: 286713 4 -rw-r--r-- 1 ubuntu ubuntu 1960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.eslintrc.json 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 288523 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/tsconfig.spec.json 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 286717 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.npmrc 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 286722 8 -rw-r--r-- 1 ubuntu ubuntu 7779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/angular.json 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 286847 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/proxy.conf.json.sample 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 286715 4 -rw-r--r-- 1 ubuntu ubuntu 612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.gitignore 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 286726 4 -rw-r--r-- 1 ubuntu ubuntu 1346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress.config.ts 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 286711 4 -rw-r--r-- 1 ubuntu ubuntu 405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.browserslistrc 2024-03-27T21:32:58.611 INFO:teuthology.orchestra.run.smithi063.stdout: 288521 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/tsconfig.app.json 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286718 4 -rw-r--r-- 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.prettierignore 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286841 4 -rw-r--r-- 1 ubuntu ubuntu 189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/html-linter.config.json 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286716 4 -rw-r--r-- 1 ubuntu ubuntu 1830 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/.htmllintrc 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286843 4 -rw-r--r-- 1 ubuntu ubuntu 1140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/jest.config.cjs 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286727 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/plugins 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286835 4 -rw-r--r-- 1 ubuntu ubuntu 729 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/plugins/index.js 2024-03-27T21:32:58.612 INFO:teuthology.orchestra.run.smithi063.stdout: 286827 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286828 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures/block-rbd-status.json 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286833 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures/rgw-status.json 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286830 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures/orchestrator 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286831 12 -rw-r--r-- 1 ubuntu ubuntu 11385 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures/orchestrator/inventory.json 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286832 24 -rw-r--r-- 1 ubuntu ubuntu 24214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures/orchestrator/services.json 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286829 4 -rw-r--r-- 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/fixtures/nfs-ganesha-status.json 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286836 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/support 2024-03-27T21:32:58.613 INFO:teuthology.orchestra.run.smithi063.stdout: 286839 4 -rw-r--r-- 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/support/eyes-index.d.ts 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286838 4 -rw-r--r-- 1 ubuntu ubuntu 436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/support/e2e.ts 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286837 8 -rw-r--r-- 1 ubuntu ubuntu 4533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/support/commands.ts 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286840 4 -rw-r--r-- 1 ubuntu ubuntu 276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/tsconfig.json 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286728 4 drwxr-xr-x 12 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286792 12 -rw-r--r-- 1 ubuntu ubuntu 8772 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/page-helper.po.ts 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286824 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/visualTests 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286825 4 -rw-r--r-- 1 ubuntu ubuntu 662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/visualTests/dashboard.vrt-spec.ts 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286826 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/visualTests/login.vrt-spec.ts 2024-03-27T21:32:58.614 INFO:teuthology.orchestra.run.smithi063.stdout: 286732 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286734 4 -rw-r--r-- 1 ubuntu ubuntu 3746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block/images.po.ts 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286733 4 -rw-r--r-- 1 ubuntu ubuntu 2604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block/images.e2e-spec.ts 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286736 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block/iscsi.po.ts 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286738 4 -rw-r--r-- 1 ubuntu ubuntu 2087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block/mirroring.po.ts 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286737 8 -rw-r--r-- 1 ubuntu ubuntu 4180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block/mirroring.e2e-spec.ts 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286735 4 -rw-r--r-- 1 ubuntu ubuntu 687 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/block/iscsi.e2e-spec.ts 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286796 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw 2024-03-27T21:32:58.615 INFO:teuthology.orchestra.run.smithi063.stdout: 286804 8 -rw-r--r-- 1 ubuntu ubuntu 5270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/users.po.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286799 4 -rw-r--r-- 1 ubuntu ubuntu 933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/daemons.e2e-spec.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286801 4 -rw-r--r-- 1 ubuntu ubuntu 638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/roles.e2e-spec.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286802 4 -rw-r--r-- 1 ubuntu ubuntu 1773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/roles.po.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286798 8 -rw-r--r-- 1 ubuntu ubuntu 6908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/buckets.po.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286797 4 -rw-r--r-- 1 ubuntu ubuntu 2055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/buckets.e2e-spec.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286800 4 -rw-r--r-- 1 ubuntu ubuntu 1047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/daemons.po.ts 2024-03-27T21:32:58.616 INFO:teuthology.orchestra.run.smithi063.stdout: 286803 4 -rw-r--r-- 1 ubuntu ubuntu 1310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/rgw/users.e2e-spec.ts 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286767 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/filesystems 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286771 4 -rw-r--r-- 1 ubuntu ubuntu 2160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/filesystems/subvolumes.e2e-spec.feature 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286769 4 -rw-r--r-- 1 ubuntu ubuntu 2148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/filesystems/snapshots.e2e-spec.feature 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286770 4 -rw-r--r-- 1 ubuntu ubuntu 2267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/filesystems/subvolume-groups.e2e-spec.feature 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286768 4 -rw-r--r-- 1 ubuntu ubuntu 1129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/filesystems/filesystems.e2e-spec.feature 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286729 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/a11y 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286731 4 -rw-r--r-- 1 ubuntu ubuntu 513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/a11y/navigation.e2e-spec.ts 2024-03-27T21:32:58.617 INFO:teuthology.orchestra.run.smithi063.stdout: 286730 4 -rw-r--r-- 1 ubuntu ubuntu 585 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/a11y/dashboard.e2e-spec.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286805 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286817 4 -rw-r--r-- 1 ubuntu ubuntu 3418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/navigation.po.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286808 4 -rw-r--r-- 1 ubuntu ubuntu 1716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/dashboard-v3.e2e-spec.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286815 4 -rw-r--r-- 1 ubuntu ubuntu 610 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/login.po.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286822 4 -rw-r--r-- 1 ubuntu ubuntu 991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/user-mgmt.e2e-spec.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286813 4 -rw-r--r-- 1 ubuntu ubuntu 331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/language.po.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286806 4 -rw-r--r-- 1 ubuntu ubuntu 355 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/api-docs.e2e-spec.ts 2024-03-27T21:32:58.618 INFO:teuthology.orchestra.run.smithi063.stdout: 286818 4 -rw-r--r-- 1 ubuntu ubuntu 1586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/notification.e2e-spec.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286819 4 -rw-r--r-- 1 ubuntu ubuntu 1127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/notification.po.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286812 4 -rw-r--r-- 1 ubuntu ubuntu 515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/language.e2e-spec.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286816 4 -rw-r--r-- 1 ubuntu ubuntu 599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/navigation.e2e-spec.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286811 4 -rw-r--r-- 1 ubuntu ubuntu 902 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/dashboard.po.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286823 4 -rw-r--r-- 1 ubuntu ubuntu 1335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/user-mgmt.po.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286821 4 -rw-r--r-- 1 ubuntu ubuntu 1254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/role-mgmt.po.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286809 4 -rw-r--r-- 1 ubuntu ubuntu 523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/dashboard-v3.po.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286820 4 -rw-r--r-- 1 ubuntu ubuntu 963 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/role-mgmt.e2e-spec.ts 2024-03-27T21:32:58.619 INFO:teuthology.orchestra.run.smithi063.stdout: 286807 4 -rw-r--r-- 1 ubuntu ubuntu 166 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/api-docs.po.ts 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286814 4 -rw-r--r-- 1 ubuntu ubuntu 490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/login.e2e-spec.ts 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286810 8 -rw-r--r-- 1 ubuntu ubuntu 4959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/ui/dashboard.e2e-spec.ts 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286772 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286777 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/grafana 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286778 4 -rw-r--r-- 1 ubuntu ubuntu 2594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/grafana/grafana.feature 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286775 4 -rw-r--r-- 1 ubuntu ubuntu 2011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/04-osds.e2e-spec.ts 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286773 4 -rw-r--r-- 1 ubuntu ubuntu 1823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/01-hosts.e2e-spec.ts 2024-03-27T21:32:58.620 INFO:teuthology.orchestra.run.smithi063.stdout: 286776 4 -rw-r--r-- 1 ubuntu ubuntu 910 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/05-services.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286779 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286789 4 -rw-r--r-- 1 ubuntu ubuntu 2656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/10-nfs-exports.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286783 4 -rw-r--r-- 1 ubuntu ubuntu 1336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/04-create-cluster-create-osds.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286782 4 -rw-r--r-- 1 ubuntu ubuntu 1450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/03-create-cluster-create-services.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286781 4 -rw-r--r-- 1 ubuntu ubuntu 2851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/02-create-cluster-add-host.feature 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286784 4 -rw-r--r-- 1 ubuntu ubuntu 2191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/05-create-cluster-review.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286785 4 -rw-r--r-- 1 ubuntu ubuntu 2740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/06-cluster-check.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286788 8 -rw-r--r-- 1 ubuntu ubuntu 4296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/09-services.e2e-spec.ts 2024-03-27T21:32:58.621 INFO:teuthology.orchestra.run.smithi063.stdout: 286787 4 -rw-r--r-- 1 ubuntu ubuntu 1418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/08-hosts.e2e-spec.ts 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286780 4 -rw-r--r-- 1 ubuntu ubuntu 956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/01-create-cluster-welcome.feature 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286786 4 -rw-r--r-- 1 ubuntu ubuntu 628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/07-osds.e2e-spec.ts 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286790 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/nfs 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286791 4 -rw-r--r-- 1 ubuntu ubuntu 1655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/workflow/nfs/nfs-export.po.ts 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286774 4 -rw-r--r-- 1 ubuntu ubuntu 730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/orchestrator/03-inventory.e2e-spec.ts 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286793 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/pools 2024-03-27T21:32:58.622 INFO:teuthology.orchestra.run.smithi063.stdout: 286795 4 -rw-r--r-- 1 ubuntu ubuntu 2095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/pools/pools.po.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286794 4 -rw-r--r-- 1 ubuntu ubuntu 1413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/pools/pools.e2e-spec.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286739 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286748 4 -rw-r--r-- 1 ubuntu ubuntu 1664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/logs.e2e-spec.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286758 4 -rw-r--r-- 1 ubuntu ubuntu 1829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/users.po.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286743 4 -rw-r--r-- 1 ubuntu ubuntu 959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/crush-map.e2e-spec.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286744 4 -rw-r--r-- 1 ubuntu ubuntu 331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/crush-map.po.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286751 4 -rw-r--r-- 1 ubuntu ubuntu 1544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/mgr-modules.po.ts 2024-03-27T21:32:58.623 INFO:teuthology.orchestra.run.smithi063.stdout: 286756 8 -rw-r--r-- 1 ubuntu ubuntu 6410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/services.po.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286741 4 -rw-r--r-- 1 ubuntu ubuntu 2639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/configuration.po.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286754 4 -rw-r--r-- 1 ubuntu ubuntu 1587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/osds.e2e-spec.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286740 4 -rw-r--r-- 1 ubuntu ubuntu 2372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/configuration.e2e-spec.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286742 4 -rw-r--r-- 1 ubuntu ubuntu 1512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/create-cluster.po.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286755 4 -rw-r--r-- 1 ubuntu ubuntu 2614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/osds.po.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286745 4 -rw-r--r-- 1 ubuntu ubuntu 837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/hosts.e2e-spec.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286750 4 -rw-r--r-- 1 ubuntu ubuntu 1889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/mgr-modules.e2e-spec.ts 2024-03-27T21:32:58.624 INFO:teuthology.orchestra.run.smithi063.stdout: 286749 4 -rw-r--r-- 1 ubuntu ubuntu 2186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/logs.po.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286747 4 -rw-r--r-- 1 ubuntu ubuntu 636 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/inventory.po.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286746 8 -rw-r--r-- 1 ubuntu ubuntu 6100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/hosts.po.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286757 4 -rw-r--r-- 1 ubuntu ubuntu 1172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/users.e2e-spec.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286752 4 -rw-r--r-- 1 ubuntu ubuntu 1921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/monitors.e2e-spec.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286753 4 -rw-r--r-- 1 ubuntu ubuntu 171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/cluster/monitors.po.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286759 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286762 4 -rw-r--r-- 1 ubuntu ubuntu 2385 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/forms-helper.feature.po.ts 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286760 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/create-cluster 2024-03-27T21:32:58.625 INFO:teuthology.orchestra.run.smithi063.stdout: 286761 4 -rw-r--r-- 1 ubuntu ubuntu 447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/create-cluster/create-cluster.feature.po.ts 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 286765 8 -rw-r--r-- 1 ubuntu ubuntu 5306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/table-helper.feature.po.ts 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 286766 4 -rw-r--r-- 1 ubuntu ubuntu 1408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/urls.po.ts 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 286763 4 -rw-r--r-- 1 ubuntu ubuntu 1073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/global.feature.po.ts 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 286764 4 -rw-r--r-- 1 ubuntu ubuntu 2391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/e2e/common/grafana.feature.po.ts 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 288622 4 -rw-r--r-- 1 ubuntu ubuntu 3969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/tox.ini 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 288546 8 -rwxr-xr-x 1 ubuntu ubuntu 5466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/run-backend-api-tests.sh 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 288542 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/requirements-test.txt 2024-03-27T21:32:58.626 INFO:teuthology.orchestra.run.smithi063.stdout: 286634 4 -rw-r--r-- 1 ubuntu ubuntu 654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/.editorconfig 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 286639 4 -rw-r--r-- 1 ubuntu ubuntu 1403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/README.rst 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 288543 4 -rw-r--r-- 1 ubuntu ubuntu 181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/requirements.txt 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 286654 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 286684 8 -rw-r--r-- 1 ubuntu ubuntu 5379 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/home.py 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 286663 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_paginate.py 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 286707 12 -rw-r--r-- 1 ubuntu ubuntu 8363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/telemetry.py 2024-03-27T21:32:58.627 INFO:teuthology.orchestra.run.smithi063.stdout: 286657 4 -rw-r--r-- 1 ubuntu ubuntu 658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_auth.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286674 8 -rw-r--r-- 1 ubuntu ubuntu 5085 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/cluster_configuration.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286681 4 -rw-r--r-- 1 ubuntu ubuntu 1636 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/grafana.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286664 4 -rw-r--r-- 1 ubuntu ubuntu 1618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_permissions.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286708 12 -rw-r--r-- 1 ubuntu ubuntu 8616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/user.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286698 20 -rw-r--r-- 1 ubuntu ubuntu 18812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/rbd.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286665 12 -rw-r--r-- 1 ubuntu ubuntu 10522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_rest_controller.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286685 20 -rw-r--r-- 1 ubuntu ubuntu 19736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/host.py 2024-03-27T21:32:58.628 INFO:teuthology.orchestra.run.smithi063.stdout: 286704 8 -rw-r--r-- 1 ubuntu ubuntu 4271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/settings.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286668 4 -rw-r--r-- 1 ubuntu ubuntu 384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_ui_router.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286696 16 -rw-r--r-- 1 ubuntu ubuntu 14350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/pool.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286702 8 -rw-r--r-- 1 ubuntu ubuntu 4462 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/saml2.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286688 8 -rw-r--r-- 1 ubuntu ubuntu 7733 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/mgr_modules.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286675 4 -rw-r--r-- 1 ubuntu ubuntu 2213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/crush_rule.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286669 4 -rw-r--r-- 1 ubuntu ubuntu 2038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_version.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286686 56 -rw-r--r-- 1 ubuntu ubuntu 55574 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/iscsi.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286659 20 -rw-r--r-- 1 ubuntu ubuntu 17507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_crud.py 2024-03-27T21:32:58.629 INFO:teuthology.orchestra.run.smithi063.stdout: 286690 16 -rw-r--r-- 1 ubuntu ubuntu 13039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/multi_cluster.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286693 4 -rw-r--r-- 1 ubuntu ubuntu 1906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/orchestrator.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286677 20 -rw-r--r-- 1 ubuntu ubuntu 16781 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/docs.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286705 8 -rw-r--r-- 1 ubuntu ubuntu 4446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/summary.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286697 8 -rw-r--r-- 1 ubuntu ubuntu 7691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/prometheus.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286658 12 -rw-r--r-- 1 ubuntu ubuntu 10918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_base_controller.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286695 4 -rw-r--r-- 1 ubuntu ubuntu 2362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/perf_counters.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286700 48 -rw-r--r-- 1 ubuntu ubuntu 45179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/rgw.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286673 4 -rw-r--r-- 1 ubuntu ubuntu 3916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/cluster.py 2024-03-27T21:32:58.630 INFO:teuthology.orchestra.run.smithi063.stdout: 286691 12 -rw-r--r-- 1 ubuntu ubuntu 10503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/nfs.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286679 8 -rw-r--r-- 1 ubuntu ubuntu 4560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/feedback.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286692 16 -rw-r--r-- 1 ubuntu ubuntu 14483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/nvmeof.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286655 4 -rwxr-xr-x 1 ubuntu ubuntu 1170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/__init__.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286683 12 -rw-r--r-- 1 ubuntu ubuntu 9694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/health.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286706 4 -rw-r--r-- 1 ubuntu ubuntu 1372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/task.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286666 4 -rw-r--r-- 1 ubuntu ubuntu 2158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_router.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286678 4 -rw-r--r-- 1 ubuntu ubuntu 2324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/erasure_code_profile.py 2024-03-27T21:32:58.631 INFO:teuthology.orchestra.run.smithi063.stdout: 286699 24 -rw-r--r-- 1 ubuntu ubuntu 23832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/rbd_mirroring.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286676 4 -rw-r--r-- 1 ubuntu ubuntu 1995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/daemon.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286682 4 -rw-r--r-- 1 ubuntu ubuntu 852 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/hardware.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286689 4 -rw-r--r-- 1 ubuntu ubuntu 4011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/monitor.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286661 4 -rw-r--r-- 1 ubuntu ubuntu 2736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_endpoint.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286694 28 -rw-r--r-- 1 ubuntu ubuntu 24994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/osd.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286662 4 -rw-r--r-- 1 ubuntu ubuntu 3990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_helpers.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286680 4 -rw-r--r-- 1 ubuntu ubuntu 352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/frontend_logging.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286672 48 -rw-r--r-- 1 ubuntu ubuntu 47353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/cephfs.py 2024-03-27T21:32:58.632 INFO:teuthology.orchestra.run.smithi063.stdout: 286701 8 -rw-r--r-- 1 ubuntu ubuntu 5530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/role.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286687 4 -rw-r--r-- 1 ubuntu ubuntu 2117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/logs.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286660 8 -rw-r--r-- 1 ubuntu ubuntu 5748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_docs.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286667 4 -rw-r--r-- 1 ubuntu ubuntu 3121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_task.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286656 4 -rw-r--r-- 1 ubuntu ubuntu 381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/_api_router.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286671 12 -rw-r--r-- 1 ubuntu ubuntu 8193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/ceph_users.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286670 8 -rw-r--r-- 1 ubuntu ubuntu 7153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/auth.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 286703 4 -rw-r--r-- 1 ubuntu ubuntu 3866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/controllers/service.py 2024-03-27T21:32:58.633 INFO:teuthology.orchestra.run.smithi063.stdout: 288547 4 -rwxr-xr-x 1 ubuntu ubuntu 1350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/run-backend-rook-api-request.sh 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286633 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/.coveragerc 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286645 12 -rw-r--r-- 1 ubuntu ubuntu 8332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/cherrypy_backports.py 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286636 20 -rw-r--r-- 1 ubuntu ubuntu 16523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/.pylintrc 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286646 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286652 8 -rw-r--r-- 1 ubuntu ubuntu 6136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci/check_grafana_dashboards.py 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286647 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci/cephadm 2024-03-27T21:32:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: 286648 4 -rwxr-xr-x 1 ubuntu ubuntu 1396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci/cephadm/bootstrap-cluster.sh 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 286651 4 -rwxr-xr-x 1 ubuntu ubuntu 2983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci/cephadm/start-cluster.sh 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 286649 4 -rwxr-xr-x 1 ubuntu ubuntu 937 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci/cephadm/ceph_cluster.yml 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 286650 4 -rwxr-xr-x 1 ubuntu ubuntu 2417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/ci/cephadm/run-cephadm-e2e-tests.sh 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 286640 4 -rw-r--r-- 1 ubuntu ubuntu 1814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/__init__.py 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 288529 464 -rw-r--r-- 1 ubuntu ubuntu 472896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/openapi.yaml 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 288551 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 288553 4 -rw-r--r-- 1 ubuntu ubuntu 2314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/_paginate.py 2024-03-27T21:32:58.635 INFO:teuthology.orchestra.run.smithi063.stdout: 288577 12 -rw-r--r-- 1 ubuntu ubuntu 9765 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/sso.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288574 32 -rw-r--r-- 1 ubuntu ubuntu 30452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/rbd.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288561 4 -rw-r--r-- 1 ubuntu ubuntu 1895 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/iscsi_cli.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288565 8 -rw-r--r-- 1 ubuntu ubuntu 4485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/nvmeof_client.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288578 8 -rw-r--r-- 1 ubuntu ubuntu 4535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/tcmu_service.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288576 4 -rw-r--r-- 1 ubuntu ubuntu 782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/settings.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288562 12 -rw-r--r-- 1 ubuntu ubuntu 10116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/iscsi_client.py 2024-03-27T21:32:58.636 INFO:teuthology.orchestra.run.smithi063.stdout: 288556 24 -rw-r--r-- 1 ubuntu ubuntu 24337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/ceph_service.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288567 12 -rw-r--r-- 1 ubuntu ubuntu 9941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/orchestrator.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288575 84 -rw-r--r-- 1 ubuntu ubuntu 82452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/rgw_client.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288563 4 -rw-r--r-- 1 ubuntu ubuntu 3920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/iscsi_config.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288569 4 -rw-r--r-- 1 ubuntu ubuntu 3309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/progress.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288558 4 -rw-r--r-- 1 ubuntu ubuntu 2846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/cluster.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288552 4 -rw-r--r-- 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/__init__.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288560 4 -rw-r--r-- 1 ubuntu ubuntu 2819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/hardware.py 2024-03-27T21:32:58.637 INFO:teuthology.orchestra.run.smithi063.stdout: 288559 4 -rw-r--r-- 1 ubuntu ubuntu 4054 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/exception.py 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288566 4 -rw-r--r-- 1 ubuntu ubuntu 1760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/nvmeof_conf.py 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288568 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/osd.py 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288570 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/proto 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288573 40 -rw-r--r-- 1 ubuntu ubuntu 40598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/proto/gateway_pb2_grpc.py 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288572 180 -rw-r--r-- 1 ubuntu ubuntu 181772 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/proto/gateway_pb2.py 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288571 12 -rw-r--r-- 1 ubuntu ubuntu 10533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/proto/gateway.proto 2024-03-27T21:32:58.638 INFO:teuthology.orchestra.run.smithi063.stdout: 288557 12 -rw-r--r-- 1 ubuntu ubuntu 10442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/cephfs.py 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288554 36 -rw-r--r-- 1 ubuntu ubuntu 33237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/access_control.py 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288564 4 -rw-r--r-- 1 ubuntu ubuntu 1441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/nvmeof_cli.py 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288555 12 -rw-r--r-- 1 ubuntu ubuntu 9730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/services/auth.py 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 286638 4 -rw-r--r-- 1 ubuntu ubuntu 473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/HACKING.rst 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/model 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288527 4 -rw-r--r-- 1 ubuntu ubuntu 1845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/model/nvmeof.py 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288526 4 -rw-r--r-- 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/model/__init__.py 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 288548 4 -rwxr-xr-x 1 ubuntu ubuntu 3901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/run-frontend-e2e-tests.sh 2024-03-27T21:32:58.639 INFO:teuthology.orchestra.run.smithi063.stdout: 286635 4 -rw-r--r-- 1 ubuntu ubuntu 109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/.gitignore 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 288544 24 -rw-r--r-- 1 ubuntu ubuntu 21421 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/rest_client.py 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 286709 4 -rw-r--r-- 1 ubuntu ubuntu 3670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/exceptions.py 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 286641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/api 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 286643 4 -rw-r--r-- 1 ubuntu ubuntu 1426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/api/doc.py 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 286642 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/api/__init__.py 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 288545 4 -rwxr-xr-x 1 ubuntu ubuntu 700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/run-backend-api-request.sh 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 288961 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/zabbix 2024-03-27T21:32:58.640 INFO:teuthology.orchestra.run.smithi063.stdout: 288963 20 -rw-r--r-- 1 ubuntu ubuntu 17629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/zabbix/module.py 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 288964 140 -rw-r--r-- 1 ubuntu ubuntu 139526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/zabbix/zabbix_template.xml 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 288962 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/zabbix/__init__.py 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 286532 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/balancer 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 286534 72 -rw-r--r-- 1 ubuntu ubuntu 71316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/balancer/module.py 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 286533 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/balancer/__init__.py 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 288723 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/influx 2024-03-27T21:32:58.641 INFO:teuthology.orchestra.run.smithi063.stdout: 288725 20 -rw-r--r-- 1 ubuntu ubuntu 18317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/influx/module.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 288724 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/influx/__init__.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 286529 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/alerts 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 286531 12 -rw-r--r-- 1 ubuntu ubuntu 9169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/alerts/module.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 286530 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/alerts/__init__.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 288733 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/iostat 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 288735 4 -rw-r--r-- 1 ubuntu ubuntu 2145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/iostat/module.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 288734 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/iostat/__init__.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 288780 28 -rw-r--r-- 1 ubuntu ubuntu 24946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/object_format.py 2024-03-27T21:32:58.642 INFO:teuthology.orchestra.run.smithi063.stdout: 288720 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/hello 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288722 8 -rw-r--r-- 1 ubuntu ubuntu 4515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/hello/module.py 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288721 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/hello/__init__.py 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288840 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rgw 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288842 20 -rw-r--r-- 1 ubuntu ubuntu 18831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rgw/module.py 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288841 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rgw/__init__.py 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288811 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288815 16 -rw-r--r-- 1 ubuntu ubuntu 12491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/module.py 2024-03-27T21:32:58.643 INFO:teuthology.orchestra.run.smithi063.stdout: 288819 12 -rw-r--r-- 1 ubuntu ubuntu 10674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/trash_purge_schedule.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288817 24 -rw-r--r-- 1 ubuntu ubuntu 22757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/schedule.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288813 4 -rw-r--r-- 1 ubuntu ubuntu 1364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/common.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288816 24 -rw-r--r-- 1 ubuntu ubuntu 22015 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/perf.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288812 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/__init__.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288818 36 -rw-r--r-- 1 ubuntu ubuntu 33972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/task.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288814 24 -rw-r--r-- 1 ubuntu ubuntu 24341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rbd_support/mirror_snapshot_schedule.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288803 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/progress 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288805 32 -rw-r--r-- 1 ubuntu ubuntu 30853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/progress/module.py 2024-03-27T21:32:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 288806 8 -rw-r--r-- 1 ubuntu ubuntu 5364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/progress/test_progress.py 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288804 4 -rw-r--r-- 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/progress/__init__.py 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288795 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288797 36 -rw-r--r-- 1 ubuntu ubuntu 34807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/module.py 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288798 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/tests 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288802 20 -rw-r--r-- 1 ubuntu ubuntu 16543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/tests/test_overlapping_roots.py 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288801 4 -rw-r--r-- 1 ubuntu ubuntu 1123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/tests/test_cal_ratio.py 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288799 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/tests/__init__.py 2024-03-27T21:32:58.645 INFO:teuthology.orchestra.run.smithi063.stdout: 288800 20 -rw-r--r-- 1 ubuntu ubuntu 19491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/tests/test_cal_final_pg_target.py 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288796 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/pg_autoscaler/__init__.py 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/devicehealth 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288625 32 -rw-r--r-- 1 ubuntu ubuntu 29526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/devicehealth/module.py 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288624 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/devicehealth/__init__.py 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288924 4 -rw-r--r-- 1 ubuntu ubuntu 3564 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/tox.ini 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288736 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/k8sevents 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288739 56 -rw-r--r-- 1 ubuntu ubuntu 55816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/k8sevents/module.py 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288737 8 -rw-r--r-- 1 ubuntu ubuntu 4591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/k8sevents/README.md 2024-03-27T21:32:58.646 INFO:teuthology.orchestra.run.smithi063.stdout: 288740 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/k8sevents/rbac_sample.yaml 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288738 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/k8sevents/__init__.py 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288751 32 -rw-r--r-- 1 ubuntu ubuntu 31403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mgr_util.py 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288843 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288863 28 -rw-r--r-- 1 ubuntu ubuntu 26252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/module.py 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288867 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/tests 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288868 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/tests/__init__.py 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288871 8 -rw-r--r-- 1 ubuntu ubuntu 5298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/tests/test_rook.py 2024-03-27T21:32:58.647 INFO:teuthology.orchestra.run.smithi063.stdout: 288869 4 -rw-r--r-- 1 ubuntu ubuntu 247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/tests/fixtures.py 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288870 4 -rw-r--r-- 1 ubuntu ubuntu 3800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/tests/test_placement.py 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288845 4 -rw-r--r-- 1 ubuntu ubuntu 842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/CMakeLists.txt 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288866 56 -rw-r--r-- 1 ubuntu ubuntu 55862 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/rook_cluster.py 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288864 4 -rw-r--r-- 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/requirements.txt 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288847 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288855 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests 2024-03-27T21:32:58.648 INFO:teuthology.orchestra.run.smithi063.stdout: 288856 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests/features 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288857 4 -rw-r--r-- 1 ubuntu ubuntu 938 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests/features/cluster-prometheus-monitoring.feature 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288858 4 -rw-r--r-- 1 ubuntu ubuntu 2128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests/features/rook.feature 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288859 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests/features/steps 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288860 8 -rw-r--r-- 1 ubuntu ubuntu 6121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests/features/steps/implementation.py 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288861 4 -rw-r--r-- 1 ubuntu ubuntu 1460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/tests/features/steps/utils.py 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288849 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/cluster-specs 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288850 8 -rw-r--r-- 1 ubuntu ubuntu 5568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/cluster-specs/cluster-on-pvc-minikube.yaml 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288853 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/scripts 2024-03-27T21:32:58.649 INFO:teuthology.orchestra.run.smithi063.stdout: 288854 8 -rwxr-xr-x 1 ubuntu ubuntu 6904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/scripts/bootstrap-rook-cluster.sh 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288851 4 -rw-r--r-- 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/requirements.txt 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288852 4 -rwxr-xr-x 1 ubuntu ubuntu 344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/run-rook-e2e-tests.sh 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288848 4 -rw-r--r-- 1 ubuntu ubuntu 214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/ci/Dockerfile 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288846 4 -rw-r--r-- 1 ubuntu ubuntu 94 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/__init__.py 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288862 4 -rwxr-xr-x 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/generate_rook_ceph_client.sh 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288844 4 -rw-r--r-- 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/.gitignore 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288865 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/rook/rook-client-python 2024-03-27T21:32:58.650 INFO:teuthology.orchestra.run.smithi063.stdout: 288821 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/requirements.txt 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288626 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288712 16 -rw-r--r-- 1 ubuntu ubuntu 12787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/module.py 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288714 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/requirements.txt 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288628 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288706 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/redhat 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288709 4 -rw-r--r-- 1 ubuntu ubuntu 1865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/redhat/hgst_scaler.pkl 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288707 4 -rw-r--r-- 1 ubuntu ubuntu 1065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/redhat/config.json 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288711 4 -rw-r--r-- 1 ubuntu ubuntu 1481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/redhat/seagate_scaler.pkl 2024-03-27T21:32:58.651 INFO:teuthology.orchestra.run.smithi063.stdout: 288710 36196 -rw-r--r-- 1 ubuntu ubuntu 37062936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/redhat/seagate_predictor.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288708 2796 -rw-r--r-- 1 ubuntu ubuntu 2860606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/redhat/hgst_predictor.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288629 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288677 528 -rw-r--r-- 1 ubuntu ubuntu 572380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_229.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288674 336 -rw-r--r-- 1 ubuntu ubuntu 342124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_223.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288645 444 -rw-r--r-- 1 ubuntu ubuntu 452492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_125.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288673 308 -rw-r--r-- 1 ubuntu ubuntu 314800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_222.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288690 324 -rw-r--r-- 1 ubuntu ubuntu 328292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_57.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288650 192 -rw-r--r-- 1 ubuntu ubuntu 244892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_14.pkl 2024-03-27T21:32:58.652 INFO:teuthology.orchestra.run.smithi063.stdout: 288658 320 -rw-r--r-- 1 ubuntu ubuntu 323764 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_174.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288700 280 -rw-r--r-- 1 ubuntu ubuntu 284992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_79.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288641 272 -rw-r--r-- 1 ubuntu ubuntu 275692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_12.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288651 416 -rw-r--r-- 1 ubuntu ubuntu 422368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_141.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288639 308 -rw-r--r-- 1 ubuntu ubuntu 315192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_118.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288694 428 -rw-r--r-- 1 ubuntu ubuntu 483492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_62.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288643 244 -rw-r--r-- 1 ubuntu ubuntu 246792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_123.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288668 588 -rw-r--r-- 1 ubuntu ubuntu 617200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_210.pkl 2024-03-27T21:32:58.653 INFO:teuthology.orchestra.run.smithi063.stdout: 288701 220 -rw-r--r-- 1 ubuntu ubuntu 255292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_82.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288683 524 -rw-r--r-- 1 ubuntu ubuntu 534148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_243.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288695 484 -rw-r--r-- 1 ubuntu ubuntu 492592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_67.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288649 416 -rw-r--r-- 1 ubuntu ubuntu 488292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_138.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288670 352 -rw-r--r-- 1 ubuntu ubuntu 357568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_213.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288689 440 -rw-r--r-- 1 ubuntu ubuntu 448292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_50.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288647 484 -rw-r--r-- 1 ubuntu ubuntu 493192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_131.pkl 2024-03-27T21:32:58.654 INFO:teuthology.orchestra.run.smithi063.stdout: 288704 296 -rw-r--r-- 1 ubuntu ubuntu 302592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_93.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288679 272 -rw-r--r-- 1 ubuntu ubuntu 277972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_234.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288657 356 -rw-r--r-- 1 ubuntu ubuntu 363400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_169.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288680 192 -rw-r--r-- 1 ubuntu ubuntu 243736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_235.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288644 304 -rw-r--r-- 1 ubuntu ubuntu 310292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_124.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288705 268 -rw-r--r-- 1 ubuntu ubuntu 272392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_97.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288698 480 -rw-r--r-- 1 ubuntu ubuntu 489492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_72.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288681 372 -rw-r--r-- 1 ubuntu ubuntu 377872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_236.pkl 2024-03-27T21:32:58.655 INFO:teuthology.orchestra.run.smithi063.stdout: 288675 324 -rw-r--r-- 1 ubuntu ubuntu 329812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_225.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288672 360 -rw-r--r-- 1 ubuntu ubuntu 365128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_221.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288661 312 -rw-r--r-- 1 ubuntu ubuntu 317176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_185.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288671 336 -rw-r--r-- 1 ubuntu ubuntu 342232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_219.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288630 16 -rw-r--r-- 1 ubuntu ubuntu 14068 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/config.json 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288703 492 -rw-r--r-- 1 ubuntu ubuntu 502392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_88.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288663 480 -rw-r--r-- 1 ubuntu ubuntu 489544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_195.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288634 168 -rw-r--r-- 1 ubuntu ubuntu 217192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_105.pkl 2024-03-27T21:32:58.656 INFO:teuthology.orchestra.run.smithi063.stdout: 288654 304 -rw-r--r-- 1 ubuntu ubuntu 308192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_16.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288702 512 -rw-r--r-- 1 ubuntu ubuntu 522092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_85.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288659 308 -rw-r--r-- 1 ubuntu ubuntu 312692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_18.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288662 272 -rw-r--r-- 1 ubuntu ubuntu 276352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_186.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288667 280 -rw-r--r-- 1 ubuntu ubuntu 283588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_208.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288693 488 -rw-r--r-- 1 ubuntu ubuntu 499492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_61.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288656 296 -rw-r--r-- 1 ubuntu ubuntu 301516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_168.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288684 496 -rw-r--r-- 1 ubuntu ubuntu 504592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_27.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288631 276 -rw-r--r-- 1 ubuntu ubuntu 281292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_1.pkl 2024-03-27T21:32:58.657 INFO:teuthology.orchestra.run.smithi063.stdout: 288691 484 -rw-r--r-- 1 ubuntu ubuntu 494292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_59.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288640 444 -rw-r--r-- 1 ubuntu ubuntu 485992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_119.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288653 268 -rw-r--r-- 1 ubuntu ubuntu 305944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_151.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288637 272 -rw-r--r-- 1 ubuntu ubuntu 276492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_114.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288646 492 -rw-r--r-- 1 ubuntu ubuntu 550492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_128.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288652 352 -rw-r--r-- 1 ubuntu ubuntu 359512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_145.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288664 304 -rw-r--r-- 1 ubuntu ubuntu 307888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_201.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288688 536 -rw-r--r-- 1 ubuntu ubuntu 546592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_44.pkl 2024-03-27T21:32:58.658 INFO:teuthology.orchestra.run.smithi063.stdout: 288685 548 -rw-r--r-- 1 ubuntu ubuntu 557192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_3.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288633 484 -rw-r--r-- 1 ubuntu ubuntu 492492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_104.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288699 448 -rw-r--r-- 1 ubuntu ubuntu 491392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_78.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288682 560 -rw-r--r-- 1 ubuntu ubuntu 571732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_239.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288687 508 -rw-r--r-- 1 ubuntu ubuntu 516692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_36.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288660 348 -rw-r--r-- 1 ubuntu ubuntu 354652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_182.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288638 500 -rw-r--r-- 1 ubuntu ubuntu 509592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_115.pkl 2024-03-27T21:32:58.659 INFO:teuthology.orchestra.run.smithi063.stdout: 288697 224 -rw-r--r-- 1 ubuntu ubuntu 228792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_71.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288642 304 -rw-r--r-- 1 ubuntu ubuntu 307592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_120.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288692 308 -rw-r--r-- 1 ubuntu ubuntu 314092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_6.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288678 200 -rw-r--r-- 1 ubuntu ubuntu 251188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_230.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288665 524 -rw-r--r-- 1 ubuntu ubuntu 567088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_204.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288666 464 -rw-r--r-- 1 ubuntu ubuntu 474856 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_206.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288669 276 -rw-r--r-- 1 ubuntu ubuntu 345148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_212.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288632 168 -rw-r--r-- 1 ubuntu ubuntu 217792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_10.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288635 252 -rw-r--r-- 1 ubuntu ubuntu 256392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_109.pkl 2024-03-27T21:32:58.660 INFO:teuthology.orchestra.run.smithi063.stdout: 288655 268 -rw-r--r-- 1 ubuntu ubuntu 305188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_161.pkl 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288696 284 -rw-r--r-- 1 ubuntu ubuntu 288292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_69.pkl 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288676 244 -rw-r--r-- 1 ubuntu ubuntu 296440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_227.pkl 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288636 488 -rw-r--r-- 1 ubuntu ubuntu 499492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_112.pkl 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288686 536 -rw-r--r-- 1 ubuntu ubuntu 547392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_33.pkl 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288648 264 -rw-r--r-- 1 ubuntu ubuntu 266692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/models/prophetstor/svm_134.pkl 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288713 20 -rw-r--r-- 1 ubuntu ubuntu 17526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/predictor.py 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288627 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/diskprediction_local/__init__.py 2024-03-27T21:32:58.661 INFO:teuthology.orchestra.run.smithi063.stdout: 288715 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/feedback 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288718 8 -rw-r--r-- 1 ubuntu ubuntu 5337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/feedback/module.py 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288716 4 -rw-r--r-- 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/feedback/__init__.py 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288717 4 -rw-r--r-- 1 ubuntu ubuntu 1138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/feedback/model.py 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288719 4 -rw-r--r-- 1 ubuntu ubuntu 1536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/feedback/service.py 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288752 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288768 8 -rw-r--r-- 1 ubuntu ubuntu 4530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/module.py 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288754 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs 2024-03-27T21:32:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: 288766 36 -rw-r--r-- 1 ubuntu ubuntu 36647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/snapshot_mirror.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288765 8 -rw-r--r-- 1 ubuntu ubuntu 4607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/notify.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288756 4 -rw-r--r-- 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/blocklist.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288755 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/__init__.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288764 4 -rw-r--r-- 1 ubuntu ubuntu 132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/exception.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288757 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288762 4 -rw-r--r-- 1 ubuntu ubuntu 3884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map/state_transition.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288759 4 -rw-r--r-- 1 ubuntu ubuntu 724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map/create.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288761 20 -rw-r--r-- 1 ubuntu ubuntu 17256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map/policy.py 2024-03-27T21:32:58.663 INFO:teuthology.orchestra.run.smithi063.stdout: 288758 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map/__init__.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288763 8 -rw-r--r-- 1 ubuntu ubuntu 5996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map/update.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288760 4 -rw-r--r-- 1 ubuntu ubuntu 2809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/dir_map/load.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288767 8 -rw-r--r-- 1 ubuntu ubuntu 5418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/fs/utils.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288753 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mirroring/__init__.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288872 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/selftest 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288874 20 -rw-r--r-- 1 ubuntu ubuntu 17529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/selftest/module.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288873 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/selftest/__init__.py 2024-03-27T21:32:58.664 INFO:teuthology.orchestra.run.smithi063.stdout: 288901 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telegraf 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288904 12 -rw-r--r-- 1 ubuntu ubuntu 9814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telegraf/module.py 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288903 4 -rw-r--r-- 1 ubuntu ubuntu 1518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telegraf/basesocket.py 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288902 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telegraf/__init__.py 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288905 4 -rw-r--r-- 1 ubuntu ubuntu 1674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telegraf/protocol.py 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288906 4 -rw-r--r-- 1 ubuntu ubuntu 658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telegraf/utils.py 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 286535 8 -rw-r--r-- 1 ubuntu ubuntu 6088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/ceph_module.pyi 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288914 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/test_orchestrator 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288918 12 -rw-r--r-- 1 ubuntu ubuntu 11182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/test_orchestrator/module.py 2024-03-27T21:32:58.665 INFO:teuthology.orchestra.run.smithi063.stdout: 288915 4 -rw-r--r-- 1 ubuntu ubuntu 290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/test_orchestrator/README.md 2024-03-27T21:32:58.666 INFO:teuthology.orchestra.run.smithi063.stdout: 288916 4 -rw-r--r-- 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/test_orchestrator/__init__.py 2024-03-27T21:32:58.666 INFO:teuthology.orchestra.run.smithi063.stdout: 288917 16 -rw-r--r-- 1 ubuntu ubuntu 13565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/test_orchestrator/dummy_data.json 2024-03-27T21:32:58.666 INFO:teuthology.orchestra.run.smithi063.stdout: 286527 20 -rw-r--r-- 1 ubuntu ubuntu 18450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/.pylintrc 2024-03-27T21:32:58.666 INFO:teuthology.orchestra.run.smithi063.stdout: 288750 88 -rw-r--r-- 1 ubuntu ubuntu 86092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/mgr_module.py 2024-03-27T21:32:58.666 INFO:teuthology.orchestra.run.smithi063.stdout: 288741 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/localpool 2024-03-27T21:32:58.666 INFO:teuthology.orchestra.run.smithi063.stdout: 288743 8 -rw-r--r-- 1 ubuntu ubuntu 5082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/localpool/module.py 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 288742 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/localpool/__init__.py 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 286629 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/crash 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 286631 16 -rw-r--r-- 1 ubuntu ubuntu 16376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/crash/module.py 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 286630 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/crash/__init__.py 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 288726 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 288729 12 -rw-r--r-- 1 ubuntu ubuntu 11800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights/module.py 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 288730 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights/tests 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 288732 8 -rw-r--r-- 1 ubuntu ubuntu 8146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights/tests/test_health.py 2024-03-27T21:32:58.667 INFO:teuthology.orchestra.run.smithi063.stdout: 288731 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights/tests/__init__.py 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288727 4 -rw-r--r-- 1 ubuntu ubuntu 85 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights/__init__.py 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288728 8 -rw-r--r-- 1 ubuntu ubuntu 6282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/insights/health.py 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288781 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288785 92 -rw-r--r-- 1 ubuntu ubuntu 90496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/module.py 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288782 4 -rw-r--r-- 1 ubuntu ubuntu 467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/README.md 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288786 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/tests 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288787 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/tests/__init__.py 2024-03-27T21:32:58.668 INFO:teuthology.orchestra.run.smithi063.stdout: 288788 12 -rw-r--r-- 1 ubuntu ubuntu 10480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/tests/test_orchestrator.py 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288783 4 -rw-r--r-- 1 ubuntu ubuntu 723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/__init__.py 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288784 64 -rw-r--r-- 1 ubuntu ubuntu 64923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/orchestrator/_interface.py 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288792 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/osd_support 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288794 4 -rw-r--r-- 1 ubuntu ubuntu 495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/osd_support/module.py 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288793 4 -rw-r--r-- 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/osd_support/__init__.py 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288925 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288960 44 -rw-r--r-- 1 ubuntu ubuntu 41386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/module.py 2024-03-27T21:32:58.669 INFO:teuthology.orchestra.run.smithi063.stdout: 288927 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288929 24 -rw-r--r-- 1 ubuntu ubuntu 24026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/async_cloner.py 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288958 4 -rw-r--r-- 1 ubuntu ubuntu 1511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/vol_spec.py 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288933 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288943 4 -rw-r--r-- 1 ubuntu ubuntu 779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/snapshot_util.py 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288940 4 -rw-r--r-- 1 ubuntu ubuntu 844 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/pin_util.py 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288935 8 -rw-r--r-- 1 ubuntu ubuntu 4544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/access.py 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288937 12 -rw-r--r-- 1 ubuntu ubuntu 11047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/group.py 2024-03-27T21:32:58.670 INFO:teuthology.orchestra.run.smithi063.stdout: 288938 4 -rw-r--r-- 1 ubuntu ubuntu 637 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/index.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288941 4 -rw-r--r-- 1 ubuntu ubuntu 3879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/rankevicter.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288945 8 -rw-r--r-- 1 ubuntu ubuntu 6234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/template.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288939 4 -rw-r--r-- 1 ubuntu ubuntu 1517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/lock.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288942 4 -rw-r--r-- 1 ubuntu ubuntu 797 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/resolver.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288944 4 -rw-r--r-- 1 ubuntu ubuntu 2905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/subvolume.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288936 4 -rw-r--r-- 1 ubuntu ubuntu 3541 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/clone_index.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288934 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/__init__.py 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288947 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions 2024-03-27T21:32:58.671 INFO:teuthology.orchestra.run.smithi063.stdout: 288953 24 -rw-r--r-- 1 ubuntu ubuntu 20750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/subvolume_base.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288951 8 -rw-r--r-- 1 ubuntu ubuntu 4952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/op_sm.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288955 20 -rw-r--r-- 1 ubuntu ubuntu 18640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/subvolume_v2.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288948 8 -rw-r--r-- 1 ubuntu ubuntu 5477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/__init__.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288954 40 -rw-r--r-- 1 ubuntu ubuntu 40869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/subvolume_v1.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288952 4 -rw-r--r-- 1 ubuntu ubuntu 1788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/subvolume_attrs.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288950 8 -rw-r--r-- 1 ubuntu ubuntu 7617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/metadata_manager.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288949 8 -rw-r--r-- 1 ubuntu ubuntu 7199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/versions/auth_metadata.py 2024-03-27T21:32:58.672 INFO:teuthology.orchestra.run.smithi063.stdout: 288956 12 -rw-r--r-- 1 ubuntu ubuntu 11794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/volume.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288946 8 -rw-r--r-- 1 ubuntu ubuntu 4482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/operations/trash.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288930 16 -rw-r--r-- 1 ubuntu ubuntu 13365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/async_job.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288928 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/__init__.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288932 8 -rw-r--r-- 1 ubuntu ubuntu 7377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/fs_util.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288931 4 -rw-r--r-- 1 ubuntu ubuntu 1921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/exception.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288959 48 -rw-r--r-- 1 ubuntu ubuntu 48278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/volume.py 2024-03-27T21:32:58.673 INFO:teuthology.orchestra.run.smithi063.stdout: 288957 8 -rw-r--r-- 1 ubuntu ubuntu 5253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/fs/purge_queue.py 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288926 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/volumes/__init__.py 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288892 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/stats 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288897 4 -rw-r--r-- 1 ubuntu ubuntu 1353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/stats/module.py 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288894 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/stats/fs 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288895 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/stats/fs/__init__.py 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288896 28 -rw-r--r-- 1 ubuntu ubuntu 25764 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/stats/fs/perf_stats.py 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 288893 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/stats/__init__.py 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 286536 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm 2024-03-27T21:32:58.674 INFO:teuthology.orchestra.run.smithi063.stdout: 286568 20 -rw-r--r-- 1 ubuntu ubuntu 18286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/ssh.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286549 156 -rw-r--r-- 1 ubuntu ubuntu 157921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/module.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286597 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286602 4 -rw-r--r-- 1 ubuntu ubuntu 2230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_autotune.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286603 136 -rw-r--r-- 1 ubuntu ubuntu 135862 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_cephadm.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286613 140 -rw-r--r-- 1 ubuntu ubuntu 141851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_services.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286599 4 -rw-r--r-- 1 ubuntu ubuntu 526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/conftest.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286614 16 -rw-r--r-- 1 ubuntu ubuntu 15705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_spec.py 2024-03-27T21:32:58.675 INFO:teuthology.orchestra.run.smithi063.stdout: 286609 12 -rw-r--r-- 1 ubuntu ubuntu 11377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_osd_removal.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286605 24 -rw-r--r-- 1 ubuntu ubuntu 24128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_configchecks.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286612 8 -rw-r--r-- 1 ubuntu ubuntu 5832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_service_discovery.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286616 4 -rw-r--r-- 1 ubuntu ubuntu 1056 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_template.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286610 12 -rw-r--r-- 1 ubuntu ubuntu 8408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_remote_executables.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286606 4 -rw-r--r-- 1 ubuntu ubuntu 1273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_facts.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286604 4 -rw-r--r-- 1 ubuntu ubuntu 1185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_completion.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286611 68 -rw-r--r-- 1 ubuntu ubuntu 66119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_scheduling.py 2024-03-27T21:32:58.676 INFO:teuthology.orchestra.run.smithi063.stdout: 286607 16 -rw-r--r-- 1 ubuntu ubuntu 13871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_migration.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286615 8 -rw-r--r-- 1 ubuntu ubuntu 4874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_ssh.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286608 16 -rw-r--r-- 1 ubuntu ubuntu 13595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_node_proxy.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286598 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/__init__.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286601 8 -rw-r--r-- 1 ubuntu ubuntu 6183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/node_proxy_data.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286600 8 -rw-r--r-- 1 ubuntu ubuntu 7397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/fixtures.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286617 16 -rw-r--r-- 1 ubuntu ubuntu 12362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_tuned_profiles.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286618 24 -rw-r--r-- 1 ubuntu ubuntu 21701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tests/test_upgrade.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286546 4 -rw-r--r-- 1 ubuntu ubuntu 3762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/http_server.py 2024-03-27T21:32:58.677 INFO:teuthology.orchestra.run.smithi063.stdout: 286544 32 -rw-r--r-- 1 ubuntu ubuntu 30105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/configchecks.py 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286543 4 -rw-r--r-- 1 ubuntu ubuntu 535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/ceph.repo 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286552 20 -rw-r--r-- 1 ubuntu ubuntu 20018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/schedule.py 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286569 8 -rw-r--r-- 1 ubuntu ubuntu 6244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/ssl_cert_utils.py 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286548 20 -rw-r--r-- 1 ubuntu ubuntu 18059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/migrations.py 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286550 4 -rw-r--r-- 1 ubuntu ubuntu 2260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/offline_watcher.py 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286570 4 -rw-r--r-- 1 ubuntu ubuntu 3731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/template.py 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286622 4 -rw-r--r-- 1 ubuntu ubuntu 229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/vagrant.config.example.json 2024-03-27T21:32:58.678 INFO:teuthology.orchestra.run.smithi063.stdout: 286554 12 -rw-r--r-- 1 ubuntu ubuntu 11027 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/service_discovery.py 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286540 4 -rw-r--r-- 1 ubuntu ubuntu 174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/__init__.py 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286619 8 -rw-r--r-- 1 ubuntu ubuntu 5026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/tuned_profiles.py 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286539 4 -rw-r--r-- 1 ubuntu ubuntu 2400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/Vagrantfile 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286553 80 -rw-r--r-- 1 ubuntu ubuntu 80849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/serve.py 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286555 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286557 56 -rw-r--r-- 1 ubuntu ubuntu 53474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/cephadmservice.py 2024-03-27T21:32:58.679 INFO:teuthology.orchestra.run.smithi063.stdout: 286562 36 -rw-r--r-- 1 ubuntu ubuntu 33338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/monitoring.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286559 16 -rw-r--r-- 1 ubuntu ubuntu 16080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/ingress.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286560 12 -rw-r--r-- 1 ubuntu ubuntu 9381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/iscsi.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286561 4 -rw-r--r-- 1 ubuntu ubuntu 3150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/jaeger.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286564 8 -rw-r--r-- 1 ubuntu ubuntu 7521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/node_proxy.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286563 16 -rw-r--r-- 1 ubuntu ubuntu 14272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/nfs.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286558 4 -rw-r--r-- 1 ubuntu ubuntu 1106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/container.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286565 8 -rw-r--r-- 1 ubuntu ubuntu 5674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/nvmeof.py 2024-03-27T21:32:58.680 INFO:teuthology.orchestra.run.smithi063.stdout: 286556 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/__init__.py 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286567 8 -rw-r--r-- 1 ubuntu ubuntu 4513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/smb.py 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286566 40 -rw-r--r-- 1 ubuntu ubuntu 40167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/services/osd.py 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286538 8 -rw-r--r-- 1 ubuntu ubuntu 6757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/HACKING.rst 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286551 4 -rw-r--r-- 1 ubuntu ubuntu 2256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/registry.py 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286537 4 -rw-r--r-- 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/.gitignore 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286571 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286572 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/blink_device_light_cmd.j2 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286573 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services 2024-03-27T21:32:58.681 INFO:teuthology.orchestra.run.smithi063.stdout: 286584 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/iscsi 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286585 4 -rw-r--r-- 1 ubuntu ubuntu 466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/iscsi/iscsi-gateway.cfg.j2 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286577 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/grafana 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286579 4 -rw-r--r-- 1 ubuntu ubuntu 682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/grafana/grafana.ini.j2 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286580 4 -rw-r--r-- 1 ubuntu ubuntu 260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/grafana/providers.yml.j2 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286578 4 -rw-r--r-- 1 ubuntu ubuntu 909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/grafana/ceph-dashboard.yml.j2 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286596 4 -rw-r--r-- 1 ubuntu ubuntu 321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/promtail.yml.j2 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286581 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/ingress 2024-03-27T21:32:58.682 INFO:teuthology.orchestra.run.smithi063.stdout: 286583 4 -rw-r--r-- 1 ubuntu ubuntu 742 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/ingress/keepalived.conf.j2 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286582 4 -rw-r--r-- 1 ubuntu ubuntu 2566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/ingress/haproxy.cfg.j2 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286589 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/node-exporter 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286590 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/node-exporter/web.yml.j2 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286586 4 -rw-r--r-- 1 ubuntu ubuntu 523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/loki.yml.j2 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/prometheus 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286595 4 -rw-r--r-- 1 ubuntu ubuntu 153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/prometheus/web.yml.j2 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286594 8 -rw-r--r-- 1 ubuntu ubuntu 4148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/prometheus/prometheus.yml.j2 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286591 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/nvmeof 2024-03-27T21:32:58.683 INFO:teuthology.orchestra.run.smithi063.stdout: 286592 4 -rw-r--r-- 1 ubuntu ubuntu 2117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/nvmeof/ceph-nvmeof.conf.j2 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286574 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/alertmanager 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286576 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/alertmanager/web.yml.j2 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286575 4 -rw-r--r-- 1 ubuntu ubuntu 1121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/alertmanager/alertmanager.yml.j2 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286587 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/nfs 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286588 4 -rw-r--r-- 1 ubuntu ubuntu 829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/templates/services/nfs/ganesha.conf.j2 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286547 72 -rw-r--r-- 1 ubuntu ubuntu 73475 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/inventory.py 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286545 8 -rw-r--r-- 1 ubuntu ubuntu 4960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/exchange.py 2024-03-27T21:32:58.684 INFO:teuthology.orchestra.run.smithi063.stdout: 286542 4 -rw-r--r-- 1 ubuntu ubuntu 1722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/autotune.py 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 286621 8 -rw-r--r-- 1 ubuntu ubuntu 4811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/utils.py 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 286541 44 -rw-r--r-- 1 ubuntu ubuntu 42944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/agent.py 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 286620 60 -rw-r--r-- 1 ubuntu ubuntu 60491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/cephadm/upgrade.py 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 286526 4 -rw-r--r-- 1 ubuntu ubuntu 130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/.gitignore 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 288907 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 288909 88 -rw-r--r-- 1 ubuntu ubuntu 89012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry/module.py 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 288910 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry/tests 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 288911 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry/tests/__init__.py 2024-03-27T21:32:58.685 INFO:teuthology.orchestra.run.smithi063.stdout: 288912 8 -rw-r--r-- 1 ubuntu ubuntu 4223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry/tests/test_telemetry.py 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288913 4 -rw-r--r-- 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry/tox.ini 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288908 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/telemetry/__init__.py 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288807 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/prometheus 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288809 80 -rw-r--r-- 1 ubuntu ubuntu 79416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/prometheus/module.py 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288808 4 -rw-r--r-- 1 ubuntu ubuntu 57 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/prometheus/__init__.py 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288810 4 -rw-r--r-- 1 ubuntu ubuntu 3979 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/prometheus/test_module.py 2024-03-27T21:32:58.686 INFO:teuthology.orchestra.run.smithi063.stdout: 288820 4 -rw-r--r-- 1 ubuntu ubuntu 195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/requirements-required.txt 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288898 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/status 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288900 20 -rw-r--r-- 1 ubuntu ubuntu 16519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/status/module.py 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288899 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/status/__init__.py 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288769 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288775 8 -rw-r--r-- 1 ubuntu ubuntu 7831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/module.py 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288776 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/tests 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288778 44 -rw-r--r-- 1 ubuntu ubuntu 41758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/tests/test_nfs.py 2024-03-27T21:32:58.687 INFO:teuthology.orchestra.run.smithi063.stdout: 288777 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/tests/__init__.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 288773 36 -rw-r--r-- 1 ubuntu ubuntu 36026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/export.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 288771 16 -rw-r--r-- 1 ubuntu ubuntu 13463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/cluster.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 288770 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/__init__.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 288772 4 -rw-r--r-- 1 ubuntu ubuntu 954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/exception.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 288774 20 -rw-r--r-- 1 ubuntu ubuntu 19920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/ganesha_conf.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 288779 4 -rw-r--r-- 1 ubuntu ubuntu 3382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/nfs/utils.py 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 286517 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs 2024-03-27T21:32:58.688 INFO:teuthology.orchestra.run.smithi063.stdout: 286524 4 -rw-r--r-- 1 ubuntu ubuntu 1499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/types.pxd 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 286518 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/CMakeLists.txt 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 286522 12 -rw-r--r-- 1 ubuntu ubuntu 10698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/mock_cephfs.pxi 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 286519 4 -rw-r--r-- 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/MANIFEST.in 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 286521 92 -rw-r--r-- 1 ubuntu ubuntu 91191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/cephfs.pyx 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 286520 12 -rw-r--r-- 1 ubuntu ubuntu 9488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/c_cephfs.pxd 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 286523 8 -rwxr-xr-x 1 ubuntu ubuntu 7227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/cephfs/setup.py 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 288965 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 288966 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/CMakeLists.txt 2024-03-27T21:32:58.689 INFO:teuthology.orchestra.run.smithi063.stdout: 288969 4 -rw-r--r-- 1 ubuntu ubuntu 229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/ctime.pxd 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288970 24 -rw-r--r-- 1 ubuntu ubuntu 22280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/mock_rados.pxi 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288967 4 -rw-r--r-- 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/MANIFEST.in 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288972 144 -rw-r--r-- 1 ubuntu ubuntu 146118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/rados.pyx 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288968 20 -rw-r--r-- 1 ubuntu ubuntu 20374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/c_rados.pxd 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288973 8 -rwxr-xr-x 1 ubuntu ubuntu 6854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/setup.py 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288971 4 -rw-r--r-- 1 ubuntu ubuntu 1187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rados/rados.pxd 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 286513 4 -rw-r--r-- 1 ubuntu ubuntu 2635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/CMakeLists.txt 2024-03-27T21:32:58.690 INFO:teuthology.orchestra.run.smithi063.stdout: 288982 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288988 20 -rw-r--r-- 1 ubuntu ubuntu 17091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/rgw.pyx 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288983 4 -rw-r--r-- 1 ubuntu ubuntu 232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/CMakeLists.txt 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288987 8 -rw-r--r-- 1 ubuntu ubuntu 4960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/mock_rgw.pxi 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288986 4 -rw-r--r-- 1 ubuntu ubuntu 486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/cstat.pxd 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288984 4 -rw-r--r-- 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/MANIFEST.in 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288989 8 -rwxr-xr-x 1 ubuntu ubuntu 7007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/setup.py 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288985 8 -rw-r--r-- 1 ubuntu ubuntu 4583 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rgw/c_rgw.pxd 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 286516 8 -rwxr-xr-x 1 ubuntu ubuntu 4538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/ceph_mgr_repl.py 2024-03-27T21:32:58.691 INFO:teuthology.orchestra.run.smithi063.stdout: 288990 4 -rw-r--r-- 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/tox.ini 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288974 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288975 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/CMakeLists.txt 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288978 4 -rw-r--r-- 1 ubuntu ubuntu 156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/ctime.pxd 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288976 4 -rw-r--r-- 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/MANIFEST.in 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288979 40 -rw-r--r-- 1 ubuntu ubuntu 39601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/mock_rbd.pxi 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288980 208 -rw-r--r-- 1 ubuntu ubuntu 210518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/rbd.pyx 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288977 36 -rw-r--r-- 1 ubuntu ubuntu 36744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/c_rbd.pxd 2024-03-27T21:32:58.692 INFO:teuthology.orchestra.run.smithi063.stdout: 288981 8 -rwxr-xr-x 1 ubuntu ubuntu 7840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/rbd/setup.py 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286515 16 -rw-r--r-- 1 ubuntu ubuntu 15462 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/ceph_daemon.py 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286514 60 -rw-r--r-- 1 ubuntu ubuntu 58341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/pybind/ceph_argparse.py 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286053 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286092 16 -rw-r--r-- 1 ubuntu ubuntu 13669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrStandby.cc 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286066 4 -rw-r--r-- 1 ubuntu ubuntu 3003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonHealthMetricCollector.cc 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286112 8 -rw-r--r-- 1 ubuntu ubuntu 5657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/StandbyPyModules.cc 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286076 4 -rw-r--r-- 1 ubuntu ubuntu 1965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MDSPerfMetricCollector.cc 2024-03-27T21:32:58.693 INFO:teuthology.orchestra.run.smithi063.stdout: 286082 8 -rw-r--r-- 1 ubuntu ubuntu 7184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MetricTypes.h 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286055 4 -rw-r--r-- 1 ubuntu ubuntu 2802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ActivePyModule.h 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286064 8 -rw-r--r-- 1 ubuntu ubuntu 4461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ClusterState.h 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286069 4 -rw-r--r-- 1 ubuntu ubuntu 612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonKey.h 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286091 4 -rw-r--r-- 1 ubuntu ubuntu 832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrSession.h 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286062 4 -rw-r--r-- 1 ubuntu ubuntu 1511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/CMakeLists.txt 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286106 24 -rw-r--r-- 1 ubuntu ubuntu 23099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyOSDMap.cc 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286073 12 -rw-r--r-- 1 ubuntu ubuntu 10143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonState.h 2024-03-27T21:32:58.694 INFO:teuthology.orchestra.run.smithi063.stdout: 286109 4 -rw-r--r-- 1 ubuntu ubuntu 275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyUtil.h 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286098 4 -rw-r--r-- 1 ubuntu ubuntu 3332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyFormatter.cc 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286115 4 -rw-r--r-- 1 ubuntu ubuntu 3154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/TTLCache.h 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286099 8 -rw-r--r-- 1 ubuntu ubuntu 4151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyFormatter.h 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286103 8 -rw-r--r-- 1 ubuntu ubuntu 6308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyModuleRegistry.h 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286104 4 -rw-r--r-- 1 ubuntu ubuntu 2846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyModuleRunner.cc 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286089 12 -rw-r--r-- 1 ubuntu ubuntu 8339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrCommands.h 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286054 12 -rw-r--r-- 1 ubuntu ubuntu 8359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ActivePyModule.cc 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286090 4 -rw-r--r-- 1 ubuntu ubuntu 1379 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrContext.h 2024-03-27T21:32:58.695 INFO:teuthology.orchestra.run.smithi063.stdout: 286057 8 -rw-r--r-- 1 ubuntu ubuntu 7507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ActivePyModules.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286086 8 -rw-r--r-- 1 ubuntu ubuntu 6053 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrCap.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286079 12 -rw-r--r-- 1 ubuntu ubuntu 10607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MDSPerfMetricTypes.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286088 8 -rw-r--r-- 1 ubuntu ubuntu 5788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrClient.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286097 16 -rw-r--r-- 1 ubuntu ubuntu 13738 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/OSDPerfMetricTypes.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286071 12 -rw-r--r-- 1 ubuntu ubuntu 9445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonServer.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286113 4 -rw-r--r-- 1 ubuntu ubuntu 2931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/StandbyPyModules.h 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286070 100 -rw-r--r-- 1 ubuntu ubuntu 99677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonServer.cc 2024-03-27T21:32:58.696 INFO:teuthology.orchestra.run.smithi063.stdout: 286058 52 -rw-r--r-- 1 ubuntu ubuntu 53028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/BaseMgrModule.cc 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286060 8 -rw-r--r-- 1 ubuntu ubuntu 8136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/BaseMgrStandbyModule.cc 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286107 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyOSDMap.h 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286084 4 -rw-r--r-- 1 ubuntu ubuntu 3271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/Mgr.h 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286056 48 -rw-r--r-- 1 ubuntu ubuntu 45455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ActivePyModules.cc 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286074 4 -rw-r--r-- 1 ubuntu ubuntu 3010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/Gil.cc 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286116 4 -rw-r--r-- 1 ubuntu ubuntu 554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/Types.h 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286068 4 -rw-r--r-- 1 ubuntu ubuntu 685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonKey.cc 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286095 4 -rw-r--r-- 1 ubuntu ubuntu 670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/OSDPerfMetricCollector.h 2024-03-27T21:32:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 286072 12 -rw-r--r-- 1 ubuntu ubuntu 11285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonState.cc 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286063 12 -rw-r--r-- 1 ubuntu ubuntu 12251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ClusterState.cc 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286120 4 -rw-r--r-- 1 ubuntu ubuntu 359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/mgr_perf_counters.h 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286108 4 -rw-r--r-- 1 ubuntu ubuntu 1037 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyUtil.cc 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286101 8 -rw-r--r-- 1 ubuntu ubuntu 4863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyModule.h 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286080 8 -rw-r--r-- 1 ubuntu ubuntu 5334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MetricCollector.cc 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286117 4 -rw-r--r-- 1 ubuntu ubuntu 457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/mgr_commands.cc 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286094 4 -rw-r--r-- 1 ubuntu ubuntu 1299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/OSDPerfMetricCollector.cc 2024-03-27T21:32:58.698 INFO:teuthology.orchestra.run.smithi063.stdout: 286096 4 -rw-r--r-- 1 ubuntu ubuntu 4070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/OSDPerfMetricTypes.cc 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286059 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/BaseMgrModule.h 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286083 24 -rw-r--r-- 1 ubuntu ubuntu 23482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/Mgr.cc 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286100 24 -rw-r--r-- 1 ubuntu ubuntu 23250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyModule.cc 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286065 4 -rw-r--r-- 1 ubuntu ubuntu 2223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonHealthMetric.h 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286119 4 -rw-r--r-- 1 ubuntu ubuntu 804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/mgr_perf_counters.cc 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286075 4 -rw-r--r-- 1 ubuntu ubuntu 2834 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/Gil.h 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286067 4 -rw-r--r-- 1 ubuntu ubuntu 933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/DaemonHealthMetricCollector.h 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286102 16 -rw-r--r-- 1 ubuntu ubuntu 12757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyModuleRegistry.cc 2024-03-27T21:32:58.699 INFO:teuthology.orchestra.run.smithi063.stdout: 286118 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/mgr_commands.h 2024-03-27T21:32:58.700 INFO:teuthology.orchestra.run.smithi063.stdout: 286078 8 -rw-r--r-- 1 ubuntu ubuntu 5513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MDSPerfMetricTypes.cc 2024-03-27T21:32:58.700 INFO:teuthology.orchestra.run.smithi063.stdout: 286061 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/BaseMgrStandbyModule.h 2024-03-27T21:32:58.700 INFO:teuthology.orchestra.run.smithi063.stdout: 286111 4 -rw-r--r-- 1 ubuntu ubuntu 2838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ServiceMap.h 2024-03-27T21:32:58.700 INFO:teuthology.orchestra.run.smithi063.stdout: 286110 8 -rw-r--r-- 1 ubuntu ubuntu 6178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/ServiceMap.cc 2024-03-27T21:32:58.700 INFO:teuthology.orchestra.run.smithi063.stdout: 286077 4 -rw-r--r-- 1 ubuntu ubuntu 838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MDSPerfMetricCollector.h 2024-03-27T21:32:58.700 INFO:teuthology.orchestra.run.smithi063.stdout: 286085 20 -rw-r--r-- 1 ubuntu ubuntu 17285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrCap.cc 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 286087 20 -rw-r--r-- 1 ubuntu ubuntu 17653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrClient.cc 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 286093 4 -rw-r--r-- 1 ubuntu ubuntu 2092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MgrStandby.h 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 286105 4 -rw-r--r-- 1 ubuntu ubuntu 1807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/PyModuleRunner.h 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 286081 4 -rw-r--r-- 1 ubuntu ubuntu 2367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/MetricCollector.h 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 286114 4 -rw-r--r-- 1 ubuntu ubuntu 2639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mgr/TTLCache.cc 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 283390 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy 2024-03-27T21:32:58.701 INFO:teuthology.orchestra.run.smithi063.stdout: 283391 4 -rw-r--r-- 1 ubuntu ubuntu 1043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/CMakeLists.txt 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283392 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/MANIFEST.in 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283393 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283396 4 -rw-r--r-- 1 ubuntu ubuntu 487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/baseclient.py 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283395 12 -rw-r--r-- 1 ubuntu ubuntu 10156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/api.py 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283403 8 -rw-r--r-- 1 ubuntu ubuntu 6028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/util.py 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283399 8 -rw-r--r-- 1 ubuntu ubuntu 7642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/main.py 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283402 4 -rw-r--r-- 1 ubuntu ubuntu 3621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/reporter.py 2024-03-27T21:32:58.702 INFO:teuthology.orchestra.run.smithi063.stdout: 283397 12 -rw-r--r-- 1 ubuntu ubuntu 11452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/baseredfishsystem.py 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283401 8 -rw-r--r-- 1 ubuntu ubuntu 6624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/redfishdellsystem.py 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283394 4 -rw-r--r-- 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/__init__.py 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283400 8 -rw-r--r-- 1 ubuntu ubuntu 5183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/redfish_client.py 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283398 4 -rw-r--r-- 1 ubuntu ubuntu 2786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/ceph_node_proxy/basesystem.py 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283404 4 -rw-r--r-- 1 ubuntu ubuntu 1213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-node-proxy/setup.py 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283290 24 -rw-r--r-- 1 ubuntu ubuntu 20980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/SimpleRADOSStriper.cc 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 291442 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/xxHash 2024-03-27T21:32:58.703 INFO:teuthology.orchestra.run.smithi063.stdout: 283706 4 -rw-r--r-- 1 ubuntu ubuntu 271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_ver.h.in.cmake 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283705 4 -rw-r--r-- 1 ubuntu ubuntu 159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_ver.c 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283294 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/CMakeLists.txt 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283296 4 -rw-r--r-- 1 ubuntu ubuntu 416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/arm.h 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283298 4 -rw-r--r-- 1 ubuntu ubuntu 681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/intel.h 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283299 4 -rw-r--r-- 1 ubuntu ubuntu 889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/ppc.c 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283297 4 -rw-r--r-- 1 ubuntu ubuntu 1883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/intel.c 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283300 4 -rw-r--r-- 1 ubuntu ubuntu 540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/ppc.h 2024-03-27T21:32:58.704 INFO:teuthology.orchestra.run.smithi063.stdout: 283302 4 -rw-r--r-- 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/probe.h 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 283301 4 -rw-r--r-- 1 ubuntu ubuntu 603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/probe.cc 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 283295 4 -rw-r--r-- 1 ubuntu ubuntu 758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arch/arm.c 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 283821 4 -rwxr-xr-x 1 ubuntu ubuntu 329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ckill.sh 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 286498 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 286501 4 -rw-r--r-- 1 ubuntu ubuntu 642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/cpu_profiler.h 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 286499 4 -rw-r--r-- 1 ubuntu ubuntu 555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/CMakeLists.txt 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 286500 4 -rw-r--r-- 1 ubuntu ubuntu 1143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/cpu_profiler.cc 2024-03-27T21:32:58.705 INFO:teuthology.orchestra.run.smithi063.stdout: 286502 4 -rw-r--r-- 1 ubuntu ubuntu 1322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/disabled_heap_profiler.cc 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 286504 8 -rw-r--r-- 1 ubuntu ubuntu 5121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/heap_profiler.cc 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 286503 4 -rw-r--r-- 1 ubuntu ubuntu 657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/disabled_stubs.cc 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 286505 4 -rw-r--r-- 1 ubuntu ubuntu 1468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perfglue/heap_profiler.h 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 284770 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 284784 4 -rw-r--r-- 1 ubuntu ubuntu 2978 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/crush.c 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 284779 124 -rw-r--r-- 1 ubuntu ubuntu 123513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushWrapper.cc 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 284774 4 -rw-r--r-- 1 ubuntu ubuntu 3894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushLocation.cc 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 284771 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CMakeLists.txt 2024-03-27T21:32:58.706 INFO:teuthology.orchestra.run.smithi063.stdout: 284790 4 -rw-r--r-- 1 ubuntu ubuntu 611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/hash.h 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284794 4 -rw-r--r-- 1 ubuntu ubuntu 250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/types.h 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284788 12 -rw-r--r-- 1 ubuntu ubuntu 9922 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/grammar.h 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284778 8 -rw-r--r-- 1 ubuntu ubuntu 7915 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushTreeDumper.h 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284793 4 -rw-r--r-- 1 ubuntu ubuntu 941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/old_sample.txt 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284780 52 -rw-r--r-- 1 ubuntu ubuntu 52372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushWrapper.h 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284782 40 -rw-r--r-- 1 ubuntu ubuntu 38355 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/builder.c 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284781 4 -rw-r--r-- 1 ubuntu ubuntu 951 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushWrapper.i 2024-03-27T21:32:58.707 INFO:teuthology.orchestra.run.smithi063.stdout: 284783 16 -rw-r--r-- 1 ubuntu ubuntu 13701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/builder.h 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284776 24 -rw-r--r-- 1 ubuntu ubuntu 24167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushTester.cc 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284772 40 -rw-r--r-- 1 ubuntu ubuntu 39691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushCompiler.cc 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284777 12 -rw-r--r-- 1 ubuntu ubuntu 10880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushTester.h 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284789 4 -rw-r--r-- 1 ubuntu ubuntu 3206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/hash.c 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284775 4 -rw-r--r-- 1 ubuntu ubuntu 1047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushLocation.h 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284791 56 -rw-r--r-- 1 ubuntu ubuntu 56791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/mapper.c 2024-03-27T21:32:58.708 INFO:teuthology.orchestra.run.smithi063.stdout: 284792 8 -rw-r--r-- 1 ubuntu ubuntu 4237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/mapper.h 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 284787 16 -rw-r--r-- 1 ubuntu ubuntu 12506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/crush_ln_table.h 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 284786 4 -rw-r--r-- 1 ubuntu ubuntu 914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/crush_compat.h 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 284785 20 -rw-r--r-- 1 ubuntu ubuntu 20470 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/crush.h 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 284773 4 -rw-r--r-- 1 ubuntu ubuntu 2949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crush/CrushCompiler.h 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 289650 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/spdk 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 285738 4 -rw-r--r-- 1 ubuntu ubuntu 358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/logrotate.conf 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 283288 32 -rw-r--r-- 1 ubuntu ubuntu 30473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/CMakeLists.txt 2024-03-27T21:32:58.709 INFO:teuthology.orchestra.run.smithi063.stdout: 289035 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/qatzip 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 285076 4 -rw-r--r-- 1 ubuntu ubuntu 4058 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/init-radosgw 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 286310 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ocf 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 286312 4 -rw-r--r-- 1 ubuntu ubuntu 364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ocf/CMakeLists.txt 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 286313 12 -rw-r--r-- 1 ubuntu ubuntu 9725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ocf/rbd.in 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 286311 4 -rw-r--r-- 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ocf/.gitignore 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 285161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 285162 4 -rw-r--r-- 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store/CMakeLists.txt 2024-03-27T21:32:58.710 INFO:teuthology.orchestra.run.smithi063.stdout: 285164 4 -rw-r--r-- 1 ubuntu ubuntu 3898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store/key_value_structure.h 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 285165 76 -rw-r--r-- 1 ubuntu ubuntu 74925 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store/kv_flat_btree_async.cc 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 285167 4 -rw-r--r-- 1 ubuntu ubuntu 3030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store/kvs_arg_types.h 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 285163 20 -rw-r--r-- 1 ubuntu ubuntu 19454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store/cls_kvs.cc 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 285166 28 -rw-r--r-- 1 ubuntu ubuntu 25031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/key_value_store/kv_flat_btree_async.h 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 283701 28 -rw-r--r-- 1 ubuntu ubuntu 28641 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_mon.cc 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 284929 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 284962 4 -rw-r--r-- 1 ubuntu ubuntu 2187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/coredumpctl.h 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 285048 4 -rw-r--r-- 1 ubuntu ubuntu 1162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/uuid.cc 2024-03-27T21:32:58.711 INFO:teuthology.orchestra.run.smithi063.stdout: 285024 8 -rw-r--r-- 1 ubuntu ubuntu 5218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rangeset.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 284977 4 -rw-r--r-- 1 ubuntu ubuntu 1034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/error.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 285074 8 -rw-r--r-- 1 ubuntu ubuntu 5427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/xlist.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 285039 4 -rw-r--r-- 1 ubuntu ubuntu 2229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/timegm.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 285035 4 -rw-r--r-- 1 ubuntu ubuntu 2750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/statlite.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 285023 12 -rw-r--r-- 1 ubuntu ubuntu 8256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/random.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 284985 4 -rw-r--r-- 1 ubuntu ubuntu 1930 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/health.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 284975 52 -rw-r--r-- 1 ubuntu ubuntu 52526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/encoding.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 284957 4 -rw-r--r-- 1 ubuntu ubuntu 898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/common_fwd.h 2024-03-27T21:32:58.712 INFO:teuthology.orchestra.run.smithi063.stdout: 284964 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cpp-btree 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284967 8 -rw-r--r-- 1 ubuntu ubuntu 6052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cpp-btree/btree_map.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284968 24 -rw-r--r-- 1 ubuntu ubuntu 21678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cpp-btree/btree_set.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284965 92 -rw-r--r-- 1 ubuntu ubuntu 90900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cpp-btree/btree.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284966 20 -rw-r--r-- 1 ubuntu ubuntu 19109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cpp-btree/btree_container.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284992 4 -rw-r--r-- 1 ubuntu ubuntu 2424 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/libcephsqlite.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 285036 4 -rw-r--r-- 1 ubuntu ubuntu 3179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/str_list.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284936 24 -rw-r--r-- 1 ubuntu ubuntu 21752 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/any.h 2024-03-27T21:32:58.713 INFO:teuthology.orchestra.run.smithi063.stdout: 284950 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cephfs 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 284951 8 -rw-r--r-- 1 ubuntu ubuntu 6463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cephfs/ceph_ll_client.h 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 284952 88 -rw-r--r-- 1 ubuntu ubuntu 88278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cephfs/libcephfs.h 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 284953 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cephfs/metrics 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 284954 20 -rw-r--r-- 1 ubuntu ubuntu 19934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cephfs/metrics/Types.h 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 284955 32 -rw-r--r-- 1 ubuntu ubuntu 30215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cephfs/types.h 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 284976 4 -rw-r--r-- 1 ubuntu ubuntu 548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/err.h 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 285006 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 285014 4 -rw-r--r-- 1 ubuntu ubuntu 922 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/librgw.h 2024-03-27T21:32:58.714 INFO:teuthology.orchestra.run.smithi063.stdout: 285012 60 -rw-r--r-- 1 ubuntu ubuntu 58501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/librados.hpp 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285015 4 -rw-r--r-- 1 ubuntu ubuntu 3860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/objclass.h 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285011 152 -rw-r--r-- 1 ubuntu ubuntu 151570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/librados.h 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285017 4 -rw-r--r-- 1 ubuntu ubuntu 720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/rados_types.h 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285018 12 -rw-r--r-- 1 ubuntu ubuntu 9611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/rados_types.hpp 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285010 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/inline_memory.h -> ../inline_memory.h 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285016 0 lrwxrwxrwx 1 ubuntu ubuntu 9 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/page.h -> ../page.h 2024-03-27T21:32:58.715 INFO:teuthology.orchestra.run.smithi063.stdout: 285009 0 lrwxrwxrwx 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/crc32c.h -> ../crc32c.h 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 285008 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/buffer_fwd.h -> ../buffer_fwd.h 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 285019 12 -rw-r--r-- 1 ubuntu ubuntu 10819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/rgw_file.h 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 285013 4 -rw-r--r-- 1 ubuntu ubuntu 841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/librados_fwd.hpp 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 285007 0 lrwxrwxrwx 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados/buffer.h -> ../buffer.h 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 284939 4 -rw-r--r-- 1 ubuntu ubuntu 1801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/btree_map.h 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 284930 4 -rw-r--r-- 1 ubuntu ubuntu 953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/CMakeLists.txt 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 284931 12 -rw-r--r-- 1 ubuntu ubuntu 8745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/CompatSet.h 2024-03-27T21:32:58.716 INFO:teuthology.orchestra.run.smithi063.stdout: 285031 4 -rw-r--r-- 1 ubuntu ubuntu 1427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/scope_guard.h 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 284990 4 -rw-r--r-- 1 ubuntu ubuntu 1325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ipaddr.h 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 284995 20 -rw-r--r-- 1 ubuntu ubuntu 18065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/mempool.h 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 285045 4 -rw-r--r-- 1 ubuntu ubuntu 855 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/utime.cc 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 284972 52 -rw-r--r-- 1 ubuntu ubuntu 52631 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/denc.h 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 284979 92 -rw-r--r-- 1 ubuntu ubuntu 92778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/expected.hpp 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 284984 4 -rw-r--r-- 1 ubuntu ubuntu 1422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/hash.h 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 285040 20 -rw-r--r-- 1 ubuntu ubuntu 18703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/types.h 2024-03-27T21:32:58.717 INFO:teuthology.orchestra.run.smithi063.stdout: 284969 4 -rw-r--r-- 1 ubuntu ubuntu 685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/cpp_lib_backport.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 285047 4 -rw-r--r-- 1 ubuntu ubuntu 1245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/utime_fmt.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 284961 12 -rw-r--r-- 1 ubuntu ubuntu 10533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/config-h.in.cmake 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 285043 12 -rw-r--r-- 1 ubuntu ubuntu 11402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/uses_allocator.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 284986 8 -rw-r--r-- 1 ubuntu ubuntu 4784 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/inline_memory.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 285042 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/unordered_set.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 285005 28 -rw-r--r-- 1 ubuntu ubuntu 24693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rados.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 285034 4 -rw-r--r-- 1 ubuntu ubuntu 2716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/stat.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 284971 4 -rw-r--r-- 1 ubuntu ubuntu 1146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/demangle.h 2024-03-27T21:32:58.718 INFO:teuthology.orchestra.run.smithi063.stdout: 285004 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/page.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 284932 16 -rw-r--r-- 1 ubuntu ubuntu 13036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/Context.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 284963 4 -rw-r--r-- 1 ubuntu ubuntu 1114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/counter.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 285046 16 -rw-r--r-- 1 ubuntu ubuntu 16154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/utime.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 284987 4 -rw-r--r-- 1 ubuntu ubuntu 883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/int_types.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 284993 4 -rw-r--r-- 1 ubuntu ubuntu 2748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/linux_fiemap.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 284974 8 -rw-r--r-- 1 ubuntu ubuntu 4262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/elist.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 285049 4 -rw-r--r-- 1 ubuntu ubuntu 2326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/uuid.h 2024-03-27T21:32:58.719 INFO:teuthology.orchestra.run.smithi063.stdout: 284942 4 -rw-r--r-- 1 ubuntu ubuntu 3507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/buffer_raw.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284996 8 -rw-r--r-- 1 ubuntu ubuntu 7552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/msgr.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284958 12 -rw-r--r-- 1 ubuntu ubuntu 11062 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/compact_map.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284959 12 -rw-r--r-- 1 ubuntu ubuntu 8630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/compact_set.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284949 4 -rw-r--r-- 1 ubuntu ubuntu 476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ceph_hash.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284970 4 -rw-r--r-- 1 ubuntu ubuntu 1356 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/crc32c.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284937 4 -rw-r--r-- 1 ubuntu ubuntu 1099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/bitmapper.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284981 20 -rw-r--r-- 1 ubuntu ubuntu 16625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/frag.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284938 4 -rw-r--r-- 1 ubuntu ubuntu 1272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/blobhash.h 2024-03-27T21:32:58.720 INFO:teuthology.orchestra.run.smithi063.stdout: 284978 4 -rw-r--r-- 1 ubuntu ubuntu 640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/event_type.h 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 285020 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/radosstriper 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 285022 8 -rw-r--r-- 1 ubuntu ubuntu 7815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/radosstriper/libradosstriper.hpp 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 285021 24 -rw-r--r-- 1 ubuntu ubuntu 21367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/radosstriper/libradosstriper.h 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 285032 4 -rw-r--r-- 1 ubuntu ubuntu 1133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/sock_compat.h 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 284941 4 -rw-r--r-- 1 ubuntu ubuntu 288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/buffer_fwd.h 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 285033 4 -rw-r--r-- 1 ubuntu ubuntu 1725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/spinlock.h 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 284991 4 -rw-r--r-- 1 ubuntu ubuntu 3294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/krbd.h 2024-03-27T21:32:58.721 INFO:teuthology.orchestra.run.smithi063.stdout: 284989 20 -rw-r--r-- 1 ubuntu ubuntu 19553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/interval_set.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285050 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285051 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/arpa 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285052 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/arpa/inet.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285056 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/netdb.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285073 4 -rw-r--r-- 1 ubuntu ubuntu 683 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/winsock_wrapper.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285071 4 -rw-r--r-- 1 ubuntu ubuntu 1204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/winioctl_compat.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285053 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/dlfcn.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285072 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/winsock_compat.h 2024-03-27T21:32:58.722 INFO:teuthology.orchestra.run.smithi063.stdout: 285069 4 -rw-r--r-- 1 ubuntu ubuntu 2597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/syslog.h 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285057 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/netinet 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285058 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/netinet/in.h 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285059 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/netinet/ip.h 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285060 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/netinet/tcp.h 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285070 4 -rw-r--r-- 1 ubuntu ubuntu 2671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/win32_errno.h 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285054 4 -rw-r--r-- 1 ubuntu ubuntu 1069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/fs_compat.h 2024-03-27T21:32:58.723 INFO:teuthology.orchestra.run.smithi063.stdout: 285061 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/poll.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285055 4 -rw-r--r-- 1 ubuntu ubuntu 1100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/ifaddrs.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285062 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285065 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys/socket.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285064 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys/select.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285063 4 -rw-r--r-- 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys/errno.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285067 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys/uio.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285068 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys/un.h 2024-03-27T21:32:58.724 INFO:teuthology.orchestra.run.smithi063.stdout: 285066 4 -rw-r--r-- 1 ubuntu ubuntu 734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/win32/sys/statvfs.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 284945 12 -rw-r--r-- 1 ubuntu ubuntu 11741 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ceph_features.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 284934 4 -rw-r--r-- 1 ubuntu ubuntu 525 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/addr_parsing.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 284960 12 -rw-r--r-- 1 ubuntu ubuntu 11144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/compat.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 284933 4 -rw-r--r-- 1 ubuntu ubuntu 1418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/Distribution.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 284946 4 -rw-r--r-- 1 ubuntu ubuntu 3114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ceph_frag.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 285037 8 -rw-r--r-- 1 ubuntu ubuntu 6044 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/str_map.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 284988 4 -rw-r--r-- 1 ubuntu ubuntu 2630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/intarith.h 2024-03-27T21:32:58.725 INFO:teuthology.orchestra.run.smithi063.stdout: 285002 8 -rw-r--r-- 1 ubuntu ubuntu 5506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/object.h 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285025 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rbd 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285027 68 -rw-r--r-- 1 ubuntu ubuntu 67649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rbd/librbd.h 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285026 8 -rw-r--r-- 1 ubuntu ubuntu 6383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rbd/features.h 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285028 36 -rw-r--r-- 1 ubuntu ubuntu 32889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rbd/librbd.hpp 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285029 4 -rw-r--r-- 1 ubuntu ubuntu 426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rbd/object_map_types.h 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285038 4 -rw-r--r-- 1 ubuntu ubuntu 625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/stringify.h 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 285003 4 -rw-r--r-- 1 ubuntu ubuntu 1043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/on_exit.h 2024-03-27T21:32:58.726 INFO:teuthology.orchestra.run.smithi063.stdout: 284980 8 -rw-r--r-- 1 ubuntu ubuntu 6138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/filepath.h 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284994 8 -rw-r--r-- 1 ubuntu ubuntu 5647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/lru.h 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284973 4 -rw-r--r-- 1 ubuntu ubuntu 1234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/dlfcn_compat.h 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284935 4 -rw-r--r-- 1 ubuntu ubuntu 2562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/alloc_ptr.h 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284943 4 -rw-r--r-- 1 ubuntu ubuntu 1137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/byteorder.h 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284944 8 -rw-r--r-- 1 ubuntu ubuntu 5066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ceph_assert.h 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284997 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/neorados 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284998 64 -rw-r--r-- 1 ubuntu ubuntu 61805 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/neorados/RADOS.hpp 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 284999 4 -rw-r--r-- 1 ubuntu ubuntu 2073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/neorados/RADOS_Decodable.hpp 2024-03-27T21:32:58.727 INFO:teuthology.orchestra.run.smithi063.stdout: 285000 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/neorados/buffer_fwd.h -> ../buffer_fwd.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 285001 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/neorados/completion.h -> ../../common/async/completion.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 285030 8 -rw-r--r-- 1 ubuntu ubuntu 4766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/rbd_types.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 284982 8 -rw-r--r-- 1 ubuntu ubuntu 5176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/fs_types.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 284947 40 -rw-r--r-- 1 ubuntu ubuntu 37413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ceph_fs.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 284948 4 -rw-r--r-- 1 ubuntu ubuntu 1529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/ceph_fuse.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 285044 4 -rw-r--r-- 1 ubuntu ubuntu 3494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/util.h 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 284983 64 -rw-r--r-- 1 ubuntu ubuntu 62171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/function2.hpp 2024-03-27T21:32:58.728 INFO:teuthology.orchestra.run.smithi063.stdout: 284956 4 -rw-r--r-- 1 ubuntu ubuntu 309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/color.h 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 284940 36 -rw-r--r-- 1 ubuntu ubuntu 36350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/buffer.h 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 285041 4 -rw-r--r-- 1 ubuntu ubuntu 173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/include/unordered_map.h 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 283406 8 -rwxr-xr-x 1 ubuntu ubuntu 4160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-post-file.in 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 283699 8 -rw-r--r-- 1 ubuntu ubuntu 7183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_mds.cc 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 286121 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 286170 32 -rw-r--r-- 1 ubuntu ubuntu 31002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/OSDMonitor.h 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 286127 12 -rw-r--r-- 1 ubuntu ubuntu 8929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ConfigMap.cc 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 286154 8 -rw-r--r-- 1 ubuntu ubuntu 6644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonCap.h 2024-03-27T21:32:58.729 INFO:teuthology.orchestra.run.smithi063.stdout: 286131 12 -rw-r--r-- 1 ubuntu ubuntu 12084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ConnectionTracker.cc 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286163 4 -rw-r--r-- 1 ubuntu ubuntu 1466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonSub.h 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286168 4 -rw-r--r-- 1 ubuntu ubuntu 3239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonmapMonitor.h 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286148 20 -rw-r--r-- 1 ubuntu ubuntu 19485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MgrMap.h 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286124 4 -rw-r--r-- 1 ubuntu ubuntu 965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/CMakeLists.txt 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286123 12 -rw-r--r-- 1 ubuntu ubuntu 8826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/AuthMonitor.h 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286147 8 -rw-r--r-- 1 ubuntu ubuntu 5035 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MDSMonitor.h 2024-03-27T21:32:58.730 INFO:teuthology.orchestra.run.smithi063.stdout: 286176 16 -rw-r--r-- 1 ubuntu ubuntu 14075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/PaxosService.cc 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286156 24 -rw-r--r-- 1 ubuntu ubuntu 22712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonClient.h 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286140 28 -rw-r--r-- 1 ubuntu ubuntu 24732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/HealthMonitor.cc 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286178 8 -rw-r--r-- 1 ubuntu ubuntu 8043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Session.h 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286172 20 -rw-r--r-- 1 ubuntu ubuntu 18840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/PGMap.h 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286146 76 -rw-r--r-- 1 ubuntu ubuntu 74317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MDSMonitor.cc 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286136 24 -rw-r--r-- 1 ubuntu ubuntu 24473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Elector.cc 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286177 28 -rw-r--r-- 1 ubuntu ubuntu 26265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/PaxosService.h 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286133 8 -rw-r--r-- 1 ubuntu ubuntu 7095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/CreatingPGs.h 2024-03-27T21:32:58.731 INFO:teuthology.orchestra.run.smithi063.stdout: 286157 8 -rw-r--r-- 1 ubuntu ubuntu 5427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonCommand.h 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286165 36 -rw-r--r-- 1 ubuntu ubuntu 36380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Monitor.h 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286144 36 -rw-r--r-- 1 ubuntu ubuntu 35966 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/LogMonitor.cc 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286122 64 -rw-r--r-- 1 ubuntu ubuntu 62848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/AuthMonitor.cc 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286155 60 -rw-r--r-- 1 ubuntu ubuntu 58331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonClient.cc 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286173 48 -rw-r--r-- 1 ubuntu ubuntu 47542 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Paxos.cc 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286150 8 -rw-r--r-- 1 ubuntu ubuntu 4401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MgrMonitor.h 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286145 8 -rw-r--r-- 1 ubuntu ubuntu 6236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/LogMonitor.h 2024-03-27T21:32:58.732 INFO:teuthology.orchestra.run.smithi063.stdout: 286181 8 -rw-r--r-- 1 ubuntu ubuntu 4914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/health_check.h 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286141 4 -rw-r--r-- 1 ubuntu ubuntu 2202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/HealthMonitor.h 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286138 60 -rw-r--r-- 1 ubuntu ubuntu 59504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/FSCommands.cc 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286135 20 -rw-r--r-- 1 ubuntu ubuntu 16840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ElectionLogic.h 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286128 8 -rw-r--r-- 1 ubuntu ubuntu 4504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ConfigMap.h 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286166 24 -rw-r--r-- 1 ubuntu ubuntu 22848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonitorDBStore.h 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286143 4 -rw-r--r-- 1 ubuntu ubuntu 1945 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/KVMonitor.h 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286125 4 -rw-r--r-- 1 ubuntu ubuntu 1083 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/CommandHandler.cc 2024-03-27T21:32:58.733 INFO:teuthology.orchestra.run.smithi063.stdout: 286175 4 -rw-r--r-- 1 ubuntu ubuntu 1354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/PaxosFSMap.h 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286137 16 -rw-r--r-- 1 ubuntu ubuntu 12433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Elector.h 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286152 4 -rw-r--r-- 1 ubuntu ubuntu 3045 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MgrStatMonitor.h 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286130 4 -rw-r--r-- 1 ubuntu ubuntu 1565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ConfigMonitor.h 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286153 28 -rw-r--r-- 1 ubuntu ubuntu 25669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonCap.cc 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286161 8 -rw-r--r-- 1 ubuntu ubuntu 5816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonOpRequest.h 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286151 12 -rw-r--r-- 1 ubuntu ubuntu 10479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MgrStatMonitor.cc 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286167 48 -rw-r--r-- 1 ubuntu ubuntu 45896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonmapMonitor.cc 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286179 4 -rw-r--r-- 1 ubuntu ubuntu 2260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/error_code.cc 2024-03-27T21:32:58.734 INFO:teuthology.orchestra.run.smithi063.stdout: 286160 16 -rw-r--r-- 1 ubuntu ubuntu 15785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonMap.h 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286159 32 -rw-r--r-- 1 ubuntu ubuntu 31027 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonMap.cc 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286158 60 -rw-r--r-- 1 ubuntu ubuntu 58335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonCommands.h 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286171 132 -rw-r--r-- 1 ubuntu ubuntu 132075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/PGMap.cc 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286132 8 -rw-r--r-- 1 ubuntu ubuntu 6799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ConnectionTracker.h 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286162 4 -rw-r--r-- 1 ubuntu ubuntu 2688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MonSub.cc 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286139 4 -rw-r--r-- 1 ubuntu ubuntu 2100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/FSCommands.h 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286164 208 -rw-r--r-- 1 ubuntu ubuntu 210520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Monitor.cc 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286169 476 -rw-r--r-- 1 ubuntu ubuntu 483479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/OSDMonitor.cc 2024-03-27T21:32:58.735 INFO:teuthology.orchestra.run.smithi063.stdout: 286129 28 -rw-r--r-- 1 ubuntu ubuntu 26529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ConfigMonitor.cc 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286126 4 -rw-r--r-- 1 ubuntu ubuntu 823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/CommandHandler.h 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286174 44 -rw-r--r-- 1 ubuntu ubuntu 43642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/Paxos.h 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286149 44 -rw-r--r-- 1 ubuntu ubuntu 43269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/MgrMonitor.cc 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286180 4 -rw-r--r-- 1 ubuntu ubuntu 1230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/error_code.h 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286134 20 -rw-r--r-- 1 ubuntu ubuntu 17879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/ElectionLogic.cc 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286142 16 -rw-r--r-- 1 ubuntu ubuntu 12341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/KVMonitor.cc 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286182 20 -rw-r--r-- 1 ubuntu ubuntu 20114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mon/mon_types.h 2024-03-27T21:32:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 286193 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286194 4 -rw-r--r-- 1 ubuntu ubuntu 1849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/CMakeLists.txt 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286291 4 -rw-r--r-- 1 ubuntu ubuntu 654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/msg_fmt.h 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286292 12 -rw-r--r-- 1 ubuntu ubuntu 10069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/msg_types.cc 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286197 8 -rw-r--r-- 1 ubuntu ubuntu 6999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/DispatchQueue.cc 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286206 4 -rw-r--r-- 1 ubuntu ubuntu 2806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/SimplePolicyMessenger.h 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286289 4 -rw-r--r-- 1 ubuntu ubuntu 3797 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/compressor_registry.cc 2024-03-27T21:32:58.737 INFO:teuthology.orchestra.run.smithi063.stdout: 286203 4 -rw-r--r-- 1 ubuntu ubuntu 3152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Messenger.cc 2024-03-27T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stdout: 286205 8 -rw-r--r-- 1 ubuntu ubuntu 4232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Policy.h 2024-03-27T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stdout: 286207 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async 2024-03-27T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stdout: 286225 4 -rw-r--r-- 1 ubuntu ubuntu 3665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/Protocol.h 2024-03-27T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stdout: 286236 8 -rw-r--r-- 1 ubuntu ubuntu 4123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/crypto_onwire.h 2024-03-27T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stdout: 286217 4 -rw-r--r-- 1 ubuntu ubuntu 1614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventKqueue.h 2024-03-27T21:32:58.738 INFO:teuthology.orchestra.run.smithi063.stdout: 286208 28 -rw-r--r-- 1 ubuntu ubuntu 24932 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/AsyncConnection.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286224 4 -rw-r--r-- 1 ubuntu ubuntu 340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/Protocol.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286220 4 -rw-r--r-- 1 ubuntu ubuntu 2356 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventSelect.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286226 88 -rw-r--r-- 1 ubuntu ubuntu 88685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/ProtocolV1.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286210 28 -rw-r--r-- 1 ubuntu ubuntu 26848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/AsyncMessenger.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286277 32 -rw-r--r-- 1 ubuntu ubuntu 30923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/frames_v2.h 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286235 12 -rw-r--r-- 1 ubuntu ubuntu 9742 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/crypto_onwire.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286216 8 -rw-r--r-- 1 ubuntu ubuntu 8181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventKqueue.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286214 8 -rw-r--r-- 1 ubuntu ubuntu 4238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventEpoll.cc 2024-03-27T21:32:58.739 INFO:teuthology.orchestra.run.smithi063.stdout: 286211 12 -rw-r--r-- 1 ubuntu ubuntu 11699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/AsyncMessenger.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286213 8 -rw-r--r-- 1 ubuntu ubuntu 7469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/Event.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286233 4 -rw-r--r-- 1 ubuntu ubuntu 2397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/compression_onwire.cc 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286223 4 -rw-r--r-- 1 ubuntu ubuntu 1594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/PosixStack.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286237 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286252 8 -rw-r--r-- 1 ubuntu ubuntu 4892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/PacketUtil.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286247 12 -rw-r--r-- 1 ubuntu ubuntu 11881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/IP.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286268 4 -rw-r--r-- 1 ubuntu ubuntu 2941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/ip_types.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286271 4 -rw-r--r-- 1 ubuntu ubuntu 2210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/queue.h 2024-03-27T21:32:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 286275 4 -rw-r--r-- 1 ubuntu ubuntu 2478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/transfer.h 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286259 4 -rw-r--r-- 1 ubuntu ubuntu 1518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/array_map.h 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286250 8 -rw-r--r-- 1 ubuntu ubuntu 4497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/Packet.cc 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286254 32 -rw-r--r-- 1 ubuntu ubuntu 29016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/TCP.cc 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286256 4 -rw-r--r-- 1 ubuntu ubuntu 3333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/UserspaceEvent.cc 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286257 4 -rw-r--r-- 1 ubuntu ubuntu 2557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/UserspaceEvent.h 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286238 4 -rw-r--r-- 1 ubuntu ubuntu 2433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/ARP.cc 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286244 4 -rw-r--r-- 1 ubuntu ubuntu 2059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/EventDPDK.cc 2024-03-27T21:32:58.741 INFO:teuthology.orchestra.run.smithi063.stdout: 286245 4 -rw-r--r-- 1 ubuntu ubuntu 1152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/EventDPDK.h 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286241 28 -rw-r--r-- 1 ubuntu ubuntu 27139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/DPDK.h 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286240 48 -rw-r--r-- 1 ubuntu ubuntu 45791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/DPDK.cc 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286246 16 -rw-r--r-- 1 ubuntu ubuntu 14372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/IP.cc 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286253 4 -rw-r--r-- 1 ubuntu ubuntu 1266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/TCP-Stack.h 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286269 8 -rw-r--r-- 1 ubuntu ubuntu 6704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/net.cc 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286262 12 -rw-r--r-- 1 ubuntu ubuntu 10157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/circular_buffer.h 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286274 4 -rw-r--r-- 1 ubuntu ubuntu 3507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/toeplitz.h 2024-03-27T21:32:58.742 INFO:teuthology.orchestra.run.smithi063.stdout: 286255 48 -rw-r--r-- 1 ubuntu ubuntu 46417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/TCP.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286273 8 -rw-r--r-- 1 ubuntu ubuntu 4223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/stream.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286265 4 -rw-r--r-- 1 ubuntu ubuntu 2314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/dpdk_rte.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286261 4 -rw-r--r-- 1 ubuntu ubuntu 1259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/capture.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286258 4 -rw-r--r-- 1 ubuntu ubuntu 1575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/align.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286270 8 -rw-r--r-- 1 ubuntu ubuntu 4196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/net.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286242 12 -rw-r--r-- 1 ubuntu ubuntu 9216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/DPDKStack.cc 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286249 4 -rw-r--r-- 1 ubuntu ubuntu 1807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/IPChecksum.h 2024-03-27T21:32:58.743 INFO:teuthology.orchestra.run.smithi063.stdout: 286239 12 -rw-r--r-- 1 ubuntu ubuntu 8248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/ARP.h 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286272 12 -rw-r--r-- 1 ubuntu ubuntu 11638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/shared_ptr.h 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286251 20 -rw-r--r-- 1 ubuntu ubuntu 17562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/Packet.h 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286266 4 -rw-r--r-- 1 ubuntu ubuntu 338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/ethernet.cc 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286264 8 -rw-r--r-- 1 ubuntu ubuntu 5671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/dpdk_rte.cc 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286260 4 -rw-r--r-- 1 ubuntu ubuntu 2043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/byteorder.h 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286267 4 -rw-r--r-- 1 ubuntu ubuntu 2297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/ethernet.h 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286248 4 -rw-r--r-- 1 ubuntu ubuntu 2055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/IPChecksum.cc 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286243 8 -rw-r--r-- 1 ubuntu ubuntu 7675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/DPDKStack.h 2024-03-27T21:32:58.744 INFO:teuthology.orchestra.run.smithi063.stdout: 286263 4 -rw-r--r-- 1 ubuntu ubuntu 1293 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/dpdk/const.h 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286215 4 -rw-r--r-- 1 ubuntu ubuntu 1244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventEpoll.h 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286218 8 -rw-r--r-- 1 ubuntu ubuntu 4904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventPoll.cc 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286229 12 -rw-r--r-- 1 ubuntu ubuntu 10197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/ProtocolV2.h 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286228 100 -rw-r--r-- 1 ubuntu ubuntu 101663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/ProtocolV2.cc 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286227 16 -rw-r--r-- 1 ubuntu ubuntu 12449 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/ProtocolV1.h 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286230 8 -rw-r--r-- 1 ubuntu ubuntu 5235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/Stack.cc 2024-03-27T21:32:58.745 INFO:teuthology.orchestra.run.smithi063.stdout: 286232 4 -rw-r--r-- 1 ubuntu ubuntu 654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/compression_meta.h 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286234 4 -rw-r--r-- 1 ubuntu ubuntu 2561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/compression_onwire.h 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286231 12 -rw-r--r-- 1 ubuntu ubuntu 12199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/Stack.h 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286278 8 -rw-r--r-- 1 ubuntu ubuntu 6550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/net_handler.cc 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286219 4 -rw-r--r-- 1 ubuntu ubuntu 1177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventPoll.h 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286276 20 -rw-r--r-- 1 ubuntu ubuntu 20453 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/frames_v2.cc 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286279 4 -rw-r--r-- 1 ubuntu ubuntu 1432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/net_handler.h 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286209 8 -rw-r--r-- 1 ubuntu ubuntu 7342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/AsyncConnection.h 2024-03-27T21:32:58.746 INFO:teuthology.orchestra.run.smithi063.stdout: 286212 16 -rw-r--r-- 1 ubuntu ubuntu 13688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/Event.cc 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286221 4 -rw-r--r-- 1 ubuntu ubuntu 1205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/EventSelect.h 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286222 12 -rw-r--r-- 1 ubuntu ubuntu 8822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/PosixStack.cc 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286280 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286284 8 -rw-r--r-- 1 ubuntu ubuntu 5671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/RDMAIWARPConnectedSocketImpl.cc 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286282 20 -rw-r--r-- 1 ubuntu ubuntu 17645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/Infiniband.h 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286288 12 -rw-r--r-- 1 ubuntu ubuntu 11697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/RDMAStack.h 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286286 4 -rw-r--r-- 1 ubuntu ubuntu 3787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/RDMAServerSocketImpl.cc 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286281 44 -rw-r--r-- 1 ubuntu ubuntu 41160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/Infiniband.cc 2024-03-27T21:32:58.747 INFO:teuthology.orchestra.run.smithi063.stdout: 286287 28 -rw-r--r-- 1 ubuntu ubuntu 28620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/RDMAStack.cc 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286283 20 -rw-r--r-- 1 ubuntu ubuntu 18298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/RDMAConnectedSocketImpl.cc 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286285 4 -rw-r--r-- 1 ubuntu ubuntu 3772 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/async/rdma/RDMAIWARPServerSocketImpl.cc 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286198 8 -rw-r--r-- 1 ubuntu ubuntu 6715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/DispatchQueue.h 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286204 24 -rw-r--r-- 1 ubuntu ubuntu 23947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Messenger.h 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286200 28 -rw-r--r-- 1 ubuntu ubuntu 28330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Message.cc 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286195 4 -rw-r--r-- 1 ubuntu ubuntu 550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Connection.cc 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286201 20 -rw-r--r-- 1 ubuntu ubuntu 19531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Message.h 2024-03-27T21:32:58.748 INFO:teuthology.orchestra.run.smithi063.stdout: 286290 4 -rw-r--r-- 1 ubuntu ubuntu 1838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/compressor_registry.h 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 286202 8 -rw-r--r-- 1 ubuntu ubuntu 4134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/MessageRef.h 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 286199 8 -rw-r--r-- 1 ubuntu ubuntu 8187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Dispatcher.h 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 286293 24 -rw-r--r-- 1 ubuntu ubuntu 23101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/msg_types.h 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 286196 8 -rw-r--r-- 1 ubuntu ubuntu 7256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/msg/Connection.h 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 283996 4 -rw-r--r-- 1 ubuntu ubuntu 1223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls_acl.cc 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 285730 4 -rwxr-xr-x 1 ubuntu ubuntu 624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/loadclass.sh 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 283998 4 -rwxr-xr-x 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cmonctl 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 289037 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_fuse 2024-03-27T21:32:58.749 INFO:teuthology.orchestra.run.smithi063.stdout: 289038 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_fuse/CMakeLists.txt 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 289039 24 -rw-r--r-- 1 ubuntu ubuntu 21241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_fuse/rbd-fuse.cc 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 286296 4 -rwxr-xr-x 1 ubuntu ubuntu 2364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/multi-dump.sh 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 289034 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/qatlib 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 291439 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/utf8proc 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 289036 4 -rwxr-xr-x 1 ubuntu ubuntu 2070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd-replay-many 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 284822 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 284833 4 -rw-r--r-- 1 ubuntu ubuntu 1806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/mon-wishlist.txt 2024-03-27T21:32:58.750 INFO:teuthology.orchestra.run.smithi063.stdout: 284827 4 -rw-r--r-- 1 ubuntu ubuntu 296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/inos.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284824 16 -rw-r--r-- 1 ubuntu ubuntu 13872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/caching.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284834 4 -rw-r--r-- 1 ubuntu ubuntu 1486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/rgw.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284825 8 -rw-r--r-- 1 ubuntu ubuntu 5685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/dynamic-throttle.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284835 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/rgw 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284836 12 -rw-r--r-- 1 ubuntu ubuntu 9096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/rgw/multisite-reshard.md 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284823 4 -rw-r--r-- 1 ubuntu ubuntu 788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/Commitdir.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284829 4 -rw-r--r-- 1 ubuntu ubuntu 1537 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/lazy_posix.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284832 4 -rw-r--r-- 1 ubuntu ubuntu 1373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/mon-janitorial-queue.txt 2024-03-27T21:32:58.751 INFO:teuthology.orchestra.run.smithi063.stdout: 284831 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/modeline.txt 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 284826 4 -rw-r--r-- 1 ubuntu ubuntu 428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/header.txt 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 284830 4 -rw-r--r-- 1 ubuntu ubuntu 2997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/mds_locks.txt 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 284828 4 -rw-r--r-- 1 ubuntu ubuntu 1711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/doc/killpoints.txt 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 283289 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/README 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 285186 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 285202 84 -rw-r--r-- 1 ubuntu ubuntu 83039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_cxx.cc 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 285191 4 -rw-r--r-- 1 ubuntu ubuntu 2482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/ListObjectImpl.h 2024-03-27T21:32:58.752 INFO:teuthology.orchestra.run.smithi063.stdout: 285188 4 -rw-r--r-- 1 ubuntu ubuntu 1271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/CMakeLists.txt 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285203 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_tp.cc 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285205 4 -rw-r--r-- 1 ubuntu ubuntu 780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_util.h 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285189 60 -rw-r--r-- 1 ubuntu ubuntu 60127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/IoCtxImpl.cc 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285197 4 -rw-r--r-- 1 ubuntu ubuntu 933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/RadosXattrIter.h 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285195 8 -rw-r--r-- 1 ubuntu ubuntu 6555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/RadosClient.h 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285204 4 -rw-r--r-- 1 ubuntu ubuntu 2228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_util.cc 2024-03-27T21:32:58.753 INFO:teuthology.orchestra.run.smithi063.stdout: 285206 8 -rw-r--r-- 1 ubuntu ubuntu 4112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/snap_set_diff.cc 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285190 12 -rw-r--r-- 1 ubuntu ubuntu 12196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/IoCtxImpl.h 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285198 4 -rw-r--r-- 1 ubuntu ubuntu 2108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados.map 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285194 32 -rw-r--r-- 1 ubuntu ubuntu 28914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/RadosClient.cc 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285200 148 -rw-r--r-- 1 ubuntu ubuntu 150658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_c.cc 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285196 4 -rw-r--r-- 1 ubuntu ubuntu 645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/RadosXattrIter.cc 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285201 4 -rw-r--r-- 1 ubuntu ubuntu 636 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_c.h 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285207 4 -rw-r--r-- 1 ubuntu ubuntu 555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/snap_set_diff.h 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285199 12 -rw-r--r-- 1 ubuntu ubuntu 8556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/librados_asio.h 2024-03-27T21:32:58.754 INFO:teuthology.orchestra.run.smithi063.stdout: 285192 4 -rw-r--r-- 1 ubuntu ubuntu 677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/ObjectOperationImpl.h 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285193 4 -rw-r--r-- 1 ubuntu ubuntu 2529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/PoolAsyncCompletionImpl.h 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285187 8 -rw-r--r-- 1 ubuntu ubuntu 5013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados/AioCompletionImpl.h 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285170 4 -rw-r--r-- 1 ubuntu ubuntu 278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/CMakeLists.txt 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285177 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/rocksdb_cache 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285179 16 -rw-r--r-- 1 ubuntu ubuntu 12504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/rocksdb_cache/BinnedLRUCache.h 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285180 8 -rw-r--r-- 1 ubuntu ubuntu 5696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/rocksdb_cache/ShardedCache.cc 2024-03-27T21:32:58.755 INFO:teuthology.orchestra.run.smithi063.stdout: 285178 24 -rw-r--r-- 1 ubuntu ubuntu 20729 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/rocksdb_cache/BinnedLRUCache.cc 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285181 8 -rw-r--r-- 1 ubuntu ubuntu 7596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/rocksdb_cache/ShardedCache.h 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285174 4 -rw-r--r-- 1 ubuntu ubuntu 999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/KeyValueHistogram.h 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285173 4 -rw-r--r-- 1 ubuntu ubuntu 2392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/KeyValueHistogram.cc 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285171 4 -rw-r--r-- 1 ubuntu ubuntu 603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/KeyValueDB.cc 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285176 20 -rw-r--r-- 1 ubuntu ubuntu 18549 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/RocksDBStore.h 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285172 16 -rw-r--r-- 1 ubuntu ubuntu 14552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/KeyValueDB.h 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 285175 104 -rw-r--r-- 1 ubuntu ubuntu 105857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/kv/RocksDBStore.cc 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 286192 4 -rwxr-xr-x 1 ubuntu ubuntu 874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mrun 2024-03-27T21:32:58.756 INFO:teuthology.orchestra.run.smithi063.stdout: 283388 4 -rwxr-xr-x 1 ubuntu ubuntu 231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-create-keys 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289605 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289640 4 -rwxr-xr-x 1 ubuntu ubuntu 3805 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/run_tox.sh 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289617 4 -rwxr-xr-x 1 ubuntu ubuntu 495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/check_commands.sh 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289622 4 -rwxr-xr-x 1 ubuntu ubuntu 2394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/credits.sh 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289624 4 -rwxr-xr-x 1 ubuntu ubuntu 690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/find_dups_in_pg_log.sh 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289606 4 -rw-r--r-- 1 ubuntu ubuntu 264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/CMakeLists.txt 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289637 4 -rwxr-xr-x 1 ubuntu ubuntu 789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/run-coverity 2024-03-27T21:32:58.757 INFO:teuthology.orchestra.run.smithi063.stdout: 289625 4 -rwxr-xr-x 1 ubuntu ubuntu 668 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/fix_modeline.pl 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289642 4 -rwxr-xr-x 1 ubuntu ubuntu 1613 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/set_up_stretch_mode.sh 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289612 8 -rwxr-xr-x 1 ubuntu ubuntu 4141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/build-integration-branch 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289608 4 -rwxr-xr-x 1 ubuntu ubuntu 896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/add_osd.sh 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289647 4 -rwxr-xr-x 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/unhexdump-C 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289629 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/kubejacker 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289632 4 -rwxr-xr-x 1 ubuntu ubuntu 2665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/kubejacker/kubejacker.sh 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289631 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/kubejacker/README.rst 2024-03-27T21:32:58.758 INFO:teuthology.orchestra.run.smithi063.stdout: 289630 4 -rw-r--r-- 1 ubuntu ubuntu 520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/kubejacker/Dockerfile 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289613 64 -rwxr-xr-x 1 ubuntu ubuntu 63497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/ceph-backport.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289627 4 -rwxr-xr-x 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/kcon_all.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289623 4 -rwxr-xr-x 1 ubuntu ubuntu 318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/extend_stretch_cluster.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289643 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/smr_benchmark 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289645 4 -rwxr-xr-x 1 ubuntu ubuntu 1789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/smr_benchmark/linearSMRCopy.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289644 4 -rwxr-xr-x 1 ubuntu ubuntu 1898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/smr_benchmark/linearCopy.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289628 4 -rwxr-xr-x 1 ubuntu ubuntu 435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/kcon_most.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289646 4 -rwxr-xr-x 1 ubuntu ubuntu 63 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/strip_trailing_whitespace.sh 2024-03-27T21:32:58.759 INFO:teuthology.orchestra.run.smithi063.stdout: 289619 8 -rwxr-xr-x 1 ubuntu ubuntu 6172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/cpatch 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289614 8 -rwxr-xr-x 1 ubuntu ubuntu 6387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/ceph-debug-docker.sh 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289636 8 -rwxr-xr-x 1 ubuntu ubuntu 4207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/run-cbt.sh 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289634 16 -rwxr-xr-x 1 ubuntu ubuntu 15763 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/ptl-tool.py 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289610 32 -rwxr-xr-x 1 ubuntu ubuntu 29767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/backport-resolve-issue 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289607 4 -rwxr-xr-x 1 ubuntu ubuntu 446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/add_header.pl 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289633 4 -rwxr-xr-x 1 ubuntu ubuntu 3031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/lib-build.sh 2024-03-27T21:32:58.760 INFO:teuthology.orchestra.run.smithi063.stdout: 289611 4 -rwxr-xr-x 1 ubuntu ubuntu 445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/bdev_grep.pl 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289639 4 -rwxr-xr-x 1 ubuntu ubuntu 2880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/run_mypy.sh 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289616 4 -rw-r--r-- 1 ubuntu ubuntu 3710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/ceph_dump_log.py 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289626 4 -rwxr-xr-x 1 ubuntu ubuntu 2323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/gen-corpus.sh 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289641 8 -rwxr-xr-x 1 ubuntu ubuntu 6622 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/run_uml.sh 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289638 8 -rwxr-xr-x 1 ubuntu ubuntu 5333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/run-make.sh 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289635 4 -rw-r--r-- 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/requirements.backport-create-issue.txt 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289618 4 -rw-r--r-- 1 ubuntu ubuntu 1003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/cmake_uninstall.cmake.in 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289620 24 -rwxr-xr-x 1 ubuntu ubuntu 22900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/cpatch.py 2024-03-27T21:32:58.761 INFO:teuthology.orchestra.run.smithi063.stdout: 289615 16 -rwxr-xr-x 1 ubuntu ubuntu 15096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/ceph-release-notes 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 289609 20 -rwxr-xr-x 1 ubuntu ubuntu 17007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/backport-create-issue 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 289621 4 -rwxr-xr-x 1 ubuntu ubuntu 223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/script/crash_bdev.sh 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 286314 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 286323 4 -rw-r--r-- 1 ubuntu ubuntu 1526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/SequencerPosition.h 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 286322 28 -rw-r--r-- 1 ubuntu ubuntu 25191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/ObjectStore.h 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 286318 32 -rw-r--r-- 1 ubuntu ubuntu 29220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/FuseStore.cc 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 286326 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore 2024-03-27T21:32:58.762 INFO:teuthology.orchestra.run.smithi063.stdout: 286348 4 -rw-r--r-- 1 ubuntu ubuntu 2001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/StupidAllocator.h 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286330 12 -rw-r--r-- 1 ubuntu ubuntu 8339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/AvlAllocator.h 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286331 4 -rw-r--r-- 1 ubuntu ubuntu 3397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BitmapAllocator.cc 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286354 44 -rw-r--r-- 1 ubuntu ubuntu 40975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/bluestore_types.h 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286328 4 -rw-r--r-- 1 ubuntu ubuntu 3806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/Allocator.h 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286347 12 -rw-r--r-- 1 ubuntu ubuntu 9644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/StupidAllocator.cc 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286335 152 -rw-r--r-- 1 ubuntu ubuntu 153986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BlueFS.cc 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286349 8 -rw-r--r-- 1 ubuntu ubuntu 7692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/bluefs_types.cc 2024-03-27T21:32:58.763 INFO:teuthology.orchestra.run.smithi063.stdout: 286338 8 -rw-r--r-- 1 ubuntu ubuntu 6431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BlueRocksEnv.h 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286345 8 -rw-r--r-- 1 ubuntu ubuntu 5593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/HybridAllocator.cc 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286340 140 -rw-r--r-- 1 ubuntu ubuntu 140284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BlueStore.h 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286351 4 -rw-r--r-- 1 ubuntu ubuntu 2198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/bluestore_common.h 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286334 4 -rw-r--r-- 1 ubuntu ubuntu 3122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BitmapFreelistManager.h 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286337 20 -rw-r--r-- 1 ubuntu ubuntu 17782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BlueRocksEnv.cc 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286357 8 -rw-r--r-- 1 ubuntu ubuntu 7889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/simple_bitmap.cc 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286356 24 -rw-r--r-- 1 ubuntu ubuntu 23826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/fastbmap_allocator_impl.h 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286333 20 -rw-r--r-- 1 ubuntu ubuntu 18100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BitmapFreelistManager.cc 2024-03-27T21:32:58.764 INFO:teuthology.orchestra.run.smithi063.stdout: 286352 36 -rw-r--r-- 1 ubuntu ubuntu 35085 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/bluestore_tool.cc 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286346 4 -rw-r--r-- 1 ubuntu ubuntu 1427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/HybridAllocator.h 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286327 12 -rw-r--r-- 1 ubuntu ubuntu 10357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/Allocator.cc 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286339 596 -rw-r--r-- 1 ubuntu ubuntu 609217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BlueStore.cc 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286358 8 -rw-r--r-- 1 ubuntu ubuntu 4928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/simple_bitmap.h 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286355 24 -rw-r--r-- 1 ubuntu ubuntu 21076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/fastbmap_allocator_impl.cc 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286332 4 -rw-r--r-- 1 ubuntu ubuntu 1428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BitmapAllocator.h 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286350 12 -rw-r--r-- 1 ubuntu ubuntu 10011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/bluefs_types.h 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286341 16 -rw-r--r-- 1 ubuntu ubuntu 13970 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BtreeAllocator.cc 2024-03-27T21:32:58.765 INFO:teuthology.orchestra.run.smithi063.stdout: 286342 8 -rw-r--r-- 1 ubuntu ubuntu 5779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BtreeAllocator.h 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286336 28 -rw-r--r-- 1 ubuntu ubuntu 27089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/BlueFS.h 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286343 4 -rw-r--r-- 1 ubuntu ubuntu 1035 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/FreelistManager.cc 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286353 40 -rw-r--r-- 1 ubuntu ubuntu 37631 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/bluestore_types.cc 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286344 4 -rw-r--r-- 1 ubuntu ubuntu 1803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/FreelistManager.h 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286329 16 -rw-r--r-- 1 ubuntu ubuntu 14323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/bluestore/AvlAllocator.cc 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286359 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286364 4 -rw-r--r-- 1 ubuntu ubuntu 1942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/ZFS.cc 2024-03-27T21:32:58.766 INFO:teuthology.orchestra.run.smithi063.stdout: 286363 4 -rw-r--r-- 1 ubuntu ubuntu 677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/XFS.h 2024-03-27T21:32:58.767 INFO:teuthology.orchestra.run.smithi063.stdout: 286360 8 -rw-r--r-- 1 ubuntu ubuntu 4160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/FS.cc 2024-03-27T21:32:58.767 INFO:teuthology.orchestra.run.smithi063.stdout: 286366 8 -rw-r--r-- 1 ubuntu ubuntu 5542 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/btrfs_ioctl.h 2024-03-27T21:32:58.767 INFO:teuthology.orchestra.run.smithi063.stdout: 286362 4 -rw-r--r-- 1 ubuntu ubuntu 1125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/XFS.cc 2024-03-27T21:32:58.767 INFO:teuthology.orchestra.run.smithi063.stdout: 286365 4 -rw-r--r-- 1 ubuntu ubuntu 1039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/ZFS.h 2024-03-27T21:32:58.767 INFO:teuthology.orchestra.run.smithi063.stdout: 286361 4 -rw-r--r-- 1 ubuntu ubuntu 1130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/fs/FS.h 2024-03-27T21:32:58.767 INFO:teuthology.orchestra.run.smithi063.stdout: 286315 4 -rw-r--r-- 1 ubuntu ubuntu 2143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/CMakeLists.txt 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286372 4 -rw-r--r-- 1 ubuntu ubuntu 1461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/kv.h 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286317 20 -rw-r--r-- 1 ubuntu ubuntu 16954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/DBObjectMap.h 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286325 44 -rw-r--r-- 1 ubuntu ubuntu 42229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/Transaction.h 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286324 16 -rw-r--r-- 1 ubuntu ubuntu 15859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/Transaction.cc 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286367 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/kstore 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286369 20 -rw-r--r-- 1 ubuntu ubuntu 19855 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/kstore/KStore.h 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286368 88 -rw-r--r-- 1 ubuntu ubuntu 86404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/kstore/KStore.cc 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286371 4 -rw-r--r-- 1 ubuntu ubuntu 1969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/kstore/kstore_types.h 2024-03-27T21:32:58.768 INFO:teuthology.orchestra.run.smithi063.stdout: 286370 4 -rw-r--r-- 1 ubuntu ubuntu 2522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/kstore/kstore_types.cc 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286320 8 -rw-r--r-- 1 ubuntu ubuntu 6174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/ObjectMap.h 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286321 4 -rw-r--r-- 1 ubuntu ubuntu 2619 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/ObjectStore.cc 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286373 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/memstore 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286376 8 -rw-r--r-- 1 ubuntu ubuntu 7090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/memstore/PageSet.h 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286375 16 -rw-r--r-- 1 ubuntu ubuntu 13614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/memstore/MemStore.h 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286374 48 -rw-r--r-- 1 ubuntu ubuntu 48372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/memstore/MemStore.cc 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286316 40 -rw-r--r-- 1 ubuntu ubuntu 37442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/DBObjectMap.cc 2024-03-27T21:32:58.769 INFO:teuthology.orchestra.run.smithi063.stdout: 286319 4 -rw-r--r-- 1 ubuntu ubuntu 1028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/os/FuseStore.h 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285146 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285151 4 -rw-r--r-- 1 ubuntu ubuntu 2571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_reader.h 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285147 4 -rw-r--r-- 1 ubuntu ubuntu 129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/CMakeLists.txt 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285158 4 -rw-r--r-- 1 ubuntu ubuntu 2364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_writer.h 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285149 4 -rw-r--r-- 1 ubuntu ubuntu 1515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_error_position.h 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285157 4 -rw-r--r-- 1 ubuntu ubuntu 2860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_writer.cpp 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285153 4 -rw-r--r-- 1 ubuntu ubuntu 1794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_stream_reader.h 2024-03-27T21:32:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 285155 4 -rw-r--r-- 1 ubuntu ubuntu 200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_value.cpp 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285152 24 -rw-r--r-- 1 ubuntu ubuntu 22044 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_reader_template.h 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285160 12 -rw-r--r-- 1 ubuntu ubuntu 11217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_writer_template.h 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285159 4 -rw-r--r-- 1 ubuntu ubuntu 1371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_writer_options.h 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285156 16 -rw-r--r-- 1 ubuntu ubuntu 16315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_value.h 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285148 4 -rw-r--r-- 1 ubuntu ubuntu 413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit.h 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285154 4 -rw-r--r-- 1 ubuntu ubuntu 1707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_utils.h 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 285150 8 -rw-r--r-- 1 ubuntu ubuntu 4106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/json_spirit/json_spirit_reader.cpp 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 289654 12 drwxr-xr-x 64 ubuntu ubuntu 12288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test 2024-03-27T21:32:58.771 INFO:teuthology.orchestra.run.smithi063.stdout: 290966 4 -rw-r--r-- 1 ubuntu ubuntu 1144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rewrite_latency.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290937 4 -rw-r--r-- 1 ubuntu ubuntu 3766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_admin_socket_output.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 289703 12 -rw-r--r-- 1 ubuntu ubuntu 9505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ceph_crypto.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290950 4 -rw-r--r-- 1 ubuntu ubuntu 1433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_features.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290130 16 -rw-r--r-- 1 ubuntu ubuntu 12434 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/confutils.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290995 4 -rw-r--r-- 1 ubuntu ubuntu 2326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/utf8.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290997 8 -rw-r--r-- 1 ubuntu ubuntu 5204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/xattr_bench.cc 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290254 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/exporter 2024-03-27T21:32:58.772 INFO:teuthology.orchestra.run.smithi063.stdout: 290255 4 -rw-r--r-- 1 ubuntu ubuntu 274 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/exporter/CMakeLists.txt 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 290256 48 -rw-r--r-- 1 ubuntu ubuntu 45082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/exporter/test_exporter.cc 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 289903 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_numops 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 289904 4 -rw-r--r-- 1 ubuntu ubuntu 340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_numops/CMakeLists.txt 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 289905 12 -rw-r--r-- 1 ubuntu ubuntu 9859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_numops/test_cls_numops.cc 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 289694 4 -rw-r--r-- 1 ubuntu ubuntu 360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/buildtest_skeleton.cc 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 290753 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 290754 4 -rw-r--r-- 1 ubuntu ubuntu 218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/CMakeLists.txt 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 290759 36 -rw-r--r-- 1 ubuntu ubuntu 34339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_cephfs.py 2024-03-27T21:32:58.773 INFO:teuthology.orchestra.run.smithi063.stdout: 290757 68 -rwxr-xr-x 1 ubuntu ubuntu 65789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_ceph_argparse.py 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290762 4 -rw-r--r-- 1 ubuntu ubuntu 3577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rgwfs.py 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290758 4 -rwxr-xr-x 1 ubuntu ubuntu 1401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_ceph_daemon.py 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290760 60 -rw-r--r-- 1 ubuntu ubuntu 57769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rados.py 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290761 104 -rw-r--r-- 1 ubuntu ubuntu 105150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290755 4 -rw-r--r-- 1 ubuntu ubuntu 615 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/assertions.py 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290756 4 -rw-r--r-- 1 ubuntu ubuntu 98 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/pybind/pytest.ini 2024-03-27T21:32:58.774 INFO:teuthology.orchestra.run.smithi063.stdout: 290638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290647 8 -rw-r--r-- 1 ubuntu ubuntu 5005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/test_userspace_event.cc 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290642 12 -rw-r--r-- 1 ubuntu ubuntu 8636 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/test_async_driver.cc 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290641 8 -rw-r--r-- 1 ubuntu ubuntu 5740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/perf_msgr_server.cc 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290644 4 -rw-r--r-- 1 ubuntu ubuntu 3565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/test_comp_registry.cc 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290639 4 -rw-r--r-- 1 ubuntu ubuntu 1786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/CMakeLists.txt 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290643 32 -rw-r--r-- 1 ubuntu ubuntu 31246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/test_async_networkstack.cc 2024-03-27T21:32:58.775 INFO:teuthology.orchestra.run.smithi063.stdout: 290640 8 -rw-r--r-- 1 ubuntu ubuntu 7108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/perf_msgr_client.cc 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 290646 80 -rw-r--r-- 1 ubuntu ubuntu 79949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/test_msgr.cc 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 290645 20 -rw-r--r-- 1 ubuntu ubuntu 19530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/msgr/test_frames_v2.cc 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 289675 4 -rw-r--r-- 1 ubuntu ubuntu 2671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/base64.cc 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 290598 8 -rw-r--r-- 1 ubuntu ubuntu 7245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file.cc 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 289674 4 -rw-r--r-- 1 ubuntu ubuntu 817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/barclass.cc 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 290612 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/memuse 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 290615 4 -rwxr-xr-x 1 ubuntu ubuntu 185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/memuse/test_written_pool_memuse.sh 2024-03-27T21:32:58.776 INFO:teuthology.orchestra.run.smithi063.stdout: 290614 4 -rwxr-xr-x 1 ubuntu ubuntu 465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/memuse/test_pool_memuse_tcmalloc.sh 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290616 4 -rwxr-xr-x 1 ubuntu ubuntu 969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/memuse/test_written_pool_memuse_tcmalloc.sh 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290613 4 -rwxr-xr-x 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/memuse/test_pool_memuse.sh 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mgr 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290619 4 -rwxr-xr-x 1 ubuntu ubuntu 2492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mgr/mgr-dashboard-smoke.sh 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290620 12 -rw-r--r-- 1 ubuntu ubuntu 9787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mgr/test_mgrcap.cc 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290618 4 -rw-r--r-- 1 ubuntu ubuntu 846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mgr/CMakeLists.txt 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290621 4 -rw-r--r-- 1 ubuntu ubuntu 1324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mgr/test_ttlcache.cc 2024-03-27T21:32:58.777 INFO:teuthology.orchestra.run.smithi063.stdout: 290978 4 -rw-r--r-- 1 ubuntu ubuntu 2036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_texttable.cc 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 289882 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_cas 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 289883 4 -rw-r--r-- 1 ubuntu ubuntu 334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_cas/CMakeLists.txt 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 289884 12 -rw-r--r-- 1 ubuntu ubuntu 8706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_cas/test_cls_cas.cc 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 290262 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 290266 4 -rw-r--r-- 1 ubuntu ubuntu 1469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-bluestore.fio 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 290264 4 -rw-r--r-- 1 ubuntu ubuntu 3284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/README.md 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 290269 4 -rw-r--r-- 1 ubuntu ubuntu 549 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-librgw.fio 2024-03-27T21:32:58.778 INFO:teuthology.orchestra.run.smithi063.stdout: 290263 4 -rw-r--r-- 1 ubuntu ubuntu 652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/CMakeLists.txt 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290270 4 -rw-r--r-- 1 ubuntu ubuntu 389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-memstore.conf 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290272 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-messenger.conf 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290267 4 -rw-r--r-- 1 ubuntu ubuntu 554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-filestore.conf 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290265 4 -rw-r--r-- 1 ubuntu ubuntu 451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-bluestore.conf 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290271 4 -rw-r--r-- 1 ubuntu ubuntu 361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-memstore.fio 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290273 4 -rw-r--r-- 1 ubuntu ubuntu 339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-messenger.fio 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290277 4 -rw-r--r-- 1 ubuntu ubuntu 2420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ring_buffer.h 2024-03-27T21:32:58.779 INFO:teuthology.orchestra.run.smithi063.stdout: 290275 32 -rw-r--r-- 1 ubuntu ubuntu 29440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/fio_ceph_objectstore.cc 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290274 20 -rw-r--r-- 1 ubuntu ubuntu 18125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/fio_ceph_messenger.cc 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290276 16 -rw-r--r-- 1 ubuntu ubuntu 15229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/fio_librgw.cc 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290268 4 -rw-r--r-- 1 ubuntu ubuntu 365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fio/ceph-filestore.fio 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290602 16 -rw-r--r-- 1 ubuntu ubuntu 12725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_marker.cc 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290940 12 -rw-r--r-- 1 ubuntu ubuntu 10284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_auth.cc 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290752 32 -rw-r--r-- 1 ubuntu ubuntu 29610 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/perf_local.cc 2024-03-27T21:32:58.780 INFO:teuthology.orchestra.run.smithi063.stdout: 290969 4 -rw-r--r-- 1 ubuntu ubuntu 2885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rgw_ldap.cc 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290253 8 -rw-r--r-- 1 ubuntu ubuntu 4786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/escape.cc 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 289665 8 -rw-r--r-- 1 ubuntu ubuntu 8077 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/TestTimers.cc 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290196 12 -rw-r--r-- 1 ubuntu ubuntu 12034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/daemon_config.cc 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 289672 4 -rw-r--r-- 1 ubuntu ubuntu 3504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket_output_tests.cc 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290671 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290694 4 -rw-r--r-- 1 ubuntu ubuntu 1028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/store_test_fixture.h 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290691 4 -rwxr-xr-x 1 ubuntu ubuntu 2479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/run_test_deferred.sh 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290693 4 -rw-r--r-- 1 ubuntu ubuntu 3519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/store_test_fixture.cc 2024-03-27T21:32:58.781 INFO:teuthology.orchestra.run.smithi063.stdout: 290683 28 -rw-r--r-- 1 ubuntu ubuntu 24785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/allocator_replay_test.cc 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290692 324 -rw-r--r-- 1 ubuntu ubuntu 329085 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/store_test.cc 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290682 4 -rw-r--r-- 1 ubuntu ubuntu 3007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/TestRocksdbOptionParse.cc 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290674 20 -rw-r--r-- 1 ubuntu ubuntu 18859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/Allocator_test.cc 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290701 8 -rw-r--r-- 1 ubuntu ubuntu 4650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_transaction.cc 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290675 8 -rw-r--r-- 1 ubuntu ubuntu 4286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/CMakeLists.txt 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290688 12 -rwxr-xr-x 1 ubuntu ubuntu 8833 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/hybrid_allocator_test.cc 2024-03-27T21:32:58.782 INFO:teuthology.orchestra.run.smithi063.stdout: 290696 52 -rw-r--r-- 1 ubuntu ubuntu 49969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_bluefs.cc 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290679 12 -rw-r--r-- 1 ubuntu ubuntu 9053 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/ObjectStoreTransactionBenchmark.cc 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290689 8 -rwxr-xr-x 1 ubuntu ubuntu 7659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/run_seed_to.sh 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290673 12 -rw-r--r-- 1 ubuntu ubuntu 9803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/Allocator_bench.cc 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290672 16 -rwxr-xr-x 1 ubuntu ubuntu 13776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/Allocator_aging_fragmentation.cc 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290699 36 -rw-r--r-- 1 ubuntu ubuntu 36716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_kv.cc 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290684 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/allocsim 2024-03-27T21:32:58.783 INFO:teuthology.orchestra.run.smithi063.stdout: 290685 12 -rw-r--r-- 1 ubuntu ubuntu 11520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/allocsim/ops_scraper.py 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290686 16 -rwxr-xr-x 1 ubuntu ubuntu 13425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/allocsim/variable_load.py 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290677 32 -rw-r--r-- 1 ubuntu ubuntu 31188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/ObjectStoreImitator.cc 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290680 8 -rw-r--r-- 1 ubuntu ubuntu 7909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/TestObjectStoreState.cc 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290676 16 -rw-r--r-- 1 ubuntu ubuntu 12368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/Fragmentation_simulator.cc 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290678 16 -rw-r--r-- 1 ubuntu ubuntu 14029 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/ObjectStoreImitator.h 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290681 8 -rw-r--r-- 1 ubuntu ubuntu 4213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/TestObjectStoreState.h 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290700 8 -rw-r--r-- 1 ubuntu ubuntu 5408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_memstore_clone.cc 2024-03-27T21:32:58.784 INFO:teuthology.orchestra.run.smithi063.stdout: 290697 100 -rw-r--r-- 1 ubuntu ubuntu 99986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_bluestore_types.cc 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290698 8 -rw-r--r-- 1 ubuntu ubuntu 4206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_deferred.cc 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290687 40 -rw-r--r-- 1 ubuntu ubuntu 37616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/fastbmap_allocator_test.cc 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290690 4 -rwxr-xr-x 1 ubuntu ubuntu 314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/run_seed_to_range.sh 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290695 4 -rwxr-xr-x 1 ubuntu ubuntu 2725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore/test_bdev.cc 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290186 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290190 4 -rw-r--r-- 1 ubuntu ubuntu 1152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush/crush-choose-args-expected-one-more-3.txt 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290188 44 -rw-r--r-- 1 ubuntu ubuntu 42266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush/CrushWrapper.cc 2024-03-27T21:32:58.785 INFO:teuthology.orchestra.run.smithi063.stdout: 290187 4 -rw-r--r-- 1 ubuntu ubuntu 413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush/CMakeLists.txt 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 290192 4 -rwxr-xr-x 1 ubuntu ubuntu 1507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush/crush_weights.sh 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 290189 4 -rw-r--r-- 1 ubuntu ubuntu 1152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush/crush-choose-args-expected-one-more-0.txt 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 290191 44 -rw-r--r-- 1 ubuntu ubuntu 44543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crush/crush.cc 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 289699 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ceph-erasure-code-tool 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 289700 4 -rwxr-xr-x 1 ubuntu ubuntu 1327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ceph-erasure-code-tool/test_ceph-erasure-code-tool.sh 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 289702 8 -rw-r--r-- 1 ubuntu ubuntu 5161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ceph_compatset.cc 2024-03-27T21:32:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: 289667 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 289669 4 -rw-r--r-- 1 ubuntu ubuntu 787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket/osd_requests 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 289668 4 -rwxr-xr-x 1 ubuntu ubuntu 1639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket/objecter_requests 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290280 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fs 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290282 8 -rw-r--r-- 1 ubuntu ubuntu 5344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fs/mds_types.cc 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290281 4 -rw-r--r-- 1 ubuntu ubuntu 640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fs/CMakeLists.txt 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290283 4 -rw-r--r-- 1 ubuntu ubuntu 1785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fs/test_ino_release_cb.cc 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290284 4 -rw-r--r-- 1 ubuntu ubuntu 1794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fs/test_trim_caps.cc 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290981 4 -rw-r--r-- 1 ubuntu ubuntu 1839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_utime.cc 2024-03-27T21:32:58.787 INFO:teuthology.orchestra.run.smithi063.stdout: 290949 16 -rw-r--r-- 1 ubuntu ubuntu 16370 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_denc.cc 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 289656 28 -rw-r--r-- 1 ubuntu ubuntu 25487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/CMakeLists.txt 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 289695 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/centos-8 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 289698 0 lrwxrwxrwx 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/centos-8/install-deps.sh -> ../../../install-deps.sh 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 289696 4 -rw-r--r-- 1 ubuntu ubuntu 1279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/centos-8/Dockerfile.in 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 289697 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/centos-8/ceph.spec.in -> ../../../ceph.spec.in 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 290962 4 -rwxr-xr-x 1 ubuntu ubuntu 898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_pools.sh 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 290979 4 -rw-r--r-- 1 ubuntu ubuntu 2052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_trans.cc 2024-03-27T21:32:58.788 INFO:teuthology.orchestra.run.smithi063.stdout: 290985 4 -rw-r--r-- 1 ubuntu ubuntu 1032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/testclass.cc 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 290967 56 -rw-r--r-- 1 ubuntu ubuntu 53788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rgw_admin_log.cc 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 290951 4 -rw-r--r-- 1 ubuntu ubuntu 2018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_get_blkdev_props.cc 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 289664 4 -rw-r--r-- 1 ubuntu ubuntu 2911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/TestSignalHandlers.cc 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 290623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 290633 4 -rw-r--r-- 1 ubuntu ubuntu 2348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_log_rss_usage.cc 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 290635 4 -rw-r--r-- 1 ubuntu ubuntu 2132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_mon_rss_usage.cc 2024-03-27T21:32:58.789 INFO:teuthology.orchestra.run.smithi063.stdout: 290624 4 -rw-r--r-- 1 ubuntu ubuntu 2401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/CMakeLists.txt 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290636 4 -rw-r--r-- 1 ubuntu ubuntu 3969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_mon_types.cc 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290628 4 -rwxr-xr-x 1 ubuntu ubuntu 662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/bench_commit.py 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290632 36 -rw-r--r-- 1 ubuntu ubuntu 33536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_election.cc 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290630 12 -rw-r--r-- 1 ubuntu ubuntu 8231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test-mon-msg.cc 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290627 4 -rwxr-xr-x 1 ubuntu ubuntu 3432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/bench_auth.py 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290631 4 -rw-r--r-- 1 ubuntu ubuntu 3374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_config_map.cc 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290625 12 -rw-r--r-- 1 ubuntu ubuntu 8513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/MonMap.cc 2024-03-27T21:32:58.790 INFO:teuthology.orchestra.run.smithi063.stdout: 290626 8 -rw-r--r-- 1 ubuntu ubuntu 6264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/PGMap.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290634 4 -rw-r--r-- 1 ubuntu ubuntu 2276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_mon_memory_target.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290637 28 -rw-r--r-- 1 ubuntu ubuntu 28304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/test_mon_workloadgen.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290629 16 -rw-r--r-- 1 ubuntu ubuntu 13171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mon/moncap.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290982 4 -rw-r--r-- 1 ubuntu ubuntu 2992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_weighted_shuffle.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290964 4 -rw-r--r-- 1 ubuntu ubuntu 3587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_random_string.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290972 36 -rw-r--r-- 1 ubuntu ubuntu 34961 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_snap_mapper.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 289666 20 -rw-r--r-- 1 ubuntu ubuntu 16477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket.cc 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290347 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados 2024-03-27T21:32:58.791 INFO:teuthology.orchestra.run.smithi063.stdout: 290381 8 -rw-r--r-- 1 ubuntu ubuntu 4718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/stat_cxx.cc 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290357 4 -rw-r--r-- 1 ubuntu ubuntu 1812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/cls_remote_reads.cc 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290354 32 -rw-r--r-- 1 ubuntu ubuntu 29256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/c_read_operations.cc 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290377 32 -rw-r--r-- 1 ubuntu ubuntu 30853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/snapshots_cxx.cc 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290368 12 -rw-r--r-- 1 ubuntu ubuntu 9180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/lock.cc 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290348 8 -rw-r--r-- 1 ubuntu ubuntu 6969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/CMakeLists.txt 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290388 4 -rw-r--r-- 1 ubuntu ubuntu 1097 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test_shared.cc 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290387 4 -rw-r--r-- 1 ubuntu ubuntu 882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test_cxx.h 2024-03-27T21:32:58.792 INFO:teuthology.orchestra.run.smithi063.stdout: 290378 12 -rw-r--r-- 1 ubuntu ubuntu 11177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/snapshots_stats.cc 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290349 8 -rw-r--r-- 1 ubuntu ubuntu 5553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/TestCase.cc 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290389 4 -rw-r--r-- 1 ubuntu ubuntu 1456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test_shared.h 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290384 8 -rw-r--r-- 1 ubuntu ubuntu 4246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test_common.cc 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290372 4 -rw-r--r-- 1 ubuntu ubuntu 637 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/op_speed.cc 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290350 4 -rw-r--r-- 1 ubuntu ubuntu 3255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/TestCase.h 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290376 16 -rw-r--r-- 1 ubuntu ubuntu 14249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/snapshots.cc 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290391 4 -rw-r--r-- 1 ubuntu ubuntu 3580 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/testcase_cxx.h 2024-03-27T21:32:58.793 INFO:teuthology.orchestra.run.smithi063.stdout: 290370 12 -rw-r--r-- 1 ubuntu ubuntu 11506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/misc.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290374 8 -rw-r--r-- 1 ubuntu ubuntu 6615 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/service.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290367 24 -rw-r--r-- 1 ubuntu ubuntu 23354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/list_cxx.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290379 12 -rw-r--r-- 1 ubuntu ubuntu 10251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/snapshots_stats_cxx.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290361 4 -rw-r--r-- 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/crimson_utils.h 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290360 4 -rw-r--r-- 1 ubuntu ubuntu 1075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/completion_speed.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290366 20 -rw-r--r-- 1 ubuntu ubuntu 18654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/list.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290358 8 -rw-r--r-- 1 ubuntu ubuntu 7556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/cmd.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290356 4 -rw-r--r-- 1 ubuntu ubuntu 907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/cls.cc 2024-03-27T21:32:58.794 INFO:teuthology.orchestra.run.smithi063.stdout: 290380 8 -rw-r--r-- 1 ubuntu ubuntu 4992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/stat.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290394 16 -rw-r--r-- 1 ubuntu ubuntu 12835 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/watch_notify_cxx.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290355 12 -rw-r--r-- 1 ubuntu ubuntu 10088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/c_write_operations.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290386 8 -rw-r--r-- 1 ubuntu ubuntu 5801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test_cxx.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290375 4 -rw-r--r-- 1 ubuntu ubuntu 3208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/service_cxx.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290392 260 -rw-r--r-- 1 ubuntu ubuntu 263965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/tier_cxx.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290353 12 -rw-r--r-- 1 ubuntu ubuntu 10279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/asio.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290362 16 -rw-r--r-- 1 ubuntu ubuntu 15525 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/io.cc 2024-03-27T21:32:58.795 INFO:teuthology.orchestra.run.smithi063.stdout: 290385 4 -rw-r--r-- 1 ubuntu ubuntu 325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test_common.h 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290382 8 -rw-r--r-- 1 ubuntu ubuntu 5555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test.cc 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290383 4 -rw-r--r-- 1 ubuntu ubuntu 988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/test.h 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290364 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/librados.cc 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290359 4 -rw-r--r-- 1 ubuntu ubuntu 2618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/cmd_cxx.cc 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290369 8 -rw-r--r-- 1 ubuntu ubuntu 7369 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/lock_cxx.cc 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290371 28 -rw-r--r-- 1 ubuntu ubuntu 26649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/misc_cxx.cc 2024-03-27T21:32:58.796 INFO:teuthology.orchestra.run.smithi063.stdout: 290390 12 -rw-r--r-- 1 ubuntu ubuntu 12049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/testcase_cxx.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290351 60 -rw-r--r-- 1 ubuntu ubuntu 58346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/aio.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290352 84 -rw-r--r-- 1 ubuntu ubuntu 82609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/aio_cxx.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290363 32 -rw-r--r-- 1 ubuntu ubuntu 30243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/io_cxx.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290373 8 -rw-r--r-- 1 ubuntu ubuntu 6540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/pool.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290365 4 -rw-r--r-- 1 ubuntu ubuntu 2427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/librados_config.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290393 24 -rw-r--r-- 1 ubuntu ubuntu 22602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados/watch_notify.cc 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 290911 4 -rwxr-xr-x 1 ubuntu ubuntu 1310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/smoke.sh 2024-03-27T21:32:58.797 INFO:teuthology.orchestra.run.smithi063.stdout: 289718 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289840 8 -rw-r--r-- 1 ubuntu ubuntu 4795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/feature-set-unset-list.t 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289844 4 -rw-r--r-- 1 ubuntu ubuntu 992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/rm-nonexistent.t 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289836 4 -rw-r--r-- 1 ubuntu ubuntu 1480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/add-many.t 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289838 4 -rw-r--r-- 1 ubuntu ubuntu 934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/create-print.t 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289837 4 -rw-r--r-- 1 ubuntu ubuntu 1647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/clobber.t 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289835 4 -rw-r--r-- 1 ubuntu ubuntu 1070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/add-exists.t 2024-03-27T21:32:58.798 INFO:teuthology.orchestra.run.smithi063.stdout: 289845 4 -rw-r--r-- 1 ubuntu ubuntu 918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/rm.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289839 4 -rw-r--r-- 1 ubuntu ubuntu 646 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/create-with-add.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289846 4 -rw-r--r-- 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/simple.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289841 4 -rw-r--r-- 1 ubuntu ubuntu 521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/help.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289843 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/print-nonexistent.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289842 4 -rw-r--r-- 1 ubuntu ubuntu 126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/monmaptool/print-empty.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289862 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/radosgw-admin 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289863 28 -rw-r--r-- 1 ubuntu ubuntu 26272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/radosgw-admin/help.t 2024-03-27T21:32:58.799 INFO:teuthology.orchestra.run.smithi063.stdout: 289720 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289727 4 -rw-r--r-- 1 ubuntu ubuntu 393 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/create-gen-list-bin.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289724 4 -rw-r--r-- 1 ubuntu ubuntu 392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/cap-invalid.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289725 4 -rw-r--r-- 1 ubuntu ubuntu 444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/cap-overwrite.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289722 4 -rw-r--r-- 1 ubuntu ubuntu 1034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/add-key.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289730 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/list-empty-bin.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289721 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/add-key-segv.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289734 4 -rw-r--r-- 1 ubuntu ubuntu 944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/manpage.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289732 4 -rw-r--r-- 1 ubuntu ubuntu 243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/list-nonexistent-bin.t 2024-03-27T21:32:58.800 INFO:teuthology.orchestra.run.smithi063.stdout: 289733 4 -rw-r--r-- 1 ubuntu ubuntu 243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/list-nonexistent.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289735 4 -rw-r--r-- 1 ubuntu ubuntu 64 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/simple.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289729 4 -rw-r--r-- 1 ubuntu ubuntu 1540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/help.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289726 4 -rw-r--r-- 1 ubuntu ubuntu 364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/cap.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289723 4 -rw-r--r-- 1 ubuntu ubuntu 245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/cap-bin.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289728 4 -rw-r--r-- 1 ubuntu ubuntu 466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/create-gen-list.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289731 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-authtool/list-empty.t 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289847 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool 2024-03-27T21:32:58.801 INFO:teuthology.orchestra.run.smithi063.stdout: 289852 4 -rw-r--r-- 1 ubuntu ubuntu 721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/crush.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289858 4 -rw-r--r-- 1 ubuntu ubuntu 1523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/test-map-pgs.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289854 4 -rw-r--r-- 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/missing-argument.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289850 4 -rw-r--r-- 1 ubuntu ubuntu 2734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/create-print.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289849 4 -rw-r--r-- 1 ubuntu ubuntu 2156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/clobber.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289855 4 -rw-r--r-- 1 ubuntu ubuntu 1389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/pool.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289851 24 -rw-r--r-- 1 ubuntu ubuntu 23201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/create-racks.t 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289848 32 -rw-r--r-- 1 ubuntu ubuntu 32627 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/ceph.conf.withracks 2024-03-27T21:32:58.802 INFO:teuthology.orchestra.run.smithi063.stdout: 289860 4 -rw-r--r-- 1 ubuntu ubuntu 917 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/upmap-out.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289853 4 -rw-r--r-- 1 ubuntu ubuntu 3137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/help.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289857 4 -rw-r--r-- 1 ubuntu ubuntu 178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/print-nonexistent.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289859 4 -rw-r--r-- 1 ubuntu ubuntu 2615 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/tree.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289856 4 -rw-r--r-- 1 ubuntu ubuntu 131 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/print-empty.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289861 4 -rw-r--r-- 1 ubuntu ubuntu 1326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/osdmaptool/upmap.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289736 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289743 4 -rw-r--r-- 1 ubuntu ubuntu 1333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/show-config-value.t 2024-03-27T21:32:58.803 INFO:teuthology.orchestra.run.smithi063.stdout: 289742 4 -rw-r--r-- 1 ubuntu ubuntu 226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/sections.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289739 4 -rw-r--r-- 1 ubuntu ubuntu 436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/invalid-args.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289740 4 -rw-r--r-- 1 ubuntu ubuntu 731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/manpage.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289745 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/simple.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289738 4 -rw-r--r-- 1 ubuntu ubuntu 1936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/help.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289741 4 -rw-r--r-- 1 ubuntu ubuntu 992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/option.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289737 4 -rw-r--r-- 1 ubuntu ubuntu 591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/env-vs-args.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289744 4 -rw-r--r-- 1 ubuntu ubuntu 441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-conf/show-config.t 2024-03-27T21:32:58.804 INFO:teuthology.orchestra.run.smithi063.stdout: 289748 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289809 4 -rw-r--r-- 1 ubuntu ubuntu 165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/straw2.t 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289819 32 -rw-r--r-- 1 ubuntu ubuntu 31995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-indep.crushmap 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289750 4 -rw-r--r-- 1 ubuntu ubuntu 967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/add-item-in-tree.t 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289820 448 -rw-r--r-- 1 ubuntu ubuntu 454875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-indep.t 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289803 4 -rw-r--r-- 1 ubuntu ubuntu 714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.four 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289784 4 -rw-r--r-- 1 ubuntu ubuntu 550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/missing-bucket.crushmap.txt 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289756 4 -rw-r--r-- 1 ubuntu ubuntu 1950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/build.t 2024-03-27T21:32:58.805 INFO:teuthology.orchestra.run.smithi063.stdout: 289789 24 -rw-r--r-- 1 ubuntu ubuntu 23207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/reclassify.t 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289757 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/check-invalid-map.t 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289805 4 -rw-r--r-- 1 ubuntu ubuntu 1045 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.multitree.reweighted 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289796 4 -rw-r--r-- 1 ubuntu ubuntu 2127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/show-choose-tries.t 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289812 12 -rw-r--r-- 1 ubuntu ubuntu 8958 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-big-1.crushmap 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289826 88 -rw-r--r-- 1 ubuntu ubuntu 90014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-vary-r-0.t 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289831 4 -rw-r--r-- 1 ubuntu ubuntu 3892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-vary-r.crushmap 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289792 4 -rw-r--r-- 1 ubuntu ubuntu 3854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/rules.t 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289827 88 -rw-r--r-- 1 ubuntu ubuntu 90053 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-vary-r-1.t 2024-03-27T21:32:58.806 INFO:teuthology.orchestra.run.smithi063.stdout: 289817 4 -rw-r--r-- 1 ubuntu ubuntu 3386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-hammer-tunables.crushmap 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289830 88 -rw-r--r-- 1 ubuntu ubuntu 90074 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-vary-r-4.t 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289818 312 -rw-r--r-- 1 ubuntu ubuntu 317387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-hammer-tunables.t 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289763 8 -rw-r--r-- 1 ubuntu ubuntu 7191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/choose-args.t 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289823 444 -rw-r--r-- 1 ubuntu ubuntu 454632 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-legacy-tunables.t 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289779 4 -rw-r--r-- 1 ubuntu ubuntu 715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/empty-default.cushmap.txt 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289807 4 -rw-r--r-- 1 ubuntu ubuntu 760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.three 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289816 12 -rw-r--r-- 1 ubuntu ubuntu 9172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-firstn-indep.txt 2024-03-27T21:32:58.807 INFO:teuthology.orchestra.run.smithi063.stdout: 289781 4 -rw-r--r-- 1 ubuntu ubuntu 368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/five-devices.crushmap 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289798 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289832 4 -rw-r--r-- 1 ubuntu ubuntu 376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/tree.template 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289811 32 -rw-r--r-- 1 ubuntu ubuntu 31995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-a.crushmap 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289806 4 -rw-r--r-- 1 ubuntu ubuntu 760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.one 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289821 4 -rw-r--r-- 1 ubuntu ubuntu 3387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-jewel-tunables.crushmap 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289797 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/show-choose-tries.txt 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289751 4 -rw-r--r-- 1 ubuntu ubuntu 3507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/add-item.t 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289829 88 -rw-r--r-- 1 ubuntu ubuntu 90020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-vary-r-3.t 2024-03-27T21:32:58.808 INFO:teuthology.orchestra.run.smithi063.stdout: 289801 4 -rw-r--r-- 1 ubuntu ubuntu 870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.adj.two 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289762 4 -rw-r--r-- 1 ubuntu ubuntu 1688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/choose-args.crush 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289793 4 -rw-r--r-- 1 ubuntu ubuntu 794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/rules.txt 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289802 4 -rw-r--r-- 1 ubuntu ubuntu 883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.five 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289795 1004 -rw-r--r-- 1 ubuntu ubuntu 1024301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/set-choose.t 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289790 4 -rw-r--r-- 1 ubuntu ubuntu 401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/reweight.t 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289808 4 -rw-r--r-- 1 ubuntu ubuntu 760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.two 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289777 4 -rw-r--r-- 1 ubuntu ubuntu 1724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/device-class.crush 2024-03-27T21:32:58.809 INFO:teuthology.orchestra.run.smithi063.stdout: 289791 4 -rw-r--r-- 1 ubuntu ubuntu 246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/reweight_multiple.t 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289813 448 -rw-r--r-- 1 ubuntu ubuntu 454828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-bobtail-tunables.t 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289814 312 -rw-r--r-- 1 ubuntu ubuntu 317913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-firefly-tunables.t 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289749 4 -rw-r--r-- 1 ubuntu ubuntu 1617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/add-bucket.t 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289794 4 -rw-r--r-- 1 ubuntu ubuntu 2370 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/set-choose.crushmap.txt 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289764 4 -rw-r--r-- 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/compile-decompile-recompile.t 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289788 4 -rw-r--r-- 1 ubuntu ubuntu 3597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/output-csv.t 2024-03-27T21:32:58.810 INFO:teuthology.orchestra.run.smithi063.stdout: 289759 4 -rw-r--r-- 1 ubuntu ubuntu 247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/check-names.empty.t 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289786 4 -rw-r--r-- 1 ubuntu ubuntu 1295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/multitype.before 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289785 4 -rw-r--r-- 1 ubuntu ubuntu 1441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/multitype.after 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289799 4 -rw-r--r-- 1 ubuntu ubuntu 714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.adj.one 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289765 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289766 4 -rw-r--r-- 1 ubuntu ubuntu 2358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/a 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289767 24 -rw-r--r-- 1 ubuntu ubuntu 20656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/b 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289772 60 -rw-r--r-- 1 ubuntu ubuntu 61002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/f 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289774 44 -rw-r--r-- 1 ubuntu ubuntu 43071 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/g 2024-03-27T21:32:58.811 INFO:teuthology.orchestra.run.smithi063.stdout: 289769 12 -rw-r--r-- 1 ubuntu ubuntu 8801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/c 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289770 4 -rw-r--r-- 1 ubuntu ubuntu 3657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/d 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289776 60 -rw-r--r-- 1 ubuntu ubuntu 61002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/gabe2 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289773 8 -rw-r--r-- 1 ubuntu ubuntu 8184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/flax 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289771 8 -rw-r--r-- 1 ubuntu ubuntu 7094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/e 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289768 64 -rw-r--r-- 1 ubuntu ubuntu 64806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/beesly 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289775 60 -rw-r--r-- 1 ubuntu ubuntu 61114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/crush-classes/gabe 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289758 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/check-names.empty.crushmap.txt 2024-03-27T21:32:58.812 INFO:teuthology.orchestra.run.smithi063.stdout: 289780 4 -rw-r--r-- 1 ubuntu ubuntu 242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/empty-default.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289815 4 -rw-r--r-- 1 ubuntu ubuntu 941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-firstn-indep.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289804 4 -rw-r--r-- 1 ubuntu ubuntu 894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.multitree 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289783 4 -rw-r--r-- 1 ubuntu ubuntu 607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/location.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289782 8 -rw-r--r-- 1 ubuntu ubuntu 7894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/help.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289760 4 -rw-r--r-- 1 ubuntu ubuntu 611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/check-names.max-id.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289752 4 -rw-r--r-- 1 ubuntu ubuntu 734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/adjust-item-weight.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289822 312 -rw-r--r-- 1 ubuntu ubuntu 317505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-jewel-tunables.t 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289810 4 -rw-r--r-- 1 ubuntu ubuntu 674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/straw2.txt 2024-03-27T21:32:58.813 INFO:teuthology.orchestra.run.smithi063.stdout: 289787 4 -rw-r--r-- 1 ubuntu ubuntu 980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/need_tree_order.crush 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289753 36 -rw-r--r-- 1 ubuntu ubuntu 34419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/arg-order-checks.t 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289778 4 -rw-r--r-- 1 ubuntu ubuntu 321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/device-class.t 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289755 4 -rw-r--r-- 1 ubuntu ubuntu 508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/bad-mappings.t 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289828 88 -rw-r--r-- 1 ubuntu ubuntu 90008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-vary-r-2.t 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289824 4 -rw-r--r-- 1 ubuntu ubuntu 808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-tries-vs-retries.crushmap 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289825 356 -rw-r--r-- 1 ubuntu ubuntu 361412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/test-map-tries-vs-retries.t 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289800 4 -rw-r--r-- 1 ubuntu ubuntu 870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/simple.template.adj.three 2024-03-27T21:32:58.814 INFO:teuthology.orchestra.run.smithi063.stdout: 289761 4 -rw-r--r-- 1 ubuntu ubuntu 986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/check-overlapped-rules.crushmap.txt 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289833 4 -rw-r--r-- 1 ubuntu ubuntu 1194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/tree.template.final 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289754 4 -rw-r--r-- 1 ubuntu ubuntu 500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/crushtool/bad-mappings.crushmap.txt 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289864 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/rbd 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289866 4 -rw-r--r-- 1 ubuntu ubuntu 3986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/rbd/invalid-snap-usage.t 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289868 4 -rw-r--r-- 1 ubuntu ubuntu 718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/rbd/too-many-args.t 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289867 8 -rw-r--r-- 1 ubuntu ubuntu 4951 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/rbd/not-enough-args.t 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289865 108 -rw-r--r-- 1 ubuntu ubuntu 109344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/rbd/help.t 2024-03-27T21:32:58.815 INFO:teuthology.orchestra.run.smithi063.stdout: 289746 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-kvstore-tool 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 289747 4 -rw-r--r-- 1 ubuntu ubuntu 655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/ceph-kvstore-tool/help.t 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 289719 4 -rw-r--r-- 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli/.gitignore 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290622 8 -rw-r--r-- 1 ubuntu ubuntu 4248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mime.cc 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290909 4 -rw-r--r-- 1 ubuntu ubuntu 3064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/signals.cc 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290278 4 -rw-r--r-- 1 ubuntu ubuntu 817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fooclass.cc 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290710 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/opensuse-13.2 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290713 0 lrwxrwxrwx 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/opensuse-13.2/install-deps.sh -> ../../../install-deps.sh 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290711 4 -rw-r--r-- 1 ubuntu ubuntu 1192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/opensuse-13.2/Dockerfile.in 2024-03-27T21:32:58.816 INFO:teuthology.orchestra.run.smithi063.stdout: 290712 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/opensuse-13.2/ceph.spec.in -> ../../../ceph.spec.in 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 290952 4 -rw-r--r-- 1 ubuntu ubuntu 1128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_intarith.cc 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 289701 16 -rw-r--r-- 1 ubuntu ubuntu 15254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ceph_argparse.cc 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 289693 80 -rw-r--r-- 1 ubuntu ubuntu 80982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/bufferlist.cc 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 290194 4 -rw-r--r-- 1 ubuntu ubuntu 471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crypto_init.cc 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 289673 4 -rw-r--r-- 1 ubuntu ubuntu 744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket_output_tests.h 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 290960 36 -rw-r--r-- 1 ubuntu ubuntu 33139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_perf_counters_cache.cc 2024-03-27T21:32:58.817 INFO:teuthology.orchestra.run.smithi063.stdout: 290279 12 -rw-r--r-- 1 ubuntu ubuntu 9231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/formatter.cc 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290938 24 -rw-r--r-- 1 ubuntu ubuntu 21692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_any.cc 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290601 16 -rw-r--r-- 1 ubuntu ubuntu 13117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_gp.cc 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290824 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290875 4 -rw-r--r-- 1 ubuntu ubuntu 3831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_multi.md 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290878 20 -rw-r--r-- 1 ubuntu ubuntu 17567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_amqp.cc 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290886 16 -rw-r--r-- 1 ubuntu ubuntu 15466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_dmclock_scheduler.cc 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290866 8 -rw-r--r-- 1 ubuntu ubuntu 4645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test-rgw-common.sh 2024-03-27T21:32:58.818 INFO:teuthology.orchestra.run.smithi063.stdout: 290894 12 -rw-r--r-- 1 ubuntu ubuntu 10006 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_period_history.cc 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290830 4 -rw-r--r-- 1 ubuntu ubuntu 1655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bench_rgw_ratelimit_gc.cc 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290874 16 -rw-r--r-- 1 ubuntu ubuntu 12904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_multen.py 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290877 12 -rw-r--r-- 1 ubuntu ubuntu 10693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_posix_bucket_cache.cc 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290825 12 -rw-r--r-- 1 ubuntu ubuntu 10074 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/CMakeLists.txt 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290897 4 -rw-r--r-- 1 ubuntu ubuntu 2939 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_reshard.cc 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290826 12 -rw-r--r-- 1 ubuntu ubuntu 11183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/amqp_mock.cc 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290898 8 -rw-r--r-- 1 ubuntu ubuntu 4607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_reshard_wait.cc 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290883 16 -rw-r--r-- 1 ubuntu ubuntu 13860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_common.h 2024-03-27T21:32:58.819 INFO:teuthology.orchestra.run.smithi063.stdout: 290828 8 -rw-r--r-- 1 ubuntu ubuntu 5304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/amqp_url.c 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290888 48 -rw-r--r-- 1 ubuntu ubuntu 48138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_iam_policy.cc 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290829 12 -rw-r--r-- 1 ubuntu ubuntu 9932 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bench_rgw_ratelimit.cc 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290864 4 -rwxr-xr-x 1 ubuntu ubuntu 1962 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test-ceph-diff-sorted.sh 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290867 4 -rwxr-xr-x 1 ubuntu ubuntu 1679 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test-rgw-meta-sync.sh 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290870 8 -rw-r--r-- 1 ubuntu ubuntu 5176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_d4n_directory.cc 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290890 16 -rw-r--r-- 1 ubuntu ubuntu 13679 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_lc.cc 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290873 12 -rw-r--r-- 1 ubuntu ubuntu 9825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_log_backing.cc 2024-03-27T21:32:58.820 INFO:teuthology.orchestra.run.smithi063.stdout: 290842 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290845 4 -rw-r--r-- 1 ubuntu ubuntu 220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/luatests.conf.SAMPLE 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290849 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/tox.ini 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290843 4 -rw-r--r-- 1 ubuntu ubuntu 288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/README.rst 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290847 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/requirements.txt 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290844 4 -rw-r--r-- 1 ubuntu ubuntu 1341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/__init__.py 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290848 16 -rw-r--r-- 1 ubuntu ubuntu 15094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/test_lua.py 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290846 4 -rw-r--r-- 1 ubuntu ubuntu 62 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/lua/pytest.ini 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290895 8 -rw-r--r-- 1 ubuntu ubuntu 5311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_putobj.cc 2024-03-27T21:32:58.821 INFO:teuthology.orchestra.run.smithi063.stdout: 290865 4 -rwxr-xr-x 1 ubuntu ubuntu 314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test-rgw-call.sh 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290889 12 -rw-r--r-- 1 ubuntu ubuntu 10511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_kms.cc 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290841 4 -rw-r--r-- 1 ubuntu ubuntu 1885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/kafka_stub.cc 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290851 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290858 4 -rw-r--r-- 1 ubuntu ubuntu 2842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/tools.py 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290861 12 -rw-r--r-- 1 ubuntu ubuntu 8780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/zone_es.py 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290856 24 -rw-r--r-- 1 ubuntu ubuntu 21099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/tests_az.py 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290859 4 -rw-r--r-- 1 ubuntu ubuntu 1115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/zone_az.py 2024-03-27T21:32:58.822 INFO:teuthology.orchestra.run.smithi063.stdout: 290854 16 -rw-r--r-- 1 ubuntu ubuntu 14657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/multisite.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290853 4 -rw-r--r-- 1 ubuntu ubuntu 2767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/conn.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290862 8 -rw-r--r-- 1 ubuntu ubuntu 7582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/zone_rados.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290852 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/__init__.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290855 116 -rw-r--r-- 1 ubuntu ubuntu 117010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/tests.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290860 12 -rw-r--r-- 1 ubuntu ubuntu 11600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/zone_cloud.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290857 16 -rw-r--r-- 1 ubuntu ubuntu 12618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_multi/tests_es.py 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290902 20 -rw-r--r-- 1 ubuntu ubuntu 17125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_xml.cc 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290831 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification 2024-03-27T21:32:58.823 INFO:teuthology.orchestra.run.smithi063.stdout: 290834 12 -rw-r--r-- 1 ubuntu ubuntu 10986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/api.py 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290836 4 -rwxr-xr-x 1 ubuntu ubuntu 1707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/bootstrap 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290837 4 -rwxr-xr-x 1 ubuntu ubuntu 1607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/kafka-security.sh 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290835 4 -rw-r--r-- 1 ubuntu ubuntu 270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/bntests.conf.SAMPLE 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290832 8 -rw-r--r-- 1 ubuntu ubuntu 6934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/README.rst 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290838 4 -rw-r--r-- 1 ubuntu ubuntu 109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/requirements.txt 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290833 4 -rw-r--r-- 1 ubuntu ubuntu 2102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/__init__.py 2024-03-27T21:32:58.824 INFO:teuthology.orchestra.run.smithi063.stdout: 290840 176 -rw-r--r-- 1 ubuntu ubuntu 179671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/test_bn.py 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290839 4 -rw-r--r-- 1 ubuntu ubuntu 410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/bucket_notification/setup.py 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290869 36 -rw-r--r-- 1 ubuntu ubuntu 34352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_cls_fifo_legacy.cc 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290881 8 -rw-r--r-- 1 ubuntu ubuntu 5163 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_bucket_sync_cache.cc 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290882 4 -rw-r--r-- 1 ubuntu ubuntu 2572 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_common.cc 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290879 8 -rw-r--r-- 1 ubuntu ubuntu 4304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_arn.cc 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290850 12 -rw-r--r-- 1 ubuntu ubuntu 10101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/rgw_cr_test.cc 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290863 4 -rwxr-xr-x 1 ubuntu ubuntu 671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/run-d4n-unit-tests.sh 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290893 8 -rw-r--r-- 1 ubuntu ubuntu 6569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_obj.cc 2024-03-27T21:32:58.825 INFO:teuthology.orchestra.run.smithi063.stdout: 290901 4 -rw-r--r-- 1 ubuntu ubuntu 3125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_url.cc 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290880 4 -rw-r--r-- 1 ubuntu ubuntu 1001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_bencode.cc 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290871 60 -rw-r--r-- 1 ubuntu ubuntu 61166 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_d4n_filter.cc 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290868 4 -rwxr-xr-x 1 ubuntu ubuntu 1605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test-rgw-multisite.sh 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290885 28 -rw-r--r-- 1 ubuntu ubuntu 26170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_crypto.cc 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290891 44 -rw-r--r-- 1 ubuntu ubuntu 44562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_lua.cc 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290896 16 -rw-r--r-- 1 ubuntu ubuntu 13171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_ratelimit.cc 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290827 4 -rw-r--r-- 1 ubuntu ubuntu 579 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/amqp_mock.h 2024-03-27T21:32:58.826 INFO:teuthology.orchestra.run.smithi063.stdout: 290899 4 -rw-r--r-- 1 ubuntu ubuntu 2251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_string.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290884 8 -rw-r--r-- 1 ubuntu ubuntu 5202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_compression.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290872 8 -rw-r--r-- 1 ubuntu ubuntu 4109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_http_manager.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290876 16 -rw-r--r-- 1 ubuntu ubuntu 15346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_multi.py 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290892 12 -rw-r--r-- 1 ubuntu ubuntu 11568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_manifest.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290887 4 -rw-r--r-- 1 ubuntu ubuntu 3599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_gc_log.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290900 8 -rw-r--r-- 1 ubuntu ubuntu 5300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rgw/test_rgw_throttle.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290425 4 drwxr-xr-x 17 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290567 16 -rw-r--r-- 1 ubuntu ubuntu 15721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_Groups.cc 2024-03-27T21:32:58.827 INFO:teuthology.orchestra.run.smithi063.stdout: 290575 4 -rw-r--r-- 1 ubuntu ubuntu 1585 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_fixture.h 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290587 12 -rw-r--r-- 1 ubuntu ubuntu 11873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_Watcher.cc 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290572 4 -rw-r--r-- 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_Operations.cc 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290571 8 -rw-r--r-- 1 ubuntu ubuntu 7711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_ObjectMap.cc 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290447 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290450 40 -rw-r--r-- 1 ubuntu ubuntu 38224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy/test_mock_ObjectCopyRequest.cc 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290451 12 -rw-r--r-- 1 ubuntu ubuntu 9579 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy/test_mock_SetHeadRequest.cc 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290453 12 -rw-r--r-- 1 ubuntu ubuntu 9814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy/test_mock_SnapshotCreateRequest.cc 2024-03-27T21:32:58.828 INFO:teuthology.orchestra.run.smithi063.stdout: 290448 32 -rw-r--r-- 1 ubuntu ubuntu 29392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy/test_mock_ImageCopyRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290452 36 -rw-r--r-- 1 ubuntu ubuntu 35850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy/test_mock_SnapshotCopyRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290449 8 -rw-r--r-- 1 ubuntu ubuntu 6885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/deep_copy/test_mock_MetadataCopyRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290553 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290555 24 -rw-r--r-- 1 ubuntu ubuntu 21064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_EnableFeaturesRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290561 16 -rw-r--r-- 1 ubuntu ubuntu 13800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_SnapshotRollbackRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290563 20 -rw-r--r-- 1 ubuntu ubuntu 16781 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_TrimRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290562 12 -rw-r--r-- 1 ubuntu ubuntu 9303 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_SnapshotUnprotectRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290560 32 -rw-r--r-- 1 ubuntu ubuntu 30634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_SnapshotRemoveRequest.cc 2024-03-27T21:32:58.829 INFO:teuthology.orchestra.run.smithi063.stdout: 290559 8 -rw-r--r-- 1 ubuntu ubuntu 6075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_SnapshotProtectRequest.cc 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290556 8 -rw-r--r-- 1 ubuntu ubuntu 4750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_Request.cc 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290554 20 -rw-r--r-- 1 ubuntu ubuntu 17530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_DisableFeaturesRequest.cc 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290558 16 -rw-r--r-- 1 ubuntu ubuntu 16216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_SnapshotCreateRequest.cc 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290557 16 -rw-r--r-- 1 ubuntu ubuntu 15166 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/operation/test_mock_ResizeRequest.cc 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290426 8 -rw-r--r-- 1 ubuntu ubuntu 7007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/CMakeLists.txt 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290592 4 -rw-r--r-- 1 ubuntu ubuntu 1582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_support.h 2024-03-27T21:32:58.830 INFO:teuthology.orchestra.run.smithi063.stdout: 290586 4 -rw-r--r-- 1 ubuntu ubuntu 2436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_TrashWatcher.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290593 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/trash 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290595 8 -rw-r--r-- 1 ubuntu ubuntu 7328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/trash/test_mock_RemoveRequest.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290594 8 -rw-r--r-- 1 ubuntu ubuntu 7803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/trash/test_mock_MoveRequest.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290576 64 -rw-r--r-- 1 ubuntu ubuntu 62358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_internal.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290568 28 -rw-r--r-- 1 ubuntu ubuntu 27184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_ImageWatcher.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290470 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/io 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290472 28 -rw-r--r-- 1 ubuntu ubuntu 25960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/io/test_mock_ImageRequest.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290471 48 -rw-r--r-- 1 ubuntu ubuntu 48591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/io/test_mock_CopyupRequest.cc 2024-03-27T21:32:58.831 INFO:teuthology.orchestra.run.smithi063.stdout: 290473 92 -rw-r--r-- 1 ubuntu ubuntu 90983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/io/test_mock_ObjectRequest.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290474 4 -rw-r--r-- 1 ubuntu ubuntu 3296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/io/test_mock_QosImageDispatch.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290475 28 -rw-r--r-- 1 ubuntu ubuntu 27984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/io/test_mock_SimpleSchedulerObjectDispatch.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290577 444 -rw-r--r-- 1 ubuntu ubuntu 453820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_librbd.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290574 8 -rw-r--r-- 1 ubuntu ubuntu 4989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_fixture.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290484 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/managed_lock 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290485 12 -rw-r--r-- 1 ubuntu ubuntu 8851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/managed_lock/test_mock_AcquireRequest.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290486 16 -rw-r--r-- 1 ubuntu ubuntu 15949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/managed_lock/test_mock_BreakRequest.cc 2024-03-27T21:32:58.832 INFO:teuthology.orchestra.run.smithi063.stdout: 290489 4 -rw-r--r-- 1 ubuntu ubuntu 2406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/managed_lock/test_mock_ReleaseRequest.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290488 4 -rw-r--r-- 1 ubuntu ubuntu 3474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/managed_lock/test_mock_ReacquireRequest.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290487 12 -rw-r--r-- 1 ubuntu ubuntu 9888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/managed_lock/test_mock_GetLockerRequest.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290596 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/watcher 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290597 8 -rw-r--r-- 1 ubuntu ubuntu 8036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/watcher/test_mock_RewatchRequest.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290458 84 -rw-r--r-- 1 ubuntu ubuntu 84985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/fsx.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290581 20 -rw-r--r-- 1 ubuntu ubuntu 16440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_DeepCopyRequest.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290584 28 -rw-r--r-- 1 ubuntu ubuntu 26414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_ManagedLock.cc 2024-03-27T21:32:58.833 INFO:teuthology.orchestra.run.smithi063.stdout: 290434 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290444 8 -rw-r--r-- 1 ubuntu ubuntu 7266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/test_mock_FormatRequest.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290445 16 -rw-r--r-- 1 ubuntu ubuntu 14294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/test_mock_LoadRequest.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290435 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/luks 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290437 8 -rw-r--r-- 1 ubuntu ubuntu 7788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/luks/test_mock_FormatRequest.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290438 16 -rw-r--r-- 1 ubuntu ubuntu 12322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/luks/test_mock_LoadRequest.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290436 12 -rw-r--r-- 1 ubuntu ubuntu 9362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/luks/test_mock_FlattenRequest.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290443 32 -rw-r--r-- 1 ubuntu ubuntu 31064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/test_mock_CryptoObjectDispatch.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290446 8 -rw-r--r-- 1 ubuntu ubuntu 4318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/test_mock_ShutDownCryptoRequest.cc 2024-03-27T21:32:58.834 INFO:teuthology.orchestra.run.smithi063.stdout: 290442 4 -rw-r--r-- 1 ubuntu ubuntu 1850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/test_mock_CryptoContextPool.cc 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290439 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/openssl 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290440 8 -rw-r--r-- 1 ubuntu ubuntu 4279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/openssl/test_DataCryptor.cc 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290441 8 -rw-r--r-- 1 ubuntu ubuntu 5097 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/crypto/test_mock_BlockCrypto.cc 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290459 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290468 16 -rw-r--r-- 1 ubuntu ubuntu 14182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_RemoveRequest.cc 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290461 8 -rw-r--r-- 1 ubuntu ubuntu 4373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_AttachParentRequest.cc 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290465 8 -rw-r--r-- 1 ubuntu ubuntu 6221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_ListWatchersRequest.cc 2024-03-27T21:32:58.835 INFO:teuthology.orchestra.run.smithi063.stdout: 290469 8 -rw-r--r-- 1 ubuntu ubuntu 6527 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_ValidatePoolRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290464 4 -rw-r--r-- 1 ubuntu ubuntu 3602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_DetachParentRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290460 12 -rw-r--r-- 1 ubuntu ubuntu 8380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_AttachChildRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290467 68 -rw-r--r-- 1 ubuntu ubuntu 66295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_RefreshRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290463 16 -rw-r--r-- 1 ubuntu ubuntu 15583 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_DetachChildRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290466 16 -rw-r--r-- 1 ubuntu ubuntu 14514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_PreRemoveRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290462 32 -rw-r--r-- 1 ubuntu ubuntu 32156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/image/test_mock_CloneRequest.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290565 4 -rw-r--r-- 1 ubuntu ubuntu 2343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_BlockGuard.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290578 4 -rw-r--r-- 1 ubuntu ubuntu 2059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_main.cc 2024-03-27T21:32:58.836 INFO:teuthology.orchestra.run.smithi063.stdout: 290499 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290500 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290504 16 -rw-r--r-- 1 ubuntu ubuntu 13444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot/test_mock_PromoteRequest.cc 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290505 16 -rw-r--r-- 1 ubuntu ubuntu 16314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot/test_mock_UnlinkPeerRequest.cc 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290501 16 -rw-r--r-- 1 ubuntu ubuntu 12833 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot/test_mock_CreateNonPrimaryRequest.cc 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290503 8 -rw-r--r-- 1 ubuntu ubuntu 4816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot/test_mock_ImageMeta.cc 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290506 8 -rw-r--r-- 1 ubuntu ubuntu 6376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot/test_mock_Utils.cc 2024-03-27T21:32:58.837 INFO:teuthology.orchestra.run.smithi063.stdout: 290502 32 -rw-r--r-- 1 ubuntu ubuntu 29101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/snapshot/test_mock_CreatePrimaryRequest.cc 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290507 24 -rw-r--r-- 1 ubuntu ubuntu 23373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mirror/test_mock_DisableRequest.cc 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290564 4 -rw-r--r-- 1 ubuntu ubuntu 1145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/rbdrw.py 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290476 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290478 32 -rw-r--r-- 1 ubuntu ubuntu 28942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_Replay.cc 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290481 12 -rw-r--r-- 1 ubuntu ubuntu 11216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_mock_PromoteRequest.cc 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290479 4 -rw-r--r-- 1 ubuntu ubuntu 4073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_Stress.cc 2024-03-27T21:32:58.838 INFO:teuthology.orchestra.run.smithi063.stdout: 290483 12 -rw-r--r-- 1 ubuntu ubuntu 8638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_mock_ResetRequest.cc 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290482 68 -rw-r--r-- 1 ubuntu ubuntu 67341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_mock_Replay.cc 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290480 8 -rw-r--r-- 1 ubuntu ubuntu 5829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_mock_OpenRequest.cc 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290477 12 -rw-r--r-- 1 ubuntu ubuntu 8827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/journal/test_Entries.cc 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290573 4 -rw-r--r-- 1 ubuntu ubuntu 3253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_Trash.cc 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290588 8 -rw-r--r-- 1 ubuntu ubuntu 5399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_fixture.cc 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290508 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290514 4 -rw-r--r-- 1 ubuntu ubuntu 914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockImageWatcher.h 2024-03-27T21:32:58.839 INFO:teuthology.orchestra.run.smithi063.stdout: 290509 4 -rw-r--r-- 1 ubuntu ubuntu 391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockContextWQ.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290516 4 -rw-r--r-- 1 ubuntu ubuntu 2977 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockJournal.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290531 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/io 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290532 4 -rw-r--r-- 1 ubuntu ubuntu 3209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/io/MockImageDispatch.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290535 4 -rw-r--r-- 1 ubuntu ubuntu 1281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/io/MockObjectDispatcher.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290534 8 -rw-r--r-- 1 ubuntu ubuntu 6074 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/io/MockObjectDispatch.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290536 4 -rw-r--r-- 1 ubuntu ubuntu 594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/io/MockQosImageDispatch.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290533 4 -rw-r--r-- 1 ubuntu ubuntu 1445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/io/MockImageDispatcher.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290512 12 -rw-r--r-- 1 ubuntu ubuntu 8680 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockImageCtx.h 2024-03-27T21:32:58.840 INFO:teuthology.orchestra.run.smithi063.stdout: 290518 4 -rw-r--r-- 1 ubuntu ubuntu 2964 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockObjectMap.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/crypto 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290527 4 -rw-r--r-- 1 ubuntu ubuntu 1279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/crypto/MockDataCryptor.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290528 4 -rw-r--r-- 1 ubuntu ubuntu 876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/crypto/MockEncryptionFormat.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290526 4 -rw-r--r-- 1 ubuntu ubuntu 983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/crypto/MockCryptoInterface.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290513 4 -rw-r--r-- 1 ubuntu ubuntu 975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockImageState.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290520 4 -rw-r--r-- 1 ubuntu ubuntu 536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockPluginRegistry.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290519 4 -rw-r--r-- 1 ubuntu ubuntu 3640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockOperations.h 2024-03-27T21:32:58.841 INFO:teuthology.orchestra.run.smithi063.stdout: 290522 4 -rw-r--r-- 1 ubuntu ubuntu 489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockSafeTimer.h 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290521 4 -rw-r--r-- 1 ubuntu ubuntu 478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockReadahead.h 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290529 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/exclusive_lock 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290530 4 -rw-r--r-- 1 ubuntu ubuntu 572 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/exclusive_lock/MockPolicy.h 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290511 8 -rw-r--r-- 1 ubuntu ubuntu 5109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockImageCtx.cc 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290515 4 -rw-r--r-- 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockJournal.cc 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290517 4 -rw-r--r-- 1 ubuntu ubuntu 554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockJournalPolicy.h 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290510 4 -rw-r--r-- 1 ubuntu ubuntu 1418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/MockExclusiveLock.h 2024-03-27T21:32:58.842 INFO:teuthology.orchestra.run.smithi063.stdout: 290523 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/cache 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290524 4 -rw-r--r-- 1 ubuntu ubuntu 2329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/cache/MockImageCache.h 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290537 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/migration 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290539 4 -rw-r--r-- 1 ubuntu ubuntu 866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/migration/MockStreamInterface.h 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290538 4 -rw-r--r-- 1 ubuntu ubuntu 1570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/mock/migration/MockSnapshotInterface.h 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290454 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/exclusive_lock 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290456 4 -rw-r--r-- 1 ubuntu ubuntu 2677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/exclusive_lock/test_mock_PreAcquireRequest.cc 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290457 16 -rw-r--r-- 1 ubuntu ubuntu 12655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/exclusive_lock/test_mock_PreReleaseRequest.cc 2024-03-27T21:32:58.843 INFO:teuthology.orchestra.run.smithi063.stdout: 290455 24 -rw-r--r-- 1 ubuntu ubuntu 21606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/exclusive_lock/test_mock_PostAcquireRequest.cc 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290579 56 -rw-r--r-- 1 ubuntu ubuntu 57302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mirroring.cc 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290589 4 -rw-r--r-- 1 ubuntu ubuntu 2684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_fixture.h 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290582 32 -rw-r--r-- 1 ubuntu ubuntu 29663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_ExclusiveLock.cc 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290540 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290550 8 -rw-r--r-- 1 ubuntu ubuntu 4797 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_SnapshotRollbackRequest.cc 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290544 8 -rw-r--r-- 1 ubuntu ubuntu 4766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_InvalidateRequest.cc 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290549 12 -rw-r--r-- 1 ubuntu ubuntu 11512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_SnapshotRemoveRequest.cc 2024-03-27T21:32:58.844 INFO:teuthology.orchestra.run.smithi063.stdout: 290545 8 -rw-r--r-- 1 ubuntu ubuntu 6268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_LockRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290546 16 -rw-r--r-- 1 ubuntu ubuntu 15673 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_RefreshRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290548 8 -rw-r--r-- 1 ubuntu ubuntu 7270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_SnapshotCreateRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290543 92 -rw-r--r-- 1 ubuntu ubuntu 93857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_DiffRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290541 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/mock 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290542 4 -rw-r--r-- 1 ubuntu ubuntu 1107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/mock/MockInvalidateRequest.h 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290547 8 -rw-r--r-- 1 ubuntu ubuntu 4695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_ResizeRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290551 4 -rw-r--r-- 1 ubuntu ubuntu 1879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_UnlockRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290552 12 -rw-r--r-- 1 ubuntu ubuntu 9522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/object_map/test_mock_UpdateRequest.cc 2024-03-27T21:32:58.845 INFO:teuthology.orchestra.run.smithi063.stdout: 290569 44 -rw-r--r-- 1 ubuntu ubuntu 41554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_Migration.cc 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290585 12 -rw-r--r-- 1 ubuntu ubuntu 9780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_ObjectMap.cc 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290566 28 -rw-r--r-- 1 ubuntu ubuntu 25853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_DeepCopy.cc 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290580 4 -rw-r--r-- 1 ubuntu ubuntu 2622 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_ConfigWatcher.cc 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290427 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache/pwl 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290429 12 -rw-r--r-- 1 ubuntu ubuntu 10309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache/pwl/test_WriteLogMap.cc 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290430 24 -rw-r--r-- 1 ubuntu ubuntu 24205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache/pwl/test_mock_ReplicatedWriteLog.cc 2024-03-27T21:32:58.846 INFO:teuthology.orchestra.run.smithi063.stdout: 290431 24 -rw-r--r-- 1 ubuntu ubuntu 24435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache/pwl/test_mock_SSDWriteLog.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290433 28 -rw-r--r-- 1 ubuntu ubuntu 24920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache/test_mock_WriteAroundObjectDispatch.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290432 16 -rw-r--r-- 1 ubuntu ubuntu 16108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/cache/test_mock_ParentCacheObjectDispatch.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290591 4 -rw-r--r-- 1 ubuntu ubuntu 3890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_support.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290583 56 -rw-r--r-- 1 ubuntu ubuntu 56284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_mock_Journal.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290490 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290496 8 -rw-r--r-- 1 ubuntu ubuntu 7706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_RawSnapshot.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290492 28 -rw-r--r-- 1 ubuntu ubuntu 28130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_HttpClient.cc 2024-03-27T21:32:58.847 INFO:teuthology.orchestra.run.smithi063.stdout: 290494 40 -rw-r--r-- 1 ubuntu ubuntu 40351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_QCOWFormat.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290498 4 -rw-r--r-- 1 ubuntu ubuntu 1697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_Utils.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290491 8 -rw-r--r-- 1 ubuntu ubuntu 5237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_FileStream.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290495 20 -rw-r--r-- 1 ubuntu ubuntu 17229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_RawFormat.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290493 8 -rw-r--r-- 1 ubuntu ubuntu 5003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_HttpStream.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290497 8 -rw-r--r-- 1 ubuntu ubuntu 6454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/migration/test_mock_S3Stream.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290590 8 -rwxr-xr-x 1 ubuntu ubuntu 5937 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_notify.py 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290570 4 -rw-r--r-- 1 ubuntu ubuntu 2644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librbd/test_MirroringWatcher.cc 2024-03-27T21:32:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 290648 8 -rw-r--r-- 1 ubuntu ubuntu 4493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/multi_stress_watch.cc 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 290708 8 -rw-r--r-- 1 ubuntu ubuntu 5375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/omap_bench.h 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 289915 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 289917 40 -rw-r--r-- 1 ubuntu ubuntu 40916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw/test_cls_rgw.cc 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 289916 4 -rw-r--r-- 1 ubuntu ubuntu 661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw/CMakeLists.txt 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 289918 24 -rw-r--r-- 1 ubuntu ubuntu 20799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw/test_cls_rgw_stats.cc 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 290344 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephsqlite 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 290345 4 -rw-r--r-- 1 ubuntu ubuntu 363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephsqlite/CMakeLists.txt 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 290346 36 -rw-r--r-- 1 ubuntu ubuntu 33382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephsqlite/main.cc 2024-03-27T21:32:58.849 INFO:teuthology.orchestra.run.smithi063.stdout: 289919 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw_gc 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 289920 4 -rw-r--r-- 1 ubuntu ubuntu 387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw_gc/CMakeLists.txt 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 289921 20 -rw-r--r-- 1 ubuntu ubuntu 19975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rgw_gc/test_cls_rgw_gc.cc 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 289692 4 -rw-r--r-- 1 ubuntu ubuntu 1880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/bench_log.cc 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 290942 4 -rw-r--r-- 1 ubuntu ubuntu 1919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_c2c.cc 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 290961 4 -rwxr-xr-x 1 ubuntu ubuntu 2479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_pidfile.sh 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 290600 8 -rw-r--r-- 1 ubuntu ubuntu 4764 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_cd.cc 2024-03-27T21:32:58.850 INFO:teuthology.orchestra.run.smithi063.stdout: 290980 4 -rwxr-xr-x 1 ubuntu ubuntu 3137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_unfound.sh 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290913 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290924 4 -rw-r--r-- 1 ubuntu ubuntu 1910 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_delete_objs.cc 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290933 4 -rw-r--r-- 1 ubuntu ubuntu 2326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/systest_runnable.h 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290931 4 -rw-r--r-- 1 ubuntu ubuntu 1372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_watch.h 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290914 4 -rw-r--r-- 1 ubuntu ubuntu 1452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/CMakeLists.txt 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290922 4 -rw-r--r-- 1 ubuntu ubuntu 3445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_create_pool.cc 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290917 4 -rw-r--r-- 1 ubuntu ubuntu 3226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/rados_delete_pools_parallel.cc 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290921 4 -rwxr-xr-x 1 ubuntu ubuntu 462 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/rerun.sh 2024-03-27T21:32:58.851 INFO:teuthology.orchestra.run.smithi063.stdout: 290925 4 -rw-r--r-- 1 ubuntu ubuntu 1161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_delete_objs.h 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290916 4 -rw-r--r-- 1 ubuntu ubuntu 971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/cross_process_sem.h 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290927 4 -rw-r--r-- 1 ubuntu ubuntu 1066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_delete_pool.h 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290926 4 -rw-r--r-- 1 ubuntu ubuntu 1696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_delete_pool.cc 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290915 4 -rw-r--r-- 1 ubuntu ubuntu 2803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/cross_process_sem.cc 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290934 4 -rw-r--r-- 1 ubuntu ubuntu 1578 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/systest_settings.cc 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290929 4 -rw-r--r-- 1 ubuntu ubuntu 1356 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_list_objects.h 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290932 8 -rw-r--r-- 1 ubuntu ubuntu 5575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/systest_runnable.cc 2024-03-27T21:32:58.852 INFO:teuthology.orchestra.run.smithi063.stdout: 290923 4 -rw-r--r-- 1 ubuntu ubuntu 1376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_create_pool.h 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290918 12 -rw-r--r-- 1 ubuntu ubuntu 9720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/rados_list_parallel.cc 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290930 4 -rw-r--r-- 1 ubuntu ubuntu 1266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_notify.h 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290919 8 -rw-r--r-- 1 ubuntu ubuntu 4223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/rados_open_pools_parallel.cc 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290928 4 -rw-r--r-- 1 ubuntu ubuntu 2727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/st_rados_list_objects.cc 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290935 4 -rw-r--r-- 1 ubuntu ubuntu 872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/systest_settings.h 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290920 8 -rw-r--r-- 1 ubuntu ubuntu 6442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/system/rados_watch_notify.cc 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290749 24 -rw-r--r-- 1 ubuntu ubuntu 23801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/perf_counters.cc 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290707 16 -rw-r--r-- 1 ubuntu ubuntu 12407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/omap_bench.cc 2024-03-27T21:32:58.853 INFO:teuthology.orchestra.run.smithi063.stdout: 290988 4 -rw-r--r-- 1 ubuntu ubuntu 3699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/testmsgr.cc 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 290216 16 -rw-r--r-- 1 ubuntu ubuntu 13939 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding.cc 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 289925 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_version 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 289926 4 -rw-r--r-- 1 ubuntu ubuntu 284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_version/CMakeLists.txt 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 289927 8 -rw-r--r-- 1 ubuntu ubuntu 7728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_version/test_cls_version.cc 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 290750 4 -rw-r--r-- 1 ubuntu ubuntu 1477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/perf_helper.cc 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 290973 4 -rwxr-xr-x 1 ubuntu ubuntu 1299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_split.sh 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 290197 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/debian-strech 2024-03-27T21:32:58.854 INFO:teuthology.orchestra.run.smithi063.stdout: 290199 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/debian-strech/debian -> ../../../debian 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290200 0 lrwxrwxrwx 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/debian-strech/install-deps.sh -> ../../../install-deps.sh 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290198 4 -rw-r--r-- 1 ubuntu ubuntu 1125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/debian-strech/Dockerfile.in 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290317 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/lazy-omap-stats 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290318 4 -rw-r--r-- 1 ubuntu ubuntu 299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/lazy-omap-stats/CMakeLists.txt 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290321 4 -rw-r--r-- 1 ubuntu ubuntu 537 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/lazy-omap-stats/main.cc 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290319 20 -rw-r--r-- 1 ubuntu ubuntu 17314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/lazy-omap-stats/lazy_omap_stats_test.cc 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290320 4 -rw-r--r-- 1 ubuntu ubuntu 2632 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/lazy-omap-stats/lazy_omap_stats_test.h 2024-03-27T21:32:58.855 INFO:teuthology.orchestra.run.smithi063.stdout: 290285 4 -rw-r--r-- 1 ubuntu ubuntu 2887 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/gather.cc 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290974 4 -rw-r--r-- 1 ubuntu ubuntu 1553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_str_list.cc 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290970 4 -rw-r--r-- 1 ubuntu ubuntu 3222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rgw_token.cc 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290947 4 -rwxr-xr-x 1 ubuntu ubuntu 1516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_crush_bucket.sh 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290912 16 -rw-r--r-- 1 ubuntu ubuntu 14177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/strtol.cc 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290910 4 -rw-r--r-- 1 ubuntu ubuntu 2783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/simple_spin.cc 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290993 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ubuntu-20.04 -> ubuntu-18.04 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290195 4 -rw-r--r-- 1 ubuntu ubuntu 158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cxx11_client.cc 2024-03-27T21:32:58.856 INFO:teuthology.orchestra.run.smithi063.stdout: 290132 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson 2024-03-27T21:32:58.857 INFO:teuthology.orchestra.run.smithi063.stdout: 290185 20 -rw-r--r-- 1 ubuntu ubuntu 19315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_socket.cc 2024-03-27T21:32:58.857 INFO:teuthology.orchestra.run.smithi063.stdout: 290170 8 -rw-r--r-- 1 ubuntu ubuntu 7753 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_calc_subsets.cc 2024-03-27T21:32:58.857 INFO:teuthology.orchestra.run.smithi063.stdout: 290182 24 -rw-r--r-- 1 ubuntu ubuntu 21203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_messenger_thrash.cc 2024-03-27T21:32:58.857 INFO:teuthology.orchestra.run.smithi063.stdout: 290178 8 -rw-r--r-- 1 ubuntu ubuntu 5213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_lru.cc 2024-03-27T21:32:58.857 INFO:teuthology.orchestra.run.smithi063.stdout: 290171 4 -rw-r--r-- 1 ubuntu ubuntu 3501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_config.cc 2024-03-27T21:32:58.857 INFO:teuthology.orchestra.run.smithi063.stdout: 290174 4 -rw-r--r-- 1 ubuntu ubuntu 1127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_denc.cc 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290133 8 -rw-r--r-- 1 ubuntu ubuntu 4302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/CMakeLists.txt 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290140 4 -rw-r--r-- 1 ubuntu ubuntu 1568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/gtest_seastar.h 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290181 16 -rw-r--r-- 1 ubuntu ubuntu 15161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_messenger_peer.cc 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290167 8 -rw-r--r-- 1 ubuntu ubuntu 7051 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_async_echo.cc 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290173 40 -rw-r--r-- 1 ubuntu ubuntu 38592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_crimson_scrub.cc 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290134 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/cbt 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290136 4 -rw-r--r-- 1 ubuntu ubuntu 868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/cbt/radosbench_4K_write.yaml 2024-03-27T21:32:58.858 INFO:teuthology.orchestra.run.smithi063.stdout: 290135 4 -rw-r--r-- 1 ubuntu ubuntu 940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/cbt/radosbench_4K_read.yaml 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290137 4 -rwxr-xr-x 1 ubuntu ubuntu 2843 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/cbt/t2c.py 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290165 12 -rw-r--r-- 1 ubuntu ubuntu 9871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_alien_echo.cc 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290142 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290154 20 -rw-r--r-- 1 ubuntu ubuntu 16775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_cbjournal.cc 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290163 64 -rw-r--r-- 1 ubuntu ubuntu 65061 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_transaction_manager.cc 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290162 12 -rw-r--r-- 1 ubuntu ubuntu 9398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_seastore_journal.cc 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290143 4 -rw-r--r-- 1 ubuntu ubuntu 3400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/CMakeLists.txt 2024-03-27T21:32:58.859 INFO:teuthology.orchestra.run.smithi063.stdout: 290159 8 -rw-r--r-- 1 ubuntu ubuntu 4355 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_randomblock_manager.cc 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290161 8 -rw-r--r-- 1 ubuntu ubuntu 7416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_seastore_cache.cc 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290156 8 -rw-r--r-- 1 ubuntu ubuntu 5270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_extent_allocator.cc 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290152 8 -rw-r--r-- 1 ubuntu ubuntu 4962 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_block.h 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290151 4 -rw-r--r-- 1 ubuntu ubuntu 911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_block.cc 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290146 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/onode_tree 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290150 8 -rw-r--r-- 1 ubuntu ubuntu 7324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/onode_tree/test_value.h 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290147 4 -rw-r--r-- 1 ubuntu ubuntu 467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/onode_tree/CMakeLists.txt 2024-03-27T21:32:58.860 INFO:teuthology.orchestra.run.smithi063.stdout: 290148 12 -rw-r--r-- 1 ubuntu ubuntu 9330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/onode_tree/test_fltree_onode_manager.cc 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290149 76 -rw-r--r-- 1 ubuntu ubuntu 74651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/onode_tree/test_staged_fltree.cc 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290160 36 -rw-r--r-- 1 ubuntu ubuntu 35483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_seastore.cc 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290158 20 -rw-r--r-- 1 ubuntu ubuntu 18590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_omap_manager.cc 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290157 20 -rw-r--r-- 1 ubuntu ubuntu 17176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_object_data_handler.cc 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290164 16 -rw-r--r-- 1 ubuntu ubuntu 12946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/transaction_manager_test_state.h 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290144 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/nvmedevice 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290145 4 -rw-r--r-- 1 ubuntu ubuntu 2936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/nvmedevice/test_nvmedevice.cc 2024-03-27T21:32:58.861 INFO:teuthology.orchestra.run.smithi063.stdout: 290155 8 -rw-r--r-- 1 ubuntu ubuntu 5444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_collection_manager.cc 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290153 20 -rw-r--r-- 1 ubuntu ubuntu 19978 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastore/test_btree_lba_manager.cc 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290172 12 -rw-r--r-- 1 ubuntu ubuntu 8575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_crimson_coroutine.cc 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290176 12 -rw-r--r-- 1 ubuntu ubuntu 9711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_fixed_kv_node_layout.cc 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290168 16 -rw-r--r-- 1 ubuntu ubuntu 14609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_backfill.cc 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290180 4 -rw-r--r-- 1 ubuntu ubuntu 2397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_messenger.h 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290169 4 -rw-r--r-- 1 ubuntu ubuntu 1599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_buffer.cc 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290138 4 -rw-r--r-- 1 ubuntu ubuntu 2566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/ctest_utils.h 2024-03-27T21:32:58.862 INFO:teuthology.orchestra.run.smithi063.stdout: 290141 4 -rw-r--r-- 1 ubuntu ubuntu 2469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/seastar_runner.h 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290139 4 -rw-r--r-- 1 ubuntu ubuntu 1903 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/gtest_seastar.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290184 4 -rw-r--r-- 1 ubuntu ubuntu 1901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_perfcounters.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290175 4 -rw-r--r-- 1 ubuntu ubuntu 2414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_errorator.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290183 4 -rw-r--r-- 1 ubuntu ubuntu 2539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_monc.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290177 12 -rw-r--r-- 1 ubuntu ubuntu 9561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_interruptible_future.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290179 136 -rw-r--r-- 1 ubuntu ubuntu 135398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_messenger.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290166 4 -rw-r--r-- 1 ubuntu ubuntu 2438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crimson/test_alienstore_thread_pool.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290984 4 -rw-r--r-- 1 ubuntu ubuntu 2540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_xlist.cc 2024-03-27T21:32:58.863 INFO:teuthology.orchestra.run.smithi063.stdout: 290714 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290741 64 -rw-r--r-- 1 ubuntu ubuntu 63090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/types.cc 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290721 8 -rw-r--r-- 1 ubuntu ubuntu 6845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestMClockScheduler.cc 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290715 4 -rw-r--r-- 1 ubuntu ubuntu 3575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/CMakeLists.txt 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290722 108 -rw-r--r-- 1 ubuntu ubuntu 110450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestOSDMap.cc 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290729 8 -rw-r--r-- 1 ubuntu ubuntu 5183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/hitset.cc 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290719 100 -rw-r--r-- 1 ubuntu ubuntu 98817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/RadosModel.h 2024-03-27T21:32:58.864 INFO:teuthology.orchestra.run.smithi063.stdout: 290717 16 -rw-r--r-- 1 ubuntu ubuntu 13817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/Object.h 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290724 4 -rw-r--r-- 1 ubuntu ubuntu 1405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestOpStat.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290738 4 -rw-r--r-- 1 ubuntu ubuntu 3250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/test_pg_transaction.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290728 8 -rw-r--r-- 1 ubuntu ubuntu 4536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/ceph_test_osd_stale_read.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290727 24 -rw-r--r-- 1 ubuntu ubuntu 22438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestRados.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290740 20 -rw-r--r-- 1 ubuntu ubuntu 19420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/test_scrubber_be.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290730 100 -rw-r--r-- 1 ubuntu ubuntu 98791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/osdcap.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290736 4 -rw-r--r-- 1 ubuntu ubuntu 3326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/test_ec_transaction.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290732 8 -rw-r--r-- 1 ubuntu ubuntu 4731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/scrubber_generators.cc 2024-03-27T21:32:58.865 INFO:teuthology.orchestra.run.smithi063.stdout: 290734 4 -rw-r--r-- 1 ubuntu ubuntu 2725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/scrubber_test_datasets.cc 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290737 8 -rw-r--r-- 1 ubuntu ubuntu 5929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/test_extent_cache.cc 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290735 4 -rw-r--r-- 1 ubuntu ubuntu 600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/scrubber_test_datasets.h 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290716 8 -rw-r--r-- 1 ubuntu ubuntu 5268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/Object.cc 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290726 100 -rw-r--r-- 1 ubuntu ubuntu 98502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestPGLog.cc 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290731 4 -rwxr-xr-x 1 ubuntu ubuntu 2262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/safe-to-destroy.sh 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290733 8 -rw-r--r-- 1 ubuntu ubuntu 6749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/scrubber_generators.h 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290720 4 -rw-r--r-- 1 ubuntu ubuntu 2005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestECBackend.cc 2024-03-27T21:32:58.866 INFO:teuthology.orchestra.run.smithi063.stdout: 290725 4 -rw-r--r-- 1 ubuntu ubuntu 1199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestOpStat.h 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290718 4 -rw-r--r-- 1 ubuntu ubuntu 833 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/RadosModel.cc 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290723 8 -rw-r--r-- 1 ubuntu ubuntu 8055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/TestOSDScrub.cc 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290739 16 -rw-r--r-- 1 ubuntu ubuntu 13686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osd/test_scrub_sched.cc 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290418 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290419 4 -rw-r--r-- 1 ubuntu ubuntu 1005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper/CMakeLists.txt 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290420 4 -rw-r--r-- 1 ubuntu ubuntu 2025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper/TestCase.cc 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290421 4 -rw-r--r-- 1 ubuntu ubuntu 2186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper/TestCase.h 2024-03-27T21:32:58.867 INFO:teuthology.orchestra.run.smithi063.stdout: 290423 16 -rw-r--r-- 1 ubuntu ubuntu 16023 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper/io.cc 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290424 20 -rw-r--r-- 1 ubuntu ubuntu 16848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper/striping.cc 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290422 20 -rw-r--r-- 1 ubuntu ubuntu 20187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libradosstriper/aio.cc 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290907 4 -rwxr-xr-x 1 ubuntu ubuntu 346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/run-rbd-valgrind-unit-tests.sh 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290217 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290222 4 -rwxr-xr-x 1 ubuntu ubuntu 716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/import-generated.sh 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290220 4 -rwxr-xr-x 1 ubuntu ubuntu 1105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/generate-corpus-objects.sh 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290224 8 -rwxr-xr-x 1 ubuntu ubuntu 7056 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/readable.sh 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290218 4 -rw-r--r-- 1 ubuntu ubuntu 158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/CMakeLists.txt 2024-03-27T21:32:58.868 INFO:teuthology.orchestra.run.smithi063.stdout: 290221 4 -rwxr-xr-x 1 ubuntu ubuntu 664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/identity.sh 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 290219 8 -rwxr-xr-x 1 ubuntu ubuntu 4867 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/check-generated.sh 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 290223 4 -rwxr-xr-x 1 ubuntu ubuntu 497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/encoding/import.sh 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 290316 8 -rw-r--r-- 1 ubuntu ubuntu 5252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/kv_store_bench.h 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 289906 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_queue 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 289907 4 -rw-r--r-- 1 ubuntu ubuntu 308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_queue/CMakeLists.txt 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 289908 24 -rw-r--r-- 1 ubuntu ubuntu 21234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_queue/test_cls_queue.cc 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 290908 4 -rw-r--r-- 1 ubuntu ubuntu 551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/run_cmd.cc 2024-03-27T21:32:58.869 INFO:teuthology.orchestra.run.smithi063.stdout: 290763 4 -rwxr-xr-x 1 ubuntu ubuntu 901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd-ggate.sh 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 290213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/dokan 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 290214 4 -rw-r--r-- 1 ubuntu ubuntu 279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/dokan/CMakeLists.txt 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 290215 28 -rw-r--r-- 1 ubuntu ubuntu 26820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/dokan/dokan.cc 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 290948 4 -rw-r--r-- 1 ubuntu ubuntu 633 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_csyn.sh 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 289704 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 289705 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/balancer 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 289706 4 -rw-r--r-- 1 ubuntu ubuntu 1223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/balancer/misplaced.t 2024-03-27T21:32:58.870 INFO:teuthology.orchestra.run.smithi063.stdout: 289707 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289717 16 -rw-r--r-- 1 ubuntu ubuntu 14182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/unmap.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289711 4 -rw-r--r-- 1 ubuntu ubuntu 1534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/gwcli_delete.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289714 4 -rw-r--r-- 1 ubuntu ubuntu 2255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/rest_api_create.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289716 4 -rw-r--r-- 1 ubuntu ubuntu 2120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/snap-diff.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289713 4 -rw-r--r-- 1 ubuntu ubuntu 2651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/mon-command-help.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289715 4 -rw-r--r-- 1 ubuntu ubuntu 854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/rest_api_delete.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289708 12 -rw-r--r-- 1 ubuntu ubuntu 8760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/defaults.t 2024-03-27T21:32:58.871 INFO:teuthology.orchestra.run.smithi063.stdout: 289709 36 -rw-r--r-- 1 ubuntu ubuntu 33673 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/formatted-output.t 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 289710 8 -rw-r--r-- 1 ubuntu ubuntu 4524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/gwcli_create.t 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 289712 4 -rw-r--r-- 1 ubuntu ubuntu 1444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cli-integration/rbd/iscsi_client.t 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 290936 12 -rw-r--r-- 1 ubuntu ubuntu 9731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_addrs.cc 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 290994 4 -rw-r--r-- 1 ubuntu ubuntu 1407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/unit.cc 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 290298 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 290300 8 -rw-r--r-- 1 ubuntu ubuntu 4199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/RadosTestFixture.cc 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 290299 4 -rw-r--r-- 1 ubuntu ubuntu 661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/CMakeLists.txt 2024-03-27T21:32:58.872 INFO:teuthology.orchestra.run.smithi063.stdout: 290309 8 -rw-r--r-- 1 ubuntu ubuntu 5450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_JournalRecorder.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290301 4 -rw-r--r-- 1 ubuntu ubuntu 2386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/RadosTestFixture.h 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290313 16 -rw-r--r-- 1 ubuntu ubuntu 15613 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_ObjectRecorder.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290312 8 -rw-r--r-- 1 ubuntu ubuntu 8088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_ObjectPlayer.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290308 32 -rw-r--r-- 1 ubuntu ubuntu 31562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_JournalPlayer.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290314 4 -rw-r--r-- 1 ubuntu ubuntu 668 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_main.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290305 4 -rw-r--r-- 1 ubuntu ubuntu 2392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_Entry.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290310 8 -rw-r--r-- 1 ubuntu ubuntu 6515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_JournalTrimmer.cc 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290302 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/mock 2024-03-27T21:32:58.873 INFO:teuthology.orchestra.run.smithi063.stdout: 290304 12 -rw-r--r-- 1 ubuntu ubuntu 10179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/mock/MockJournaler.h 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290303 4 -rw-r--r-- 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/mock/MockJournaler.cc 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290307 8 -rw-r--r-- 1 ubuntu ubuntu 6965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_JournalMetadata.cc 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290311 8 -rw-r--r-- 1 ubuntu ubuntu 5506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_Journaler.cc 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290306 8 -rw-r--r-- 1 ubuntu ubuntu 7631 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/journal/test_FutureImpl.cc 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290131 4 -rwxr-xr-x 1 ubuntu ubuntu 900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/coverage.sh 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290193 12 -rw-r--r-- 1 ubuntu ubuntu 9684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/crypto.cc 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 289671 4 -rw-r--r-- 1 ubuntu ubuntu 2157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket_output.h 2024-03-27T21:32:58.874 INFO:teuthology.orchestra.run.smithi063.stdout: 290986 4 -rw-r--r-- 1 ubuntu ubuntu 1438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/testcrypto.cc 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290122 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290124 4 -rw-r--r-- 1 ubuntu ubuntu 1442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/compressor_example.h 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290123 4 -rw-r--r-- 1 ubuntu ubuntu 381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/CMakeLists.txt 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290129 20 -rw-r--r-- 1 ubuntu ubuntu 17393 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/test_compression.cc 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290126 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/osdmaps 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290127 600 -rw-r--r-- 1 ubuntu ubuntu 612069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/osdmaps/osdmap.2982809 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290128 2632 -rw-r--r-- 1 ubuntu ubuntu 2692799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/osdmaps/osdmap.2982809.h 2024-03-27T21:32:58.875 INFO:teuthology.orchestra.run.smithi063.stdout: 290125 4 -rw-r--r-- 1 ubuntu ubuntu 1555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/compressor/compressor_plugin_example.cc 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 289922 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_sdk 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 289923 4 -rw-r--r-- 1 ubuntu ubuntu 284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_sdk/CMakeLists.txt 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 289924 4 -rw-r--r-- 1 ubuntu ubuntu 984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_sdk/test_cls_sdk.cc 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 290211 12 -rwxr-xr-x 1 ubuntu ubuntu 10592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/docker-test-helper.sh 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 290954 8 -rwxr-xr-x 1 ubuntu ubuntu 6419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_lost.sh 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 289912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_refcount 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 289913 4 -rw-r--r-- 1 ubuntu ubuntu 368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_refcount/CMakeLists.txt 2024-03-27T21:32:58.876 INFO:teuthology.orchestra.run.smithi063.stdout: 289914 20 -rw-r--r-- 1 ubuntu ubuntu 18789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_refcount/test_cls_refcount.cc 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 290977 12 -rw-r--r-- 1 ubuntu ubuntu 9150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_subprocess.cc 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289676 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289677 4 -rw-r--r-- 1 ubuntu ubuntu 1675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/README.md 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289687 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/template 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289688 4 -rw-r--r-- 1 ubuntu ubuntu 1440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/template/bootstrap_script_template 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289689 4 -rw-r--r-- 1 ubuntu ubuntu 878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/template/kcli_plan_template 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289690 4 -rw-r--r-- 1 ubuntu ubuntu 302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/tox.ini 2024-03-27T21:32:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 289678 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289680 4 -rw-r--r-- 1 ubuntu ubuntu 1665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/ceph_shell_test.feature 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289686 4 -rw-r--r-- 1 ubuntu ubuntu 454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/validation_util.py 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289683 4 -rw-r--r-- 1 ubuntu ubuntu 2673 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/kcli_handler.py 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289679 4 -rw-r--r-- 1 ubuntu ubuntu 1744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/ceph_osd_test.feature 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289684 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/steps 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289685 4 -rw-r--r-- 1 ubuntu ubuntu 3754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/steps/ceph_steps.py 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289682 8 -rw-r--r-- 1 ubuntu ubuntu 5810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/environment.py 2024-03-27T21:32:58.878 INFO:teuthology.orchestra.run.smithi063.stdout: 289681 4 -rw-r--r-- 1 ubuntu ubuntu 767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/behave_tests/features/cephadm_test.feature 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290963 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rados_tool.sh -> ../../qa/workunits/rados/test_rados_tool.sh 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290257 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fedora-33 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290260 0 lrwxrwxrwx 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fedora-33/install-deps.sh -> ../../../install-deps.sh 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290258 4 -rw-r--r-- 1 ubuntu ubuntu 1003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fedora-33/Dockerfile.in 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290259 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fedora-33/ceph.spec.in -> ../../../ceph.spec.in 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290322 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290332 4 -rw-r--r-- 1 ubuntu ubuntu 2854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/monconfig.cc 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290337 4 -rw-r--r-- 1 ubuntu ubuntu 3627 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/reclaim.cc 2024-03-27T21:32:58.879 INFO:teuthology.orchestra.run.smithi063.stdout: 290326 4 -rw-r--r-- 1 ubuntu ubuntu 2644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/caps.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290323 4 -rw-r--r-- 1 ubuntu ubuntu 2391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/CMakeLists.txt 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290325 12 -rw-r--r-- 1 ubuntu ubuntu 11920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/acl.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290331 4 -rw-r--r-- 1 ubuntu ubuntu 1108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/main.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290333 8 -rw-r--r-- 1 ubuntu ubuntu 5089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/multiclient.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290329 20 -rw-r--r-- 1 ubuntu ubuntu 19512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/flock.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290324 16 -rw-r--r-- 1 ubuntu ubuntu 14953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/access.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290334 4 -rw-r--r-- 1 ubuntu ubuntu 2418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/newops.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290328 16 -rw-r--r-- 1 ubuntu ubuntu 13820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/deleg.cc 2024-03-27T21:32:58.880 INFO:teuthology.orchestra.run.smithi063.stdout: 290340 12 -rw-r--r-- 1 ubuntu ubuntu 10664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/suidsgid.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290335 8 -rw-r--r-- 1 ubuntu ubuntu 6023 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/quota.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290327 4 -rw-r--r-- 1 ubuntu ubuntu 958 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/ceph_pthread_self.h 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290339 60 -rw-r--r-- 1 ubuntu ubuntu 60828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/snapdiff.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290341 128 -rw-r--r-- 1 ubuntu ubuntu 127923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/test.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290342 12 -rw-r--r-- 1 ubuntu ubuntu 11147 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/vxattr.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290330 16 -rw-r--r-- 1 ubuntu ubuntu 12730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/lazyio.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290336 4 -rw-r--r-- 1 ubuntu ubuntu 2223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/readdir_r_cb.cc 2024-03-27T21:32:58.881 INFO:teuthology.orchestra.run.smithi063.stdout: 290338 32 -rw-r--r-- 1 ubuntu ubuntu 31209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs/recordlock.cc 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 290983 4 -rw-r--r-- 1 ubuntu ubuntu 2428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_workqueue.cc 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 290946 36 -rw-r--r-- 1 ubuntu ubuntu 34226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_cors.cc 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 289888 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_hello 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 289889 4 -rw-r--r-- 1 ubuntu ubuntu 292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_hello/CMakeLists.txt 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 289890 12 -rw-r--r-- 1 ubuntu ubuntu 9493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_hello/test_cls_hello.cc 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 290315 20 -rw-r--r-- 1 ubuntu ubuntu 16597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/kv_store_bench.cc 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 290976 4 -rw-r--r-- 1 ubuntu ubuntu 1945 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_striper.cc 2024-03-27T21:32:58.882 INFO:teuthology.orchestra.run.smithi063.stdout: 290945 8 -rwxr-xr-x 1 ubuntu ubuntu 4371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_common.sh 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290287 4 -rw-r--r-- 1 ubuntu ubuntu 1172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/heartbeat_map.cc 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290905 4 -rwxr-xr-x 1 ubuntu ubuntu 1550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/run-rbd-tests 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290958 4 -rwxr-xr-x 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_objectstore_memstore.sh 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290343 4 -rw-r--r-- 1 ubuntu ubuntu 1645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/libcephfs_config.cc 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290987 4 -rw-r--r-- 1 ubuntu ubuntu 1647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/testkeys.cc 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290751 4 -rw-r--r-- 1 ubuntu ubuntu 1098 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/perf_helper.h 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290955 12 -rw-r--r-- 1 ubuntu ubuntu 11250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_mempool.cc 2024-03-27T21:32:58.883 INFO:teuthology.orchestra.run.smithi063.stdout: 290989 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ubuntu-18.04 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 290991 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ubuntu-18.04/debian -> ../../../debian/ 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 290992 0 lrwxrwxrwx 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ubuntu-18.04/install-deps.sh -> ../../../install-deps.sh 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 290990 4 -rw-r--r-- 1 ubuntu ubuntu 1138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ubuntu-18.04/Dockerfile.in 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 289900 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_lua 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 289901 4 -rw-r--r-- 1 ubuntu ubuntu 369 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_lua/CMakeLists.txt 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 289902 32 -rw-r--r-- 1 ubuntu ubuntu 29635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_lua/test_cls_lua.cc 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 290764 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 290801 12 -rw-r--r-- 1 ubuntu ubuntu 10210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_ImageDeleter.cc 2024-03-27T21:32:58.884 INFO:teuthology.orchestra.run.smithi063.stdout: 290809 4 -rw-r--r-- 1 ubuntu ubuntu 1623 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_fixture.h 2024-03-27T21:32:58.885 INFO:teuthology.orchestra.run.smithi063.stdout: 290820 28 -rw-r--r-- 1 ubuntu ubuntu 25382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_PoolWatcher.cc 2024-03-27T21:32:58.885 INFO:teuthology.orchestra.run.smithi063.stdout: 290765 4 -rw-r--r-- 1 ubuntu ubuntu 2769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/CMakeLists.txt 2024-03-27T21:32:58.885 INFO:teuthology.orchestra.run.smithi063.stdout: 290802 52 -rw-r--r-- 1 ubuntu ubuntu 52219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_ImageReplayer.cc 2024-03-27T21:32:58.885 INFO:teuthology.orchestra.run.smithi063.stdout: 290815 36 -rw-r--r-- 1 ubuntu ubuntu 34516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_InstanceWatcher.cc 2024-03-27T21:32:58.885 INFO:teuthology.orchestra.run.smithi063.stdout: 290808 8 -rw-r--r-- 1 ubuntu ubuntu 4486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_fixture.cc 2024-03-27T21:32:58.885 INFO:teuthology.orchestra.run.smithi063.stdout: 290819 36 -rw-r--r-- 1 ubuntu ubuntu 34094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_PoolReplayer.cc 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290803 16 -rw-r--r-- 1 ubuntu ubuntu 12634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_ImageSync.cc 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290773 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290786 20 -rw-r--r-- 1 ubuntu ubuntu 19562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/test_mock_PrepareLocalImageRequest.cc 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290785 4 -rw-r--r-- 1 ubuntu ubuntu 3278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/test_mock_GetMirrorImageIdRequest.cc 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290784 24 -rw-r--r-- 1 ubuntu ubuntu 24010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/test_mock_CreateImageRequest.cc 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290774 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/journal 2024-03-27T21:32:58.886 INFO:teuthology.orchestra.run.smithi063.stdout: 290778 92 -rw-r--r-- 1 ubuntu ubuntu 90150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/journal/test_mock_Replayer.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290776 12 -rw-r--r-- 1 ubuntu ubuntu 10436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/journal/test_mock_EventPreprocessor.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290775 12 -rw-r--r-- 1 ubuntu ubuntu 11447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/journal/test_mock_CreateLocalImageRequest.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290777 32 -rw-r--r-- 1 ubuntu ubuntu 30401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/journal/test_mock_PrepareReplayRequest.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290783 48 -rw-r--r-- 1 ubuntu ubuntu 48271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/test_mock_BootstrapRequest.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290787 36 -rw-r--r-- 1 ubuntu ubuntu 34554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/test_mock_PrepareRemoteImageRequest.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290779 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/snapshot 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290782 140 -rw-r--r-- 1 ubuntu ubuntu 140167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/snapshot/test_mock_Replayer.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290781 12 -rw-r--r-- 1 ubuntu ubuntu 12055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/snapshot/test_mock_CreateLocalImageRequest.cc 2024-03-27T21:32:58.887 INFO:teuthology.orchestra.run.smithi063.stdout: 290780 24 -rw-r--r-- 1 ubuntu ubuntu 22802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_replayer/snapshot/test_mock_ApplyImageStateRequest.cc 2024-03-27T21:32:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: 290771 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_map 2024-03-27T21:32:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: 290772 16 -rw-r--r-- 1 ubuntu ubuntu 13298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_map/test_Policy.cc 2024-03-27T21:32:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: 290812 32 -rw-r--r-- 1 ubuntu ubuntu 30818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_ImageReplayer.cc 2024-03-27T21:32:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: 290797 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/pool_watcher 2024-03-27T21:32:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: 290798 4 -rw-r--r-- 1 ubuntu ubuntu 3595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/pool_watcher/test_mock_RefreshImagesRequest.cc 2024-03-27T21:32:58.889 INFO:teuthology.orchestra.run.smithi063.stdout: 290800 8 -rw-r--r-- 1 ubuntu ubuntu 8113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_ClusterWatcher.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290817 24 -rw-r--r-- 1 ubuntu ubuntu 24494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_MirrorStatusUpdater.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290805 8 -rw-r--r-- 1 ubuntu ubuntu 4603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_Instances.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290810 4 -rw-r--r-- 1 ubuntu ubuntu 1558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_main.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290799 8 -rw-r--r-- 1 ubuntu ubuntu 5727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/random_write.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290788 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_sync 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290790 16 -rw-r--r-- 1 ubuntu ubuntu 13207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_sync/test_mock_SyncPointPruneRequest.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290789 8 -rw-r--r-- 1 ubuntu ubuntu 6891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_sync/test_mock_SyncPointCreateRequest.cc 2024-03-27T21:32:58.890 INFO:teuthology.orchestra.run.smithi063.stdout: 290822 4 -rw-r--r-- 1 ubuntu ubuntu 2136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_fixture.cc 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290791 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/mock 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290793 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/mock/MockContextWQ.h 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290795 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/mock/image_sync 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290796 4 -rw-r--r-- 1 ubuntu ubuntu 821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/mock/image_sync/MockSyncPointHandler.h 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290792 4 -rw-r--r-- 1 ubuntu ubuntu 524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/mock/MockBaseRequest.h 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290794 4 -rw-r--r-- 1 ubuntu ubuntu 373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/mock/MockSafeTimer.h 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290766 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_deleter 2024-03-27T21:32:58.891 INFO:teuthology.orchestra.run.smithi063.stdout: 290770 20 -rw-r--r-- 1 ubuntu ubuntu 16868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_deleter/test_mock_TrashWatcher.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290769 16 -rw-r--r-- 1 ubuntu ubuntu 15149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_deleter/test_mock_TrashRemoveRequest.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290767 16 -rw-r--r-- 1 ubuntu ubuntu 16334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_deleter/test_mock_SnapshotPurgeRequest.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290768 36 -rw-r--r-- 1 ubuntu ubuntu 34172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/image_deleter/test_mock_TrashMoveRequest.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290813 20 -rw-r--r-- 1 ubuntu ubuntu 18060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_ImageSync.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290807 8 -rw-r--r-- 1 ubuntu ubuntu 8152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_PoolWatcher.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290823 4 -rw-r--r-- 1 ubuntu ubuntu 1628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_fixture.h 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290806 12 -rw-r--r-- 1 ubuntu ubuntu 9354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_LeaderWatcher.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290814 16 -rw-r--r-- 1 ubuntu ubuntu 12869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_InstanceReplayer.cc 2024-03-27T21:32:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: 290816 20 -rw-r--r-- 1 ubuntu ubuntu 20057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_LeaderWatcher.cc 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290804 8 -rw-r--r-- 1 ubuntu ubuntu 4097 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_InstanceWatcher.cc 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290818 24 -rw-r--r-- 1 ubuntu ubuntu 21510 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_NamespaceReplayer.cc 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290811 60 -rw-r--r-- 1 ubuntu ubuntu 57432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_ImageMap.cc 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290821 8 -rw-r--r-- 1 ubuntu ubuntu 7264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/rbd_mirror/test_mock_Throttler.cc 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290606 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mds 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290607 4 -rw-r--r-- 1 ubuntu ubuntu 1076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mds/CMakeLists.txt 2024-03-27T21:32:58.893 INFO:teuthology.orchestra.run.smithi063.stdout: 290610 56 -rw-r--r-- 1 ubuntu ubuntu 55287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mds/TestQuiesceDb.cc 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 290608 16 -rw-r--r-- 1 ubuntu ubuntu 15600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mds/TestMDSAuthCaps.cc 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 290611 4 -rw-r--r-- 1 ubuntu ubuntu 3870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mds/TestSessionFilter.cc 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 290609 20 -rw-r--r-- 1 ubuntu ubuntu 16904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/mds/TestQuiesceAgent.cc 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 290261 0 lrwxrwxrwx 1 ubuntu ubuntu 9 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/fedora-34 -> fedora-33 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 290944 4 -rw-r--r-- 1 ubuntu ubuntu 1005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_cfuse_cache_invalidate.cc 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 289894 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_lock 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 289895 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_lock/CMakeLists.txt 2024-03-27T21:32:58.894 INFO:teuthology.orchestra.run.smithi063.stdout: 289896 16 -rw-r--r-- 1 ubuntu ubuntu 16127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_lock/test_cls_lock.cc 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 290904 4 -rwxr-xr-x 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/run-cli-tests-maybe-unset-ccache 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289869 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289873 4 -rw-r--r-- 1 ubuntu ubuntu 1216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/commands.cc 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289870 4 -rw-r--r-- 1 ubuntu ubuntu 392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/CMakeLists.txt 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289876 4 -rw-r--r-- 1 ubuntu ubuntu 820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/main.cc 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289877 20 -rw-r--r-- 1 ubuntu ubuntu 17603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/nonblocking.cc 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289878 4 -rw-r--r-- 1 ubuntu ubuntu 1342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/ops.cc 2024-03-27T21:32:58.895 INFO:teuthology.orchestra.run.smithi063.stdout: 289872 8 -rw-r--r-- 1 ubuntu ubuntu 6354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/alternate_name.cc 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 289875 4 -rwxr-xr-x 1 ubuntu ubuntu 153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/kernel_untar_build.sh 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 289871 8 -rw-r--r-- 1 ubuntu ubuntu 4990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/TestClient.h 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 289874 4 -rwxr-xr-x 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/client/iozone.sh 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 290975 4 -rw-r--r-- 1 ubuntu ubuntu 2922 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_stress_watch.cc 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 290996 4 -rwxr-xr-x 1 ubuntu ubuntu 2231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/vstart_wrapper.sh 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 290971 4 -rwxr-xr-x 1 ubuntu ubuntu 854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rw.sh 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 290953 28 -rw-r--r-- 1 ubuntu ubuntu 27294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_ipaddr.cc 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 290201 4 -rw-r--r-- 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/detect-build-env-vars.sh 2024-03-27T21:32:58.896 INFO:teuthology.orchestra.run.smithi063.stdout: 289655 4 -rw-r--r-- 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/.gitignore 2024-03-27T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 289909 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rbd 2024-03-27T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 289910 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rbd/CMakeLists.txt 2024-03-27T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 289911 124 -rw-r--r-- 1 ubuntu ubuntu 125038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_rbd/test_cls_rbd.cc 2024-03-27T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 290702 12 -rw-r--r-- 1 ubuntu ubuntu 9291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/objectstore_bench.cc 2024-03-27T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 290742 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc 2024-03-27T21:32:58.897 INFO:teuthology.orchestra.run.smithi063.stdout: 290743 4 -rw-r--r-- 1 ubuntu ubuntu 303 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc/CMakeLists.txt 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290744 4 -rw-r--r-- 1 ubuntu ubuntu 2576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc/FakeWriteback.cc 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290748 16 -rw-r--r-- 1 ubuntu ubuntu 13621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc/object_cacher_stress.cc 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290747 4 -rw-r--r-- 1 ubuntu ubuntu 1688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc/MemWriteback.h 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290745 4 -rw-r--r-- 1 ubuntu ubuntu 1424 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc/FakeWriteback.h 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290746 8 -rw-r--r-- 1 ubuntu ubuntu 4928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/osdc/MemWriteback.cc 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 289691 4 -rw-r--r-- 1 ubuntu ubuntu 535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/bench_journald_logger.cc 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290603 32 -rw-r--r-- 1 ubuntu ubuntu 32390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_nfsns.cc 2024-03-27T21:32:58.898 INFO:teuthology.orchestra.run.smithi063.stdout: 290709 4 -rw-r--r-- 1 ubuntu ubuntu 2748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/on_exit.cc 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 290703 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/old 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 290706 4 -rw-r--r-- 1 ubuntu ubuntu 444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/old/testfilepath.cc 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 290704 4 -rw-r--r-- 1 ubuntu ubuntu 1280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/old/test_disk_bw.cc 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 290705 4 -rw-r--r-- 1 ubuntu ubuntu 498 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/old/test_setlayout.c 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 290599 12 -rw-r--r-- 1 ubuntu ubuntu 10914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_aw.cc 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 289657 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 289658 4 -rw-r--r-- 1 ubuntu ubuntu 803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap/CMakeLists.txt 2024-03-27T21:32:58.899 INFO:teuthology.orchestra.run.smithi063.stdout: 289663 32 -rw-r--r-- 1 ubuntu ubuntu 31252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap/test_object_map.cc 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 289661 4 -rw-r--r-- 1 ubuntu ubuntu 3191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap/test_keyvaluedb_atomicity.cc 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 289659 8 -rw-r--r-- 1 ubuntu ubuntu 5982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap/KeyValueDBMemory.cc 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 289660 8 -rw-r--r-- 1 ubuntu ubuntu 4938 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap/KeyValueDBMemory.h 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 289662 56 -rw-r--r-- 1 ubuntu ubuntu 55602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/ObjectMap/test_keyvaluedb_iterators.cc 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 290288 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 290290 4 -rw-r--r-- 1 ubuntu ubuntu 1237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/MockCacheDaemon.h 2024-03-27T21:32:58.900 INFO:teuthology.orchestra.run.smithi063.stdout: 290291 8 -rw-r--r-- 1 ubuntu ubuntu 5323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_DomainSocket.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290289 4 -rw-r--r-- 1 ubuntu ubuntu 684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/CMakeLists.txt 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290296 8 -rw-r--r-- 1 ubuntu ubuntu 4948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_multi_session.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290297 4 -rw-r--r-- 1 ubuntu ubuntu 3068 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_object_store.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290294 4 -rw-r--r-- 1 ubuntu ubuntu 728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_main.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290295 4 -rw-r--r-- 1 ubuntu ubuntu 1963 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_message.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290292 12 -rw-r--r-- 1 ubuntu ubuntu 12207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_SimplePolicy.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290293 4 -rw-r--r-- 1 ubuntu ubuntu 846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/immutable_object_cache/test_common.h 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290604 8 -rw-r--r-- 1 ubuntu ubuntu 7875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_rename.cc 2024-03-27T21:32:58.901 INFO:teuthology.orchestra.run.smithi063.stdout: 290649 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290670 8 -rw-r--r-- 1 ubuntu ubuntu 5453 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/write_operations.cc 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290667 8 -rw-r--r-- 1 ubuntu ubuntu 4876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/start_stop.cc 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290650 8 -rw-r--r-- 1 ubuntu ubuntu 5216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/CMakeLists.txt 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290656 4 -rw-r--r-- 1 ubuntu ubuntu 3315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/ec_io.cc 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290655 4 -rw-r--r-- 1 ubuntu ubuntu 317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/completions.cc 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290663 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/op_speed.cc 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290668 4 -rw-r--r-- 1 ubuntu ubuntu 1143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/test_neorados.cc 2024-03-27T21:32:58.902 INFO:teuthology.orchestra.run.smithi063.stdout: 290666 16 -rw-r--r-- 1 ubuntu ubuntu 14965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/snapshots.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290665 24 -rw-r--r-- 1 ubuntu ubuntu 22359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/read_operations.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290662 12 -rw-r--r-- 1 ubuntu ubuntu 8880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/misc.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290657 4 -rw-r--r-- 1 ubuntu ubuntu 3818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/ec_list.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290658 4 -rw-r--r-- 1 ubuntu ubuntu 1497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/handler_error.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290661 8 -rw-r--r-- 1 ubuntu ubuntu 4278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/list_pool.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290654 20 -rw-r--r-- 1 ubuntu ubuntu 17571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/common_tests.h 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290660 4 -rw-r--r-- 1 ubuntu ubuntu 3892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/list.cc 2024-03-27T21:32:58.903 INFO:teuthology.orchestra.run.smithi063.stdout: 290652 4 -rw-r--r-- 1 ubuntu ubuntu 3091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/cmd.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290651 4 -rw-r--r-- 1 ubuntu ubuntu 2559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/cls.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290653 4 -rw-r--r-- 1 ubuntu ubuntu 2453 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/common_tests.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290659 12 -rw-r--r-- 1 ubuntu ubuntu 10931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/io.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290664 8 -rw-r--r-- 1 ubuntu ubuntu 4956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/pool.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290669 8 -rw-r--r-- 1 ubuntu ubuntu 5656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/neorados/watch_notify.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290240 8 -rw-r--r-- 1 ubuntu ubuntu 4366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodePlugin.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290238 12 -rw-r--r-- 1 ubuntu ubuntu 11003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeJerasure.cc 2024-03-27T21:32:58.904 INFO:teuthology.orchestra.run.smithi063.stdout: 290232 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodePluginMissingEntryPoint.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290242 4 -rw-r--r-- 1 ubuntu ubuntu 1815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodePluginIsa.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290226 8 -rw-r--r-- 1 ubuntu ubuntu 7183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/CMakeLists.txt 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290248 12 -rw-r--r-- 1 ubuntu ubuntu 11876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeShec_arguments.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290244 4 -rw-r--r-- 1 ubuntu ubuntu 1539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodePluginLrc.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290229 4 -rw-r--r-- 1 ubuntu ubuntu 791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodePluginFailToInitialize.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290250 12 -rw-r--r-- 1 ubuntu ubuntu 10659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ceph_erasure_code_benchmark.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290233 4 -rw-r--r-- 1 ubuntu ubuntu 85 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodePluginMissingVersion.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290234 8 -rw-r--r-- 1 ubuntu ubuntu 5710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCode.cc 2024-03-27T21:32:58.905 INFO:teuthology.orchestra.run.smithi063.stdout: 290227 8 -rw-r--r-- 1 ubuntu ubuntu 5876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodeExample.h 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290251 4 -rw-r--r-- 1 ubuntu ubuntu 1482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ceph_erasure_code_benchmark.h 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290228 4 -rw-r--r-- 1 ubuntu ubuntu 1376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodePluginExample.cc 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290246 76 -rw-r--r-- 1 ubuntu ubuntu 76300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeShec.cc 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290245 4 -rw-r--r-- 1 ubuntu ubuntu 1977 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodePluginShec.cc 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290252 12 -rw-r--r-- 1 ubuntu ubuntu 9521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ceph_erasure_code_non_regression.cc 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290237 32 -rw-r--r-- 1 ubuntu ubuntu 31936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeIsa.cc 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290249 8 -rw-r--r-- 1 ubuntu ubuntu 5809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeShec_thread.cc 2024-03-27T21:32:58.906 INFO:teuthology.orchestra.run.smithi063.stdout: 290236 8 -rw-r--r-- 1 ubuntu ubuntu 7018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeExample.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290247 12 -rw-r--r-- 1 ubuntu ubuntu 9076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeShec_all.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290235 20 -rw-r--r-- 1 ubuntu ubuntu 20469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeClay.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290241 4 -rw-r--r-- 1 ubuntu ubuntu 3539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodePluginClay.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290231 4 -rw-r--r-- 1 ubuntu ubuntu 800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodePluginHangs.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290230 4 -rw-r--r-- 1 ubuntu ubuntu 767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/ErasureCodePluginFailToRegister.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290243 4 -rw-r--r-- 1 ubuntu ubuntu 2122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodePluginJerasure.cc 2024-03-27T21:32:58.907 INFO:teuthology.orchestra.run.smithi063.stdout: 290239 32 -rw-r--r-- 1 ubuntu ubuntu 29144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/erasure-code/TestErasureCodeLrc.cc 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290956 4 -rwxr-xr-x 1 ubuntu ubuntu 512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_missing_unfound.sh 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 289670 8 -rw-r--r-- 1 ubuntu ubuntu 7700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/admin_socket_output.cc 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290212 4 -rwxr-xr-x 1 ubuntu ubuntu 649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/docker-test.sh 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290202 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290206 4 -rw-r--r-- 1 ubuntu ubuntu 906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/DispatchStrategy.h 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290203 4 -rw-r--r-- 1 ubuntu ubuntu 302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/CMakeLists.txt 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290208 4 -rw-r--r-- 1 ubuntu ubuntu 2295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/QueueStrategy.cc 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290207 4 -rw-r--r-- 1 ubuntu ubuntu 900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/FastStrategy.h 2024-03-27T21:32:58.908 INFO:teuthology.orchestra.run.smithi063.stdout: 290210 16 -rw-r--r-- 1 ubuntu ubuntu 13475 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/test_direct_messenger.cc 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290205 4 -rw-r--r-- 1 ubuntu ubuntu 3186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/DirectMessenger.h 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290204 8 -rw-r--r-- 1 ubuntu ubuntu 6907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/DirectMessenger.cc 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290209 4 -rw-r--r-- 1 ubuntu ubuntu 1597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/direct_messenger/QueueStrategy.h 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290413 4 -rw-r--r-- 1 ubuntu ubuntu 2667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestMemRadosClient.h 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290406 12 -rw-r--r-- 1 ubuntu ubuntu 11565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestIoCtxImpl.cc 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290396 4 -rw-r--r-- 1 ubuntu ubuntu 286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/CMakeLists.txt 2024-03-27T21:32:58.909 INFO:teuthology.orchestra.run.smithi063.stdout: 290411 8 -rw-r--r-- 1 ubuntu ubuntu 4396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestMemIoCtxImpl.h 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290404 4 -rw-r--r-- 1 ubuntu ubuntu 2063 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestClassHandler.h 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290397 52 -rw-r--r-- 1 ubuntu ubuntu 51065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/LibradosTestStub.cc 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290417 8 -rw-r--r-- 1 ubuntu ubuntu 5364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestWatchNotify.h 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290401 8 -rw-r--r-- 1 ubuntu ubuntu 4561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/MockTestMemRadosClient.h 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290398 4 -rw-r--r-- 1 ubuntu ubuntu 1008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/LibradosTestStub.h 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290410 28 -rw-r--r-- 1 ubuntu ubuntu 25213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestMemIoCtxImpl.cc 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290405 4 -rw-r--r-- 1 ubuntu ubuntu 1565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestCluster.h 2024-03-27T21:32:58.910 INFO:teuthology.orchestra.run.smithi063.stdout: 290412 4 -rw-r--r-- 1 ubuntu ubuntu 3360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestMemRadosClient.cc 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290399 4 -rw-r--r-- 1 ubuntu ubuntu 984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/MockTestMemCluster.h 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290415 8 -rw-r--r-- 1 ubuntu ubuntu 4728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestRadosClient.h 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290402 20 -rw-r--r-- 1 ubuntu ubuntu 19985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/NeoradosTestStub.cc 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290414 8 -rw-r--r-- 1 ubuntu ubuntu 8123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestRadosClient.cc 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290400 12 -rw-r--r-- 1 ubuntu ubuntu 12014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/MockTestMemIoCtxImpl.h 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290408 8 -rw-r--r-- 1 ubuntu ubuntu 5538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestMemCluster.cc 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290409 4 -rw-r--r-- 1 ubuntu ubuntu 3468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestMemCluster.h 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290407 12 -rw-r--r-- 1 ubuntu ubuntu 8907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestIoCtxImpl.h 2024-03-27T21:32:58.911 INFO:teuthology.orchestra.run.smithi063.stdout: 290403 8 -rw-r--r-- 1 ubuntu ubuntu 4570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestClassHandler.cc 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 290416 20 -rw-r--r-- 1 ubuntu ubuntu 16552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librados_test_stub/TestWatchNotify.cc 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 290286 4 -rw-r--r-- 1 ubuntu ubuntu 3605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/gprof-helper.c 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 290957 4 -rw-r--r-- 1 ubuntu ubuntu 2870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_mutate.cc 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 289879 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_2pc_queue 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 289880 4 -rw-r--r-- 1 ubuntu ubuntu 348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_2pc_queue/CMakeLists.txt 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 289881 40 -rw-r--r-- 1 ubuntu ubuntu 40846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_2pc_queue/test_cls_2pc_queue.cc 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 290965 4 -rw-r--r-- 1 ubuntu ubuntu 4039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rbd_replay.cc 2024-03-27T21:32:58.912 INFO:teuthology.orchestra.run.smithi063.stdout: 289928 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290086 4 -rw-r--r-- 1 ubuntu ubuntu 1907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_hostname.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290106 8 -rw-r--r-- 1 ubuntu ubuntu 6051 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_random.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290072 8 -rw-r--r-- 1 ubuntu ubuntu 6692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blocked_completion.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 289962 4 -rw-r--r-- 1 ubuntu ubuntu 2523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_allocate_unique.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290110 16 -rw-r--r-- 1 ubuntu ubuntu 13996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_shunique_lock.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290105 4 -rw-r--r-- 1 ubuntu ubuntu 3706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_rabin_chunk.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290095 4 -rw-r--r-- 1 ubuntu ubuntu 4085 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_lru.cc 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 289931 4 -rw-r--r-- 1 ubuntu ubuntu 2837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/ObjectContents.h 2024-03-27T21:32:58.913 INFO:teuthology.orchestra.run.smithi063.stdout: 290091 4 -rw-r--r-- 1 ubuntu ubuntu 1007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_journald_logger.cc 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 290114 4 -rw-r--r-- 1 ubuntu ubuntu 2485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_str_map.cc 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 290077 12 -rw-r--r-- 1 ubuntu ubuntu 10802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_config.cc 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 289929 12 -rw-r--r-- 1 ubuntu ubuntu 11554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/CMakeLists.txt 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 290120 8 -rw-r--r-- 1 ubuntu ubuntu 7795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_weighted_priority_queue.cc 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 289958 8 -rw-r--r-- 1 ubuntu ubuntu 5042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/dns_messages.h 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 290094 4 -rw-r--r-- 1 ubuntu ubuntu 1749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_lockdep.cc 2024-03-27T21:32:58.914 INFO:teuthology.orchestra.run.smithi063.stdout: 290075 8 -rw-r--r-- 1 ubuntu ubuntu 4405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_cdc.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 290111 4 -rw-r--r-- 1 ubuntu ubuntu 2761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_sloppy_crc_map.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 289966 12 -rw-r--r-- 1 ubuntu ubuntu 9607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_bit_vector.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 289964 12 -rw-r--r-- 1 ubuntu ubuntu 10824 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_async_shared_mutex.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 290118 4 -rw-r--r-- 1 ubuntu ubuntu 1036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_util.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 290100 4 -rw-r--r-- 1 ubuntu ubuntu 1707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_option.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 290097 4 -rw-r--r-- 1 ubuntu ubuntu 2114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_memory.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 289930 4 -rw-r--r-- 1 ubuntu ubuntu 3150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/ObjectContents.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 290098 4 -rw-r--r-- 1 ubuntu ubuntu 2399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_mutex_debug.cc 2024-03-27T21:32:58.915 INFO:teuthology.orchestra.run.smithi063.stdout: 290081 20 -rw-r--r-- 1 ubuntu ubuntu 19624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_crc32c.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 289967 4 -rw-r--r-- 1 ubuntu ubuntu 2842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 290102 12 -rw-r--r-- 1 ubuntu ubuntu 8897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_perf_histogram.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 289965 4 -rw-r--r-- 1 ubuntu ubuntu 1219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_back_trace.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 290117 4 -rw-r--r-- 1 ubuntu ubuntu 1134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_url_escape.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 290104 8 -rw-r--r-- 1 ubuntu ubuntu 6136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_prioritized_queue.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 290093 8 -rw-r--r-- 1 ubuntu ubuntu 4218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_json_formatter.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 290116 8 -rw-r--r-- 1 ubuntu ubuntu 7094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_time.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 289961 4 -rw-r--r-- 1 ubuntu ubuntu 2478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/histogram.cc 2024-03-27T21:32:58.916 INFO:teuthology.orchestra.run.smithi063.stdout: 290103 4 -rw-r--r-- 1 ubuntu ubuntu 2046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_pretty_binary.cc 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289968 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289969 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289970 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289971 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289972 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289978 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iosched 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289982 4 -rw-r--r-- 1 ubuntu ubuntu 5 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iosched/write_expire 2024-03-27T21:32:58.917 INFO:teuthology.orchestra.run.smithi063.stdout: 289980 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iosched/front_merges 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289979 4 -rw-r--r-- 1 ubuntu ubuntu 3 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iosched/fifo_batch 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289983 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iosched/writes_starved 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289981 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iosched/read_expire 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289988 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/max_sectors_kb 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289975 4 -rw-r--r-- 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/discard_max_bytes 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289994 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/optimal_io_size 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289989 4 -rw-r--r-- 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/max_segment_size 2024-03-27T21:32:58.918 INFO:teuthology.orchestra.run.smithi063.stdout: 289974 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/discard_granularity 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 290000 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/write_same_max_bytes 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289973 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/add_random 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289976 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/discard_zeroes_data 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289996 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/read_ahead_kb 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289999 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/scheduler 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289986 4 -rw-r--r-- 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/max_hw_sectors_kb 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289997 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/rotational 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289984 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/iostats 2024-03-27T21:32:58.919 INFO:teuthology.orchestra.run.smithi063.stdout: 289998 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/rq_affinity 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289990 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/max_segments 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289992 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/nomerges 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289993 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/nr_requests 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289987 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/max_integrity_segments 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289977 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/hw_sector_size 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289991 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/minimum_io_size 2024-03-27T21:32:58.920 INFO:teuthology.orchestra.run.smithi063.stdout: 289995 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/physical_block_size 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 289985 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/cciss!c0d1/queue/logical_block_size 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290036 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290039 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/device 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290040 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/device/model 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290038 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/dev 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290042 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290048 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iosched 2024-03-27T21:32:58.921 INFO:teuthology.orchestra.run.smithi063.stdout: 290052 4 -rw-r--r-- 1 ubuntu ubuntu 5 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iosched/write_expire 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290050 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iosched/front_merges 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290049 4 -rw-r--r-- 1 ubuntu ubuntu 3 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iosched/fifo_batch 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290053 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iosched/writes_starved 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290051 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iosched/read_expire 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290058 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/max_sectors_kb 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290045 4 -rw-r--r-- 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/discard_max_bytes 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290064 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/optimal_io_size 2024-03-27T21:32:58.922 INFO:teuthology.orchestra.run.smithi063.stdout: 290059 4 -rw-r--r-- 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/max_segment_size 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290044 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/discard_granularity 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290071 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/write_same_max_bytes 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290043 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/add_random 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290046 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/discard_zeroes_data 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290067 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/read_ahead_kb 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290070 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/scheduler 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290056 4 -rw-r--r-- 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/max_hw_sectors_kb 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290066 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/queue 2024-03-27T21:32:58.923 INFO:teuthology.orchestra.run.smithi063.stdout: 290068 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/rotational 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290054 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/iostats 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290069 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/rq_affinity 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290060 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/max_segments 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290062 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/nomerges 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290063 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/nr_requests 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290057 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/max_integrity_segments 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290047 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/hw_sector_size 2024-03-27T21:32:58.924 INFO:teuthology.orchestra.run.smithi063.stdout: 290061 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/minimum_io_size 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290065 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/physical_block_size 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290055 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/queue/logical_block_size 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290041 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/foo 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290037 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sdb/bar 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290001 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290004 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/device 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290005 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/device/model 2024-03-27T21:32:58.925 INFO:teuthology.orchestra.run.smithi063.stdout: 290003 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/dev 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290007 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290013 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iosched 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290017 4 -rw-r--r-- 1 ubuntu ubuntu 5 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iosched/write_expire 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290015 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iosched/front_merges 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290014 4 -rw-r--r-- 1 ubuntu ubuntu 3 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iosched/fifo_batch 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290018 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iosched/writes_starved 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290016 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iosched/read_expire 2024-03-27T21:32:58.926 INFO:teuthology.orchestra.run.smithi063.stdout: 290023 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/max_sectors_kb 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290010 4 -rw-r--r-- 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/discard_max_bytes 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290029 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/optimal_io_size 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290024 4 -rw-r--r-- 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/max_segment_size 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290009 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/discard_granularity 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290035 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/write_same_max_bytes 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290008 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/add_random 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290011 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/discard_zeroes_data 2024-03-27T21:32:58.927 INFO:teuthology.orchestra.run.smithi063.stdout: 290031 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/read_ahead_kb 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290034 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/scheduler 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290021 4 -rw-r--r-- 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/max_hw_sectors_kb 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290032 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/rotational 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290019 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/iostats 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290033 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/rq_affinity 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290025 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/max_segments 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290027 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/nomerges 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290028 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/nr_requests 2024-03-27T21:32:58.928 INFO:teuthology.orchestra.run.smithi063.stdout: 290022 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/max_integrity_segments 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290012 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/hw_sector_size 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290026 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/minimum_io_size 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290030 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/physical_block_size 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290020 4 -rw-r--r-- 1 ubuntu ubuntu 4 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/queue/logical_block_size 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290006 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/foo 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290002 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_blkdev_sys_block/sys/block/sda/bar 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290092 12 -rw-r--r-- 1 ubuntu ubuntu 10578 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_json_formattable.cc 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 290073 12 -rw-r--r-- 1 ubuntu ubuntu 8924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_bloom_filter.cc 2024-03-27T21:32:58.929 INFO:teuthology.orchestra.run.smithi063.stdout: 289963 8 -rw-r--r-- 1 ubuntu ubuntu 6731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_async_completion.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 289932 8 -rw-r--r-- 1 ubuntu ubuntu 5616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/Readahead.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 289933 12 -rw-r--r-- 1 ubuntu ubuntu 9135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/Throttle.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 290107 4 -rw-r--r-- 1 ubuntu ubuntu 961 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_safe_io.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 290079 4 -rw-r--r-- 1 ubuntu ubuntu 1756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_convenience.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 290087 8 -rw-r--r-- 1 ubuntu ubuntu 8143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_interval_map.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 290083 8 -rw-r--r-- 1 ubuntu ubuntu 6479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_fault_injector.cc 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 289934 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples 2024-03-27T21:32:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 289939 4 -rw-r--r-- 1 ubuntu ubuntu 1180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/erwan.v1.sda 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289955 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/reesi001.nvme0n1.devid 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289948 4 -rw-r--r-- 1 ubuntu ubuntu 911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/mira055.sda 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289943 4 -rw-r--r-- 1 ubuntu ubuntu 1201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/erwan1 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289949 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/mira055.sda.devid 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289938 4 -rw-r--r-- 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/cpach.sdn.devid 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289942 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/erwan.v1.sdb.devid 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289951 4 -rw-r--r-- 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/mira055.sdb.devid 2024-03-27T21:32:58.931 INFO:teuthology.orchestra.run.smithi063.stdout: 289957 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/stud.nvme0n1.devid 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289937 4 -rw-r--r-- 1 ubuntu ubuntu 2344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/cpach.sdn 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289940 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/erwan.v1.sda.devid 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289947 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/gnit.sda.devid 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289950 4 -rw-r--r-- 1 ubuntu ubuntu 946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/mira055.sdb 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289946 4 -rw-r--r-- 1 ubuntu ubuntu 1704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/gnit.sda 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289952 4 -rw-r--r-- 1 ubuntu ubuntu 947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/mira055.sde 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289941 4 -rw-r--r-- 1 ubuntu ubuntu 1345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/erwan.v1.sdb 2024-03-27T21:32:58.932 INFO:teuthology.orchestra.run.smithi063.stdout: 289954 4 -rw-r--r-- 1 ubuntu ubuntu 561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/reesi001.nvme0n1 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 289935 4 -rw-r--r-- 1 ubuntu ubuntu 677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/autriche.nvme0n1 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 289936 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/autriche.nvme0n1.devid 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 289945 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/gnit.nvme0n1.devid 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 289944 4 -rw-r--r-- 1 ubuntu ubuntu 1285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/gnit.nvme0n1 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 289956 4 -rw-r--r-- 1 ubuntu ubuntu 1480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/stud.nvme0n1 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 289953 4 -rw-r--r-- 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/blkdev-udevadm-info-samples/mira055.sde.devid 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 290089 8 -rw-r--r-- 1 ubuntu ubuntu 6407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_intrusive_lru.cc 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 290088 20 -rw-r--r-- 1 ubuntu ubuntu 17188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_interval_set.cc 2024-03-27T21:32:58.933 INFO:teuthology.orchestra.run.smithi063.stdout: 290082 4 -rw-r--r-- 1 ubuntu ubuntu 2243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_fair_mutex.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290109 12 -rw-r--r-- 1 ubuntu ubuntu 9518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_sharedptr_registry.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290076 8 -rw-r--r-- 1 ubuntu ubuntu 5180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_ceph_timer.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290121 8 -rw-r--r-- 1 ubuntu ubuntu 4221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_xmlformatter.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 289960 4 -rw-r--r-- 1 ubuntu ubuntu 4018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/get_command_descriptions.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290085 12 -rw-r--r-- 1 ubuntu ubuntu 8971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_hobject.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290108 12 -rw-r--r-- 1 ubuntu ubuntu 10749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_shared_cache.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290101 4 -rw-r--r-- 1 ubuntu ubuntu 3984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_perf_counters_key.cc 2024-03-27T21:32:58.934 INFO:teuthology.orchestra.run.smithi063.stdout: 290096 4 -rw-r--r-- 1 ubuntu ubuntu 1998 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_lruset.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290099 4 -rw-r--r-- 1 ubuntu ubuntu 1942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_numa.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290119 8 -rw-r--r-- 1 ubuntu ubuntu 7337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_versioned_variant.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290080 4 -rw-r--r-- 1 ubuntu ubuntu 1001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_counter.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290112 4 -rw-r--r-- 1 ubuntu ubuntu 2923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_split.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290074 8 -rw-r--r-- 1 ubuntu ubuntu 6744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_bounded_key_counter.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290084 4 -rw-r--r-- 1 ubuntu ubuntu 863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_global_doublefree.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290078 8 -rw-r--r-- 1 ubuntu ubuntu 4944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_context.cc 2024-03-27T21:32:58.935 INFO:teuthology.orchestra.run.smithi063.stdout: 290115 8 -rw-r--r-- 1 ubuntu ubuntu 7420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_tableformatter.cc 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 290090 4 -rw-r--r-- 1 ubuntu ubuntu 1913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_iso_8601.cc 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 290113 8 -rw-r--r-- 1 ubuntu ubuntu 5651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/test_static_ptr.cc 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 289959 12 -rw-r--r-- 1 ubuntu ubuntu 8965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/common/dns_resolve.cc 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 290903 4 -rwxr-xr-x 1 ubuntu ubuntu 1699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/run-cli-tests 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 290605 12 -rw-r--r-- 1 ubuntu ubuntu 10586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/librgw_file_xattr.cc 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 289897 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_log 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 289898 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_log/CMakeLists.txt 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 289899 12 -rw-r--r-- 1 ubuntu ubuntu 10002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_log/test_cls_log.cc 2024-03-27T21:32:58.936 INFO:teuthology.orchestra.run.smithi063.stdout: 289891 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_journal 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 289892 4 -rw-r--r-- 1 ubuntu ubuntu 375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_journal/CMakeLists.txt 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 289893 24 -rw-r--r-- 1 ubuntu ubuntu 22225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_journal/test_cls_journal.cc 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 289885 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_cmpomap 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 289887 28 -rw-r--r-- 1 ubuntu ubuntu 27120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_cmpomap/test_cls_cmpomap.cc 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 289886 4 -rw-r--r-- 1 ubuntu ubuntu 237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/cls_cmpomap/CMakeLists.txt 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 290968 32 -rw-r--r-- 1 ubuntu ubuntu 28960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_rgw_admin_meta.cc 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 290941 4 -rwxr-xr-x 1 ubuntu ubuntu 255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_backfill.sh 2024-03-27T21:32:58.937 INFO:teuthology.orchestra.run.smithi063.stdout: 290943 4 -rw-r--r-- 1 ubuntu ubuntu 563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_c_headers.c 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 290906 4 -rwxr-xr-x 1 ubuntu ubuntu 473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/run-rbd-unit-tests.sh 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 290959 8 -rw-r--r-- 1 ubuntu ubuntu 6808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_pageset.cc 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 290939 4 -rw-r--r-- 1 ubuntu ubuntu 2353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/test/test_arch.cc 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 284928 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/googletest 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 289649 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/spawn 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 284917 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 284925 20 -rw-r--r-- 1 ubuntu ubuntu 19144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/signal_handler.cc 2024-03-27T21:32:58.938 INFO:teuthology.orchestra.run.smithi063.stdout: 284920 4 -rw-r--r-- 1 ubuntu ubuntu 1395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/global_context.h 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284918 4 -rw-r--r-- 1 ubuntu ubuntu 519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/CMakeLists.txt 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284921 20 -rw-r--r-- 1 ubuntu ubuntu 18241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/global_init.cc 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284922 4 -rw-r--r-- 1 ubuntu ubuntu 2952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/global_init.h 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284923 8 -rw-r--r-- 1 ubuntu ubuntu 5427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/pidfile.cc 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284926 4 -rw-r--r-- 1 ubuntu ubuntu 1758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/signal_handler.h 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284919 4 -rw-r--r-- 1 ubuntu ubuntu 2549 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/global_context.cc 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284924 4 -rw-r--r-- 1 ubuntu ubuntu 808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/pidfile.h 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 284927 4 -rw-r--r-- 1 ubuntu ubuntu 1210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/global/signal_handler_win32.cc 2024-03-27T21:32:58.939 INFO:teuthology.orchestra.run.smithi063.stdout: 285182 68 -rw-r--r-- 1 ubuntu ubuntu 65791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libcephfs.cc 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286184 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286185 4 -rw-r--r-- 1 ubuntu ubuntu 412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount/CMakeLists.txt 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286187 4 -rw-r--r-- 1 ubuntu ubuntu 2638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount/conf.cc 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286190 12 -rw-r--r-- 1 ubuntu ubuntu 8269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount/mtab.c 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286189 4 -rw-r--r-- 1 ubuntu ubuntu 1049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount/mount.ceph.h 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286186 8 -rw-r--r-- 1 ubuntu ubuntu 4505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount/canonicalize.c 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 286188 28 -rw-r--r-- 1 ubuntu ubuntu 25575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount/mount.ceph.c 2024-03-27T21:32:58.940 INFO:teuthology.orchestra.run.smithi063.stdout: 289063 12 drwxr-xr-x 6 ubuntu ubuntu 12288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289451 32 -rw-r--r-- 1 ubuntu ubuntu 30802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_client.cc 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289505 20 -rw-r--r-- 1 ubuntu ubuntu 17126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_swift_auth.h 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289352 4 -rw-r--r-- 1 ubuntu ubuntu 1404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kmip_client.h 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289391 4 -rw-r--r-- 1 ubuntu ubuntu 1262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_multi_del.h 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289428 4 -rw-r--r-- 1 ubuntu ubuntu 1178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_process_env.h 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289246 16 -rw-r--r-- 1 ubuntu ubuntu 12802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl.h 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289375 4 -rw-r--r-- 1 ubuntu ubuntu 3823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_data_filter.cc 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289376 4 -rw-r--r-- 1 ubuntu ubuntu 1104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_data_filter.h 2024-03-27T21:32:58.941 INFO:teuthology.orchestra.run.smithi063.stdout: 289251 8 -rw-r--r-- 1 ubuntu ubuntu 6064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl_types.h 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289369 20 -rw-r--r-- 1 ubuntu ubuntu 19242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_log.cc 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289474 28 -rw-r--r-- 1 ubuntu ubuntu 26563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_sts.cc 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289463 8 -rw-r--r-- 1 ubuntu ubuntu 6376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_oidc_provider.cc 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289328 8 -rw-r--r-- 1 ubuntu ubuntu 5924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_flight.h 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289483 4 -rw-r--r-- 1 ubuntu ubuntu 947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_zero.h 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289394 8 -rw-r--r-- 1 ubuntu ubuntu 5534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_notify_event_type.cc 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289261 4 -rw-r--r-- 1 ubuntu ubuntu 3948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_arn.h 2024-03-27T21:32:58.942 INFO:teuthology.orchestra.run.smithi063.stdout: 289405 4 -rw-r--r-- 1 ubuntu ubuntu 3506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_op_type.h 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289478 4 -rw-r--r-- 1 ubuntu ubuntu 3482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_usage.cc 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289386 4 -rw-r--r-- 1 ubuntu ubuntu 2955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_meta_sync_status.h 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289461 12 -rw-r--r-- 1 ubuntu ubuntu 8230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_metadata.cc 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289271 8 -rw-r--r-- 1 ubuntu ubuntu 7616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth_keystone.h 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289492 56 -rw-r--r-- 1 ubuntu ubuntu 55411 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_dbstore.cc 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289445 4 -rw-r--r-- 1 ubuntu ubuntu 851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_request.h 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289354 4 -rw-r--r-- 1 ubuntu ubuntu 874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kmip_client_impl.h 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289370 8 -rw-r--r-- 1 ubuntu ubuntu 7535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_log.h 2024-03-27T21:32:58.943 INFO:teuthology.orchestra.run.smithi063.stdout: 289480 12 -rw-r--r-- 1 ubuntu ubuntu 11614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_user_policy.cc 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289363 20 -rw-r--r-- 1 ubuntu ubuntu 16773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lib.cc 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289491 16 -rw-r--r-- 1 ubuntu ubuntu 13345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_config.h 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289424 4 -rw-r--r-- 1 ubuntu ubuntu 2599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_polparser.cc 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289293 8 -rw-r--r-- 1 ubuntu ubuntu 8148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_compression.cc 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289319 4 -rw-r--r-- 1 ubuntu ubuntu 3340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_sync_scheduler.cc 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289420 4 -rw-r--r-- 1 ubuntu ubuntu 1796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period_pusher.h 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289510 20 -rw-r--r-- 1 ubuntu ubuntu 17626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sync_policy.h 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289393 4 -rw-r--r-- 1 ubuntu ubuntu 781 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_multipart_meta_filter.cc 2024-03-27T21:32:58.944 INFO:teuthology.orchestra.run.smithi063.stdout: 289422 12 -rw-r--r-- 1 ubuntu ubuntu 8222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_policy_s3.cc 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289259 24 -rw-r--r-- 1 ubuntu ubuntu 20749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_appmain.cc 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289329 8 -rw-r--r-- 1 ubuntu ubuntu 7224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_flight_frontend.cc 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289379 8 -rw-r--r-- 1 ubuntu ubuntu 5048 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_utils.cc 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289256 4 -rw-r--r-- 1 ubuntu ubuntu 3544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_aio_throttle.h 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289519 8 -rw-r--r-- 1 ubuntu ubuntu 5066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_torrent.cc 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289374 8 -rw-r--r-- 1 ubuntu ubuntu 5503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_background.h 2024-03-27T21:32:58.945 INFO:teuthology.orchestra.run.smithi063.stdout: 289475 12 -rw-r--r-- 1 ubuntu ubuntu 8472 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_sts.h 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289253 8 -rw-r--r-- 1 ubuntu ubuntu 5392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_aio.cc 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289494 36 -rw-r--r-- 1 ubuntu ubuntu 36043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_filter.cc 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289421 4 -rw-r--r-- 1 ubuntu ubuntu 3057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_placement_types.h 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289435 36 -rw-r--r-- 1 ubuntu ubuntu 34011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_quota.cc 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289366 4 -rw-r--r-- 1 ubuntu ubuntu 3240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_loadgen.cc 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289471 204 -rw-r--r-- 1 ubuntu ubuntu 204804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_s3.cc 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289477 20 -rw-r--r-- 1 ubuntu ubuntu 18598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_swift.h 2024-03-27T21:32:58.946 INFO:teuthology.orchestra.run.smithi063.stdout: 289495 44 -rw-r--r-- 1 ubuntu ubuntu 43447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_filter.h 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289064 16 -rw-r--r-- 1 ubuntu ubuntu 16234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/CMakeLists.txt 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289350 12 -rw-r--r-- 1 ubuntu ubuntu 9783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_keystone.h 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289304 20 -rw-r--r-- 1 ubuntu ubuntu 20001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cr_rest.h 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289381 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_version.h 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289282 12 -rw-r--r-- 1 ubuntu ubuntu 9706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket_layout.cc 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289431 36 -rw-r--r-- 1 ubuntu ubuntu 36773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_pubsub.cc 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289066 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver 2024-03-27T21:32:58.947 INFO:teuthology.orchestra.run.smithi063.stdout: 289118 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289119 4 -rw-r--r-- 1 ubuntu ubuntu 1414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/README.md 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289120 4 -rw-r--r-- 1 ubuntu ubuntu 132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/bucket_cache.cpp 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289123 12 -rw-r--r-- 1 ubuntu ubuntu 11160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/lmdb-safe.cc 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289130 260 -rw-r--r-- 1 ubuntu ubuntu 263287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/zpp_bits.h 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289121 20 -rw-r--r-- 1 ubuntu ubuntu 17046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/bucket_cache.h 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289126 8 -rw-r--r-- 1 ubuntu ubuntu 6644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/notify.h 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289128 28 -rw-r--r-- 1 ubuntu ubuntu 26417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/rgw_sal_posix.h 2024-03-27T21:32:58.948 INFO:teuthology.orchestra.run.smithi063.stdout: 289125 4 -rw-r--r-- 1 ubuntu ubuntu 527 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/notify.cpp 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289122 4 -rw-r--r-- 1 ubuntu ubuntu 761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/lmdb-safe-global.h 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289127 80 -rw-r--r-- 1 ubuntu ubuntu 79555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/rgw_sal_posix.cc 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289124 20 -rw-r--r-- 1 ubuntu ubuntu 17745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/lmdb-safe.hh 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289129 64 -rw-r--r-- 1 ubuntu ubuntu 62486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/posix/unordered_dense.h 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289067 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289073 8 -rw-r--r-- 1 ubuntu ubuntu 7205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n/rgw_sal_d4n.h 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289069 4 -rw-r--r-- 1 ubuntu ubuntu 1308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n/d4n_datacache.h 2024-03-27T21:32:58.949 INFO:teuthology.orchestra.run.smithi063.stdout: 289068 12 -rw-r--r-- 1 ubuntu ubuntu 11770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n/d4n_datacache.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289071 4 -rw-r--r-- 1 ubuntu ubuntu 1294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n/d4n_directory.h 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289070 8 -rw-r--r-- 1 ubuntu ubuntu 4354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n/d4n_directory.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289072 20 -rw-r--r-- 1 ubuntu ubuntu 17346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/d4n/rgw_sal_d4n.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289131 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289164 4 -rw-r--r-- 1 ubuntu ubuntu 1704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_gc_log.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289156 36 -rw-r--r-- 1 ubuntu ubuntu 32800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_datalog.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289189 12 -rw-r--r-- 1 ubuntu ubuntu 11034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_bucket.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289231 12 -rw-r--r-- 1 ubuntu ubuntu 8720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/sync_fairness.cc 2024-03-27T21:32:58.950 INFO:teuthology.orchestra.run.smithi063.stdout: 289166 4 -rw-r--r-- 1 ubuntu ubuntu 1521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_lc_tier.h 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289230 40 -rw-r--r-- 1 ubuntu ubuntu 38079 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_zone.h 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289215 4 -rw-r--r-- 1 ubuntu ubuntu 3586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_log.cc 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289204 4 -rw-r--r-- 1 ubuntu ubuntu 407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_counters.h 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289220 8 -rw-r--r-- 1 ubuntu ubuntu 7140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_tools.h 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289183 28 -rw-r--r-- 1 ubuntu ubuntu 24779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_putobj_processor.cc 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289200 8 -rw-r--r-- 1 ubuntu ubuntu 6638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_service.h 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289160 8 -rw-r--r-- 1 ubuntu ubuntu 6148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_etag_verifier.cc 2024-03-27T21:32:58.951 INFO:teuthology.orchestra.run.smithi063.stdout: 289146 36 -rw-r--r-- 1 ubuntu ubuntu 34004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_bucket_sync.cc 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289213 16 -rw-r--r-- 1 ubuntu ubuntu 14395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_es_rest.cc 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289186 72 -rw-r--r-- 1 ubuntu ubuntu 70026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rados.h 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289187 48 -rw-r--r-- 1 ubuntu ubuntu 47419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_reshard.cc 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289172 52 -rw-r--r-- 1 ubuntu ubuntu 53231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_notify.cc 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289232 4 -rw-r--r-- 1 ubuntu ubuntu 1584 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/sync_fairness.h 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289157 12 -rw-r--r-- 1 ubuntu ubuntu 11839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_datalog.h 2024-03-27T21:32:58.952 INFO:teuthology.orchestra.run.smithi063.stdout: 289234 4 -rw-r--r-- 1 ubuntu ubuntu 3266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/topic.h 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289133 12 -rw-r--r-- 1 ubuntu ubuntu 12040 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/cls_fifo_legacy.h 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289145 28 -rw-r--r-- 1 ubuntu ubuntu 27000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_bucket.h 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289219 12 -rw-r--r-- 1 ubuntu ubuntu 11191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_tools.cc 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289148 40 -rw-r--r-- 1 ubuntu ubuntu 38932 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_cr_rados.cc 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289199 16 -rw-r--r-- 1 ubuntu ubuntu 15417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_service.cc 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289201 92 -rw-r--r-- 1 ubuntu ubuntu 92732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync.cc 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289221 48 -rw-r--r-- 1 ubuntu ubuntu 46105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_trim_bilog.cc 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289179 4 -rw-r--r-- 1 ubuntu ubuntu 2559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_otp.h 2024-03-27T21:32:58.953 INFO:teuthology.orchestra.run.smithi063.stdout: 289227 72 -rw-r--r-- 1 ubuntu ubuntu 72829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_user.cc 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289176 16 -rw-r--r-- 1 ubuntu ubuntu 13662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_object_expirer_core.cc 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289185 340 -rw-r--r-- 1 ubuntu ubuntu 344332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rados.cc 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289211 36 -rw-r--r-- 1 ubuntu ubuntu 33048 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_es.cc 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289196 4 -rw-r--r-- 1 ubuntu ubuntu 927 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_user.h 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289218 4 -rw-r--r-- 1 ubuntu ubuntu 3267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_trace.h 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289163 4 -rw-r--r-- 1 ubuntu ubuntu 2650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_gc.h 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289222 4 -rw-r--r-- 1 ubuntu ubuntu 3920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_trim_bilog.h 2024-03-27T21:32:58.954 INFO:teuthology.orchestra.run.smithi063.stdout: 289165 40 -rw-r--r-- 1 ubuntu ubuntu 39672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_lc_tier.cc 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289168 12 -rw-r--r-- 1 ubuntu ubuntu 11540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_log_backing.h 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289214 4 -rw-r--r-- 1 ubuntu ubuntu 521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_es_rest.h 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289159 4 -rw-r--r-- 1 ubuntu ubuntu 845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_datalog_notify.h 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289188 12 -rw-r--r-- 1 ubuntu ubuntu 9277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_reshard.h 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289150 8 -rw-r--r-- 1 ubuntu ubuntu 4143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_cr_tools.cc 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289181 16 -rw-r--r-- 1 ubuntu ubuntu 12561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_pubsub_push.cc 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289212 4 -rw-r--r-- 1 ubuntu ubuntu 1508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_es.h 2024-03-27T21:32:58.955 INFO:teuthology.orchestra.run.smithi063.stdout: 289147 16 -rw-r--r-- 1 ubuntu ubuntu 14707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_bucket_sync.h 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289206 4 -rw-r--r-- 1 ubuntu ubuntu 1881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_error_repo.h 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289209 64 -rw-r--r-- 1 ubuntu ubuntu 62634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_aws.cc 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289216 4 -rw-r--r-- 1 ubuntu ubuntu 444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_log.h 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289205 8 -rw-r--r-- 1 ubuntu ubuntu 5633 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_error_repo.cc 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289233 12 -rw-r--r-- 1 ubuntu ubuntu 12086 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/topic.cc 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289174 16 -rw-r--r-- 1 ubuntu ubuntu 12936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_obj_manifest.cc 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289144 116 -rw-r--r-- 1 ubuntu ubuntu 116710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_bucket.cc 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289180 12 -rw-r--r-- 1 ubuntu ubuntu 10798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_period.cc 2024-03-27T21:32:58.956 INFO:teuthology.orchestra.run.smithi063.stdout: 289162 28 -rw-r--r-- 1 ubuntu ubuntu 24929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_gc.cc 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289149 52 -rw-r--r-- 1 ubuntu ubuntu 51145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_cr_rados.h 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289170 12 -rw-r--r-- 1 ubuntu ubuntu 10364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_metadata.h 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289132 76 -rw-r--r-- 1 ubuntu ubuntu 76710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/cls_fifo_legacy.cc 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289177 8 -rw-r--r-- 1 ubuntu ubuntu 4555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_object_expirer_core.h 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289226 4 -rw-r--r-- 1 ubuntu ubuntu 908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_trim_mdlog.h 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289184 12 -rw-r--r-- 1 ubuntu ubuntu 10991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_putobj_processor.h 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289190 4 -rw-r--r-- 1 ubuntu ubuntu 941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_bucket.h 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289193 16 -rw-r--r-- 1 ubuntu ubuntu 12404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_realm.cc 2024-03-27T21:32:58.957 INFO:teuthology.orchestra.run.smithi063.stdout: 289203 4 -rw-r--r-- 1 ubuntu ubuntu 1043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_counters.cc 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289175 20 -rw-r--r-- 1 ubuntu ubuntu 18216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_obj_manifest.h 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289229 48 -rw-r--r-- 1 ubuntu ubuntu 48920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_zone.cc 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289167 24 -rw-r--r-- 1 ubuntu ubuntu 21319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_log_backing.cc 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289202 16 -rw-r--r-- 1 ubuntu ubuntu 15552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync.h 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289173 8 -rw-r--r-- 1 ubuntu ubuntu 4675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_notify.h 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289191 40 -rw-r--r-- 1 ubuntu ubuntu 37211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_log.cc 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289224 4 -rw-r--r-- 1 ubuntu ubuntu 965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_trim_datalog.h 2024-03-27T21:32:58.958 INFO:teuthology.orchestra.run.smithi063.stdout: 289210 4 -rw-r--r-- 1 ubuntu ubuntu 2651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module_aws.h 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289171 4 -rw-r--r-- 1 ubuntu ubuntu 1744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_metadata_lister.h 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289197 124 -rw-r--r-- 1 ubuntu ubuntu 124622 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sal_rados.cc 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289153 12 -rw-r--r-- 1 ubuntu ubuntu 8487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_d3n_datacache.h 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289182 4 -rw-r--r-- 1 ubuntu ubuntu 1776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_pubsub_push.h 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289134 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289137 12 -rw-r--r-- 1 ubuntu ubuntu 8201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/period.cc 2024-03-27T21:32:58.959 INFO:teuthology.orchestra.run.smithi063.stdout: 289135 4 -rw-r--r-- 1 ubuntu ubuntu 3758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/impl.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289142 12 -rw-r--r-- 1 ubuntu ubuntu 9991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/zone.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289141 12 -rw-r--r-- 1 ubuntu ubuntu 9218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/store.h 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289139 12 -rw-r--r-- 1 ubuntu ubuntu 11737 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/realm.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289136 4 -rw-r--r-- 1 ubuntu ubuntu 4066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/impl.h 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289143 12 -rw-r--r-- 1 ubuntu ubuntu 10804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/zonegroup.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289138 4 -rw-r--r-- 1 ubuntu ubuntu 1760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/period_config.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289140 4 -rw-r--r-- 1 ubuntu ubuntu 1282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/config/store.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289223 12 -rw-r--r-- 1 ubuntu ubuntu 8585 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_trim_datalog.cc 2024-03-27T21:32:58.960 INFO:teuthology.orchestra.run.smithi063.stdout: 289178 8 -rw-r--r-- 1 ubuntu ubuntu 5638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_otp.cc 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289225 28 -rw-r--r-- 1 ubuntu ubuntu 27546 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_trim_mdlog.cc 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289151 4 -rw-r--r-- 1 ubuntu ubuntu 1688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_cr_tools.h 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289217 12 -rw-r--r-- 1 ubuntu ubuntu 8271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_trace.cc 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289208 8 -rw-r--r-- 1 ubuntu ubuntu 5993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module.h 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289207 4 -rw-r--r-- 1 ubuntu ubuntu 3371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sync_module.cc 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289228 28 -rw-r--r-- 1 ubuntu ubuntu 26879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_user.h 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289194 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_realm.h 2024-03-27T21:32:58.961 INFO:teuthology.orchestra.run.smithi063.stdout: 289154 248 -rw-r--r-- 1 ubuntu ubuntu 251333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_data_sync.cc 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289155 28 -rw-r--r-- 1 ubuntu ubuntu 26605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_data_sync.h 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289169 8 -rw-r--r-- 1 ubuntu ubuntu 6718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_metadata.cc 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289161 4 -rw-r--r-- 1 ubuntu ubuntu 2817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_etag_verifier.h 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289152 16 -rw-r--r-- 1 ubuntu ubuntu 13122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_d3n_datacache.cc 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289195 32 -rw-r--r-- 1 ubuntu ubuntu 31076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_user.cc 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289192 12 -rw-r--r-- 1 ubuntu ubuntu 9230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_rest_log.h 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289158 4 -rw-r--r-- 1 ubuntu ubuntu 2246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_datalog_notify.cc 2024-03-27T21:32:58.962 INFO:teuthology.orchestra.run.smithi063.stdout: 289198 48 -rw-r--r-- 1 ubuntu ubuntu 47274 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/rados/rgw_sal_rados.h 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/daos 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289075 4 -rw-r--r-- 1 ubuntu ubuntu 879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/daos/README.md 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289077 44 -rw-r--r-- 1 ubuntu ubuntu 42602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/daos/rgw_sal_daos.h 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289076 80 -rw-r--r-- 1 ubuntu ubuntu 78878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/daos/rgw_sal_daos.cc 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/json_config 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289114 4 -rw-r--r-- 1 ubuntu ubuntu 707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/json_config/store.h 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289113 8 -rw-r--r-- 1 ubuntu ubuntu 5988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/json_config/store.cc 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289109 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/immutable_config 2024-03-27T21:32:58.963 INFO:teuthology.orchestra.run.smithi063.stdout: 289111 12 -rw-r--r-- 1 ubuntu ubuntu 9431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/immutable_config/store.h 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289110 16 -rw-r--r-- 1 ubuntu ubuntu 13715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/immutable_config/store.cc 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289078 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289094 4 -rw-r--r-- 1 ubuntu ubuntu 1524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/dbstore_mgr.h 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289080 4 -rw-r--r-- 1 ubuntu ubuntu 1764 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/README.md 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289105 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/tests 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289106 4 -rw-r--r-- 1 ubuntu ubuntu 563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/tests/CMakeLists.txt 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289107 8 -rw-r--r-- 1 ubuntu ubuntu 5319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/tests/dbstore_mgr_tests.cc 2024-03-27T21:32:58.964 INFO:teuthology.orchestra.run.smithi063.stdout: 289108 44 -rw-r--r-- 1 ubuntu ubuntu 41384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/tests/dbstore_tests.cc 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289079 4 -rw-r--r-- 1 ubuntu ubuntu 1967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/CMakeLists.txt 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289095 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289100 4 -rw-r--r-- 1 ubuntu ubuntu 2348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/error.h 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289096 4 -rw-r--r-- 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/CMakeLists.txt 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289102 24 -rw-r--r-- 1 ubuntu ubuntu 21389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/sqliteDB.h 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289104 4 -rw-r--r-- 1 ubuntu ubuntu 3020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/statement.h 2024-03-27T21:32:58.965 INFO:teuthology.orchestra.run.smithi063.stdout: 289099 4 -rw-r--r-- 1 ubuntu ubuntu 952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/error.cc 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289097 4 -rw-r--r-- 1 ubuntu ubuntu 907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/connection.cc 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289103 8 -rw-r--r-- 1 ubuntu ubuntu 7054 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/statement.cc 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289098 4 -rw-r--r-- 1 ubuntu ubuntu 1485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/connection.h 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289101 96 -rw-r--r-- 1 ubuntu ubuntu 97254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/sqlite/sqliteDB.cc 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289092 8 -rw-r--r-- 1 ubuntu ubuntu 5311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/dbstore_main.cc 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289093 4 -rw-r--r-- 1 ubuntu ubuntu 3136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/dbstore_mgr.cc 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289086 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/config 2024-03-27T21:32:58.966 INFO:teuthology.orchestra.run.smithi063.stdout: 289088 8 -rw-r--r-- 1 ubuntu ubuntu 8134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/config/sqlite.h 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289087 68 -rw-r--r-- 1 ubuntu ubuntu 68901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/config/sqlite.cc 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289091 4 -rw-r--r-- 1 ubuntu ubuntu 671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/config/store.h 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289089 12 -rw-r--r-- 1 ubuntu ubuntu 9244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/config/sqlite_schema.h 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289090 4 -rw-r--r-- 1 ubuntu ubuntu 892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/config/store.cc 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289081 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/common 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289082 8 -rw-r--r-- 1 ubuntu ubuntu 4665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/common/connection_pool.h 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289083 60 -rw-r--r-- 1 ubuntu ubuntu 60048 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/common/dbstore.cc 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289085 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/common/dbstore_log.h 2024-03-27T21:32:58.967 INFO:teuthology.orchestra.run.smithi063.stdout: 289084 80 -rw-r--r-- 1 ubuntu ubuntu 80695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/dbstore/common/dbstore.h 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289115 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/motr 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289116 120 -rw-r--r-- 1 ubuntu ubuntu 122589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/motr/rgw_sal_motr.cc 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289117 52 -rw-r--r-- 1 ubuntu ubuntu 50671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/driver/motr/rgw_sal_motr.h 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289517 4 -rw-r--r-- 1 ubuntu ubuntu 4088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_token.h 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289503 12 -rw-r--r-- 1 ubuntu ubuntu 9296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sts.h 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289496 4 -rw-r--r-- 1 ubuntu ubuntu 1251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_fwd.h 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289442 4 -rw-r--r-- 1 ubuntu ubuntu 3845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_realm_watcher.cc 2024-03-27T21:32:58.968 INFO:teuthology.orchestra.run.smithi063.stdout: 289290 16 -rw-r--r-- 1 ubuntu ubuntu 13842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_client_io_filters.h 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289472 36 -rw-r--r-- 1 ubuntu ubuntu 36344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_s3.h 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289416 4 -rw-r--r-- 1 ubuntu ubuntu 3694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period_history.h 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289430 4 -rw-r--r-- 1 ubuntu ubuntu 1762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_public_access.h 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289270 32 -rw-r--r-- 1 ubuntu ubuntu 28935 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth_keystone.cc 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289243 12 -rwxr-xr-x 1 ubuntu ubuntu 9021 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw-orphan-list 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289311 4 -rw-r--r-- 1 ubuntu ubuntu 3216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_data_access.h 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289400 8 -rw-r--r-- 1 ubuntu ubuntu 4908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_object_lock.h 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289349 24 -rw-r--r-- 1 ubuntu ubuntu 21612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_keystone.cc 2024-03-27T21:32:58.969 INFO:teuthology.orchestra.run.smithi063.stdout: 289535 4 -rw-r--r-- 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_xml_enc.cc 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289389 4 -rw-r--r-- 1 ubuntu ubuntu 1412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_multi.h 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289371 12 -rw-r--r-- 1 ubuntu ubuntu 8801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua.cc 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289425 8 -rw-r--r-- 1 ubuntu ubuntu 4141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_pool_types.h 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289351 4 -rw-r--r-- 1 ubuntu ubuntu 1493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kmip_client.cc 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289380 20 -rw-r--r-- 1 ubuntu ubuntu 18060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_utils.h 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289538 20 -rw-r--r-- 1 ubuntu ubuntu 17735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_zone_types.h 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289434 4 -rw-r--r-- 1 ubuntu ubuntu 2040 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_putobj.h 2024-03-27T21:32:58.970 INFO:teuthology.orchestra.run.smithi063.stdout: 289275 4 -rw-r--r-- 1 ubuntu ubuntu 2336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_b64.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289336 32 -rw-r--r-- 1 ubuntu ubuntu 30766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_http_client.cc 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289509 20 -rw-r--r-- 1 ubuntu ubuntu 17524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sync_policy.cc 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289490 72 -rw-r--r-- 1 ubuntu ubuntu 71933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289436 4 -rw-r--r-- 1 ubuntu ubuntu 1751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_quota.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289341 4 -rw-r--r-- 1 ubuntu ubuntu 938 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_http_errors.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289464 4 -rw-r--r-- 1 ubuntu ubuntu 2457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_oidc_provider.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289481 4 -rw-r--r-- 1 ubuntu ubuntu 2127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_user_policy.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289383 4 -rw-r--r-- 1 ubuntu ubuntu 3684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_main.h 2024-03-27T21:32:58.971 INFO:teuthology.orchestra.run.smithi063.stdout: 289408 48 -rw-r--r-- 1 ubuntu ubuntu 46914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_orphan.cc 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289539 8 -rwxr-xr-x 1 ubuntu ubuntu 8004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgwam.py 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289294 4 -rw-r--r-- 1 ubuntu ubuntu 2091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_compression.h 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289279 4 -rw-r--r-- 1 ubuntu ubuntu 1295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket.h 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289286 12 -rw-r--r-- 1 ubuntu ubuntu 11630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cache.cc 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289362 4 -rw-r--r-- 1 ubuntu ubuntu 3195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_ldap.h 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289518 4 -rw-r--r-- 1 ubuntu ubuntu 2678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tools.cc 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289515 4 -rw-r--r-- 1 ubuntu ubuntu 4059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tar.h 2024-03-27T21:32:58.972 INFO:teuthology.orchestra.run.smithi063.stdout: 289529 4 -rw-r--r-- 1 ubuntu ubuntu 599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_web_idp.h 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289506 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sync.cc 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289527 4 -rw-r--r-- 1 ubuntu ubuntu 3170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_user.cc 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289255 8 -rw-r--r-- 1 ubuntu ubuntu 5041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_aio_throttle.cc 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289415 12 -rw-r--r-- 1 ubuntu ubuntu 11000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period_history.cc 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289357 92 -rw-r--r-- 1 ubuntu ubuntu 90665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lc.cc 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289407 4 -rw-r--r-- 1 ubuntu ubuntu 270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_opa.h 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289468 4 -rw-r--r-- 1 ubuntu ubuntu 924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_ratelimit.h 2024-03-27T21:32:58.973 INFO:teuthology.orchestra.run.smithi063.stdout: 289516 4 -rw-r--r-- 1 ubuntu ubuntu 3697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_token.cc 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289258 4 -rw-r--r-- 1 ubuntu ubuntu 2234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_amqp.h 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289305 56 -rw-r--r-- 1 ubuntu ubuntu 57275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_crypt.cc 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289288 4 -rw-r--r-- 1 ubuntu ubuntu 801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_client_io.cc 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289458 4 -rw-r--r-- 1 ubuntu ubuntu 1445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_iam.h 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289327 24 -rw-r--r-- 1 ubuntu ubuntu 20525 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_flight.cc 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289392 4 -rw-r--r-- 1 ubuntu ubuntu 942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_multiparser.cc 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289438 12 -rw-r--r-- 1 ubuntu ubuntu 10868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_ratelimit.h 2024-03-27T21:32:58.974 INFO:teuthology.orchestra.run.smithi063.stdout: 289485 8 -rw-r--r-- 1 ubuntu ubuntu 7005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_role.h 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289502 20 -rw-r--r-- 1 ubuntu ubuntu 16628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sts.cc 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289459 4 -rw-r--r-- 1 ubuntu ubuntu 1431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_info.cc 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289500 4 -rw-r--r-- 1 ubuntu ubuntu 509 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_string.cc 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289511 4 -rw-r--r-- 1 ubuntu ubuntu 1719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tag.cc 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289291 88 -rw-r--r-- 1 ubuntu ubuntu 88674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_common.cc 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289395 4 -rw-r--r-- 1 ubuntu ubuntu 2255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_notify_event_type.h 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289409 12 -rw-r--r-- 1 ubuntu ubuntu 8950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_orphan.h 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289377 28 -rw-r--r-- 1 ubuntu ubuntu 27869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_request.cc 2024-03-27T21:32:58.975 INFO:teuthology.orchestra.run.smithi063.stdout: 289533 12 -rw-r--r-- 1 ubuntu ubuntu 10108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_xml.cc 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289344 12 -rw-r--r-- 1 ubuntu ubuntu 9285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_iam_policy_keywords.gperf 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289406 4 -rw-r--r-- 1 ubuntu ubuntu 2787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_opa.cc 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289348 4 -rw-r--r-- 1 ubuntu ubuntu 1873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kafka.h 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289335 4 -rw-r--r-- 1 ubuntu ubuntu 1041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_gc_log.h 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289317 8 -rw-r--r-- 1 ubuntu ubuntu 5839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_scheduler_ctx.cc 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289314 8 -rw-r--r-- 1 ubuntu ubuntu 5178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_async_scheduler.cc 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289497 20 -rw-r--r-- 1 ubuntu ubuntu 18296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_store.h 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289266 4 -rw-r--r-- 1 ubuntu ubuntu 1822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_asio_frontend_timer.h 2024-03-27T21:32:58.976 INFO:teuthology.orchestra.run.smithi063.stdout: 289249 12 -rw-r--r-- 1 ubuntu ubuntu 11792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl_swift.cc 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289248 4 -rw-r--r-- 1 ubuntu ubuntu 1666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl_s3.h 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289514 4 -rw-r--r-- 1 ubuntu ubuntu 1004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tag_s3.h 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289513 4 -rw-r--r-- 1 ubuntu ubuntu 1505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tag_s3.cc 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289499 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_signal.h 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289274 28 -rw-r--r-- 1 ubuntu ubuntu 26848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth_s3.h 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289316 4 -rw-r--r-- 1 ubuntu ubuntu 2173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_scheduler.h 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289398 4 -rw-r--r-- 1 ubuntu ubuntu 3276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_object_expirer.cc 2024-03-27T21:32:58.977 INFO:teuthology.orchestra.run.smithi063.stdout: 289411 4 -rw-r--r-- 1 ubuntu ubuntu 188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_os_lib.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289287 8 -rw-r--r-- 1 ubuntu ubuntu 6247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cache.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289427 8 -rw-r--r-- 1 ubuntu ubuntu 4523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_process.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289385 4 -rw-r--r-- 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_mdlog_types.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289493 40 -rw-r--r-- 1 ubuntu ubuntu 39607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal_dbstore.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289531 8 -rw-r--r-- 1 ubuntu ubuntu 6407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_website.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289473 4 -rw-r--r-- 1 ubuntu ubuntu 3629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_s3website.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289252 388 -rw-r--r-- 1 ubuntu ubuntu 393860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_admin.cc 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289250 4 -rw-r--r-- 1 ubuntu ubuntu 1899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl_swift.h 2024-03-27T21:32:58.978 INFO:teuthology.orchestra.run.smithi063.stdout: 289312 4 -rw-r--r-- 1 ubuntu ubuntu 981 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dencoder.cc 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289299 8 -rw-r--r-- 1 ubuntu ubuntu 4314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cors.h 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289456 20 -rw-r--r-- 1 ubuntu ubuntu 16875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_conn.h 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289331 12 -rw-r--r-- 1 ubuntu ubuntu 9321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_formats.cc 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289332 4 -rw-r--r-- 1 ubuntu ubuntu 3826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_formats.h 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289309 8 -rw-r--r-- 1 ubuntu ubuntu 5416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_d3n_cacherequest.h 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289323 20 -rw-r--r-- 1 ubuntu ubuntu 16899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_es_query.cc 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289313 4 -rw-r--r-- 1 ubuntu ubuntu 1430 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock.h 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289524 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_url.h 2024-03-27T21:32:58.979 INFO:teuthology.orchestra.run.smithi063.stdout: 289264 36 -rw-r--r-- 1 ubuntu ubuntu 35503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_asio_frontend.cc 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289315 8 -rw-r--r-- 1 ubuntu ubuntu 7482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_async_scheduler.h 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289440 8 -rw-r--r-- 1 ubuntu ubuntu 6313 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_realm_reloader.cc 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289432 24 -rw-r--r-- 1 ubuntu ubuntu 21753 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_pubsub.h 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289244 16 -rwxr-xr-x 1 ubuntu ubuntu 12690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw-restore-bucket-index 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289242 4 -rwxr-xr-x 1 ubuntu ubuntu 3196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw-gap-list-comparator 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289454 4 -rw-r--r-- 1 ubuntu ubuntu 1739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_config.h 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289346 4 -rw-r--r-- 1 ubuntu ubuntu 3086 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_jsonparser.cc 2024-03-27T21:32:58.980 INFO:teuthology.orchestra.run.smithi063.stdout: 289399 4 -rw-r--r-- 1 ubuntu ubuntu 4063 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_object_lock.cc 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289402 4 -rw-r--r-- 1 ubuntu ubuntu 3650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_oidc_provider.h 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289334 8 -rw-r--r-- 1 ubuntu ubuntu 5004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_frontend.h 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289285 8 -rw-r--r-- 1 ubuntu ubuntu 6946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket_types.h 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289452 12 -rw-r--r-- 1 ubuntu ubuntu 10404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_client.h 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289257 40 -rw-r--r-- 1 ubuntu ubuntu 37637 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_amqp.cc 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289470 8 -rw-r--r-- 1 ubuntu ubuntu 6548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_role.h 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289342 48 -rw-r--r-- 1 ubuntu ubuntu 45318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_iam_policy.cc 2024-03-27T21:32:58.981 INFO:teuthology.orchestra.run.smithi063.stdout: 289267 32 -rw-r--r-- 1 ubuntu ubuntu 31205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289272 4 -rw-r--r-- 1 ubuntu ubuntu 3080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth_registry.h 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289521 4 -rw-r--r-- 1 ubuntu ubuntu 228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tracer.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289303 12 -rw-r--r-- 1 ubuntu ubuntu 8860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cr_rest.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289412 12 -rw-r--r-- 1 ubuntu ubuntu 11069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_perf_counters.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289433 4 -rw-r--r-- 1 ubuntu ubuntu 2219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_putobj.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289448 64 -rw-r--r-- 1 ubuntu ubuntu 62485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289453 4 -rw-r--r-- 1 ubuntu ubuntu 1392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_config.cc 2024-03-27T21:32:58.982 INFO:teuthology.orchestra.run.smithi063.stdout: 289269 12 -rw-r--r-- 1 ubuntu ubuntu 9946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth_filters.h 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289367 4 -rw-r--r-- 1 ubuntu ubuntu 1697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_loadgen.h 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289532 4 -rw-r--r-- 1 ubuntu ubuntu 2124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_worker.h 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289235 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/jwt-cpp 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289237 60 -rw-r--r-- 1 ubuntu ubuntu 57647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/jwt-cpp/jwt.h 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289236 8 -rw-r--r-- 1 ubuntu ubuntu 5000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/jwt-cpp/base.h 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289419 12 -rw-r--r-- 1 ubuntu ubuntu 9736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period_pusher.cc 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289512 4 -rw-r--r-- 1 ubuntu ubuntu 1426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tag.h 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289396 8 -rw-r--r-- 1 ubuntu ubuntu 6883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_obj_manifest.cc 2024-03-27T21:32:58.983 INFO:teuthology.orchestra.run.smithi063.stdout: 289382 8 -rw-r--r-- 1 ubuntu ubuntu 5607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_main.cc 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289278 8 -rw-r--r-- 1 ubuntu ubuntu 5225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket.cc 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289330 4 -rw-r--r-- 1 ubuntu ubuntu 1934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_flight_frontend.h 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289414 12 -rw-r--r-- 1 ubuntu ubuntu 9693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period.cc 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289467 16 -rw-r--r-- 1 ubuntu ubuntu 13566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_ratelimit.cc 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289292 60 -rw-r--r-- 1 ubuntu ubuntu 61352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_common.h 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289307 4 -rw-r--r-- 1 ubuntu ubuntu 2505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_crypt_sanitize.cc 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289300 8 -rw-r--r-- 1 ubuntu ubuntu 7425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cors_s3.cc 2024-03-27T21:32:58.984 INFO:teuthology.orchestra.run.smithi063.stdout: 289537 4 -rw-r--r-- 1 ubuntu ubuntu 1412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_zone_features.h 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289504 28 -rw-r--r-- 1 ubuntu ubuntu 25478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_swift_auth.cc 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289318 4 -rw-r--r-- 1 ubuntu ubuntu 3159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_scheduler_ctx.h 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289306 8 -rw-r--r-- 1 ubuntu ubuntu 7095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_crypt.h 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289447 4 -rw-r--r-- 1 ubuntu ubuntu 475 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_resolve.h 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289525 8 -rw-r--r-- 1 ubuntu ubuntu 6189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_usage.cc 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289368 4 -rw-r--r-- 1 ubuntu ubuntu 3325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_loadgen_process.cc 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289284 4 -rw-r--r-- 1 ubuntu ubuntu 3750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket_sync_cache.h 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289308 4 -rw-r--r-- 1 ubuntu ubuntu 1789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_crypt_sanitize.h 2024-03-27T21:32:58.985 INFO:teuthology.orchestra.run.smithi063.stdout: 289423 4 -rw-r--r-- 1 ubuntu ubuntu 1557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_policy_s3.h 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289339 4 -rw-r--r-- 1 ubuntu ubuntu 680 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_http_client_curl.h 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289441 4 -rw-r--r-- 1 ubuntu ubuntu 2367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_realm_reloader.h 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289343 20 -rw-r--r-- 1 ubuntu ubuntu 19530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_iam_policy.h 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289289 16 -rw-r--r-- 1 ubuntu ubuntu 15240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_client_io.h 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289340 4 -rw-r--r-- 1 ubuntu ubuntu 1367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_http_client_types.h 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289482 8 -rw-r--r-- 1 ubuntu ubuntu 5689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_zero.cc 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289338 4 -rw-r--r-- 1 ubuntu ubuntu 2530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_http_client_curl.cc 2024-03-27T21:32:58.986 INFO:teuthology.orchestra.run.smithi063.stdout: 289301 4 -rw-r--r-- 1 ubuntu ubuntu 1504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cors_s3.h 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289476 96 -rw-r--r-- 1 ubuntu ubuntu 96035 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_swift.cc 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289439 8 -rw-r--r-- 1 ubuntu ubuntu 7285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_realm.cc 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289429 4 -rw-r--r-- 1 ubuntu ubuntu 1505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_public_access.cc 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289361 4 -rw-r--r-- 1 ubuntu ubuntu 3669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_ldap.cc 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289413 4 -rw-r--r-- 1 ubuntu ubuntu 2461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_perf_counters.h 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289358 20 -rw-r--r-- 1 ubuntu ubuntu 16562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lc.h 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289247 20 -rw-r--r-- 1 ubuntu ubuntu 17756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl_s3.cc 2024-03-27T21:32:58.987 INFO:teuthology.orchestra.run.smithi063.stdout: 289276 8 -rw-r--r-- 1 ubuntu ubuntu 4934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_basic_types.cc 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289536 44 -rw-r--r-- 1 ubuntu ubuntu 44466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_zone.cc 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289522 4 -rw-r--r-- 1 ubuntu ubuntu 905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_tracer.h 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289254 4 -rw-r--r-- 1 ubuntu ubuntu 3197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_aio.h 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289280 4 -rw-r--r-- 1 ubuntu ubuntu 1677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket_encryption.cc 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289283 12 -rw-r--r-- 1 ubuntu ubuntu 10089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket_layout.h 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289325 76 -rw-r--r-- 1 ubuntu ubuntu 75859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_file.cc 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289265 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_asio_frontend.h 2024-03-27T21:32:58.988 INFO:teuthology.orchestra.run.smithi063.stdout: 289484 16 -rw-r--r-- 1 ubuntu ubuntu 12464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_role.cc 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289403 288 -rw-r--r-- 1 ubuntu ubuntu 290872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_op.cc 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289540 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289571 8 -rw-r--r-- 1 ubuntu ubuntu 6751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be_sobj.h 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289581 4 -rw-r--r-- 1 ubuntu ubuntu 1357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_role_rados.h 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289575 8 -rw-r--r-- 1 ubuntu ubuntu 5105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_otp.cc 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289590 4 -rw-r--r-- 1 ubuntu ubuntu 991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj_core_types.h 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289542 20 -rw-r--r-- 1 ubuntu ubuntu 16852 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bi_rados.cc 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289585 8 -rw-r--r-- 1 ubuntu ubuntu 7183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj.h 2024-03-27T21:32:58.989 INFO:teuthology.orchestra.run.smithi063.stdout: 289592 4 -rw-r--r-- 1 ubuntu ubuntu 783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_tier_rados.cc 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289595 8 -rw-r--r-- 1 ubuntu ubuntu 5407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_user.h 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289545 4 -rw-r--r-- 1 ubuntu ubuntu 1886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bilog_rados.h 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289556 4 -rw-r--r-- 1 ubuntu ubuntu 697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_config_key.h 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289567 4 -rw-r--r-- 1 ubuntu ubuntu 2284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be_otp.cc 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289564 4 -rw-r--r-- 1 ubuntu ubuntu 1098 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta.h 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289579 4 -rw-r--r-- 1 ubuntu ubuntu 463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_quota.h 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289559 4 -rw-r--r-- 1 ubuntu ubuntu 1012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_finisher.cc 2024-03-27T21:32:58.990 INFO:teuthology.orchestra.run.smithi063.stdout: 289574 4 -rw-r--r-- 1 ubuntu ubuntu 2719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_notify.h 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289587 8 -rw-r--r-- 1 ubuntu ubuntu 6952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj_cache.h 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289550 4 -rw-r--r-- 1 ubuntu ubuntu 1906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket_sync.h 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289563 4 -rw-r--r-- 1 ubuntu ubuntu 1039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta.cc 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289561 20 -rw-r--r-- 1 ubuntu ubuntu 18075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_mdlog.cc 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289597 12 -rw-r--r-- 1 ubuntu ubuntu 8805 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_user_rados.h 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289598 32 -rw-r--r-- 1 ubuntu ubuntu 30535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_zone.cc 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289555 8 -rw-r--r-- 1 ubuntu ubuntu 5946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_cls.h 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289580 4 -rw-r--r-- 1 ubuntu ubuntu 2264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_role_rados.cc 2024-03-27T21:32:58.991 INFO:teuthology.orchestra.run.smithi063.stdout: 289576 4 -rw-r--r-- 1 ubuntu ubuntu 2780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_otp.h 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289577 4 -rw-r--r-- 1 ubuntu ubuntu 740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_otp_types.h 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289596 32 -rw-r--r-- 1 ubuntu ubuntu 30007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_user_rados.cc 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289554 16 -rw-r--r-- 1 ubuntu ubuntu 12319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_cls.cc 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289584 8 -rw-r--r-- 1 ubuntu ubuntu 5726 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj.cc 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289599 8 -rw-r--r-- 1 ubuntu ubuntu 5957 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_zone.h 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289544 8 -rw-r--r-- 1 ubuntu ubuntu 7292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bilog_rados.cc 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289572 4 -rw-r--r-- 1 ubuntu ubuntu 528 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be_types.h 2024-03-27T21:32:58.992 INFO:teuthology.orchestra.run.smithi063.stdout: 289558 4 -rw-r--r-- 1 ubuntu ubuntu 1055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_config_key_rados.h 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289541 4 -rw-r--r-- 1 ubuntu ubuntu 1402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bi.h 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289601 4 -rw-r--r-- 1 ubuntu ubuntu 798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_zone_utils.h 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289569 4 -rw-r--r-- 1 ubuntu ubuntu 578 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be_params.h 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289591 4 -rw-r--r-- 1 ubuntu ubuntu 230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj_types.h 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289578 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_quota.cc 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289543 8 -rw-r--r-- 1 ubuntu ubuntu 5798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bi_rados.h 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289573 16 -rw-r--r-- 1 ubuntu ubuntu 13323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_notify.cc 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289551 32 -rw-r--r-- 1 ubuntu ubuntu 29479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket_sync_sobj.cc 2024-03-27T21:32:58.993 INFO:teuthology.orchestra.run.smithi063.stdout: 289547 8 -rw-r--r-- 1 ubuntu ubuntu 5177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket.h 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289582 4 -rw-r--r-- 1 ubuntu ubuntu 1295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sync_modules.cc 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289562 8 -rw-r--r-- 1 ubuntu ubuntu 4327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_mdlog.h 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289589 8 -rw-r--r-- 1 ubuntu ubuntu 5955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj_core.h 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289546 4 -rw-r--r-- 1 ubuntu ubuntu 488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket.cc 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289565 8 -rw-r--r-- 1 ubuntu ubuntu 5858 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be.cc 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289553 4 -rw-r--r-- 1 ubuntu ubuntu 1037 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket_types.h 2024-03-27T21:32:58.994 INFO:teuthology.orchestra.run.smithi063.stdout: 289548 24 -rw-r--r-- 1 ubuntu ubuntu 22442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket_sobj.cc 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289593 4 -rw-r--r-- 1 ubuntu ubuntu 4083 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_tier_rados.h 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289588 20 -rw-r--r-- 1 ubuntu ubuntu 18047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj_core.cc 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289586 20 -rw-r--r-- 1 ubuntu ubuntu 19078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sys_obj_cache.cc 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289560 4 -rw-r--r-- 1 ubuntu ubuntu 898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_finisher.h 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289570 8 -rw-r--r-- 1 ubuntu ubuntu 8042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be_sobj.cc 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289583 4 -rw-r--r-- 1 ubuntu ubuntu 790 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_sync_modules.h 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289600 4 -rw-r--r-- 1 ubuntu ubuntu 1989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_zone_utils.cc 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289566 12 -rw-r--r-- 1 ubuntu ubuntu 9532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be.h 2024-03-27T21:32:58.995 INFO:teuthology.orchestra.run.smithi063.stdout: 289549 8 -rw-r--r-- 1 ubuntu ubuntu 7290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket_sobj.h 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289552 8 -rw-r--r-- 1 ubuntu ubuntu 4274 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_bucket_sync_sobj.h 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289568 4 -rw-r--r-- 1 ubuntu ubuntu 2477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_meta_be_otp.h 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289594 4 -rw-r--r-- 1 ubuntu ubuntu 231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_user.cc 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289557 4 -rw-r--r-- 1 ubuntu ubuntu 1224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/services/svc_config_key_rados.cc 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289523 4 -rw-r--r-- 1 ubuntu ubuntu 1452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_url.cc 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289345 4 -rw-r--r-- 1 ubuntu ubuntu 2468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_iam_policy_keywords.h 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289347 32 -rw-r--r-- 1 ubuntu ubuntu 28787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kafka.cc 2024-03-27T21:32:58.996 INFO:teuthology.orchestra.run.smithi063.stdout: 289065 4 -rw-r--r-- 1 ubuntu ubuntu 1503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/MAINTAINERS.md 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289501 8 -rw-r--r-- 1 ubuntu ubuntu 6361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_string.h 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289449 28 -rw-r--r-- 1 ubuntu ubuntu 25007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest.h 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289260 12 -rw-r--r-- 1 ubuntu ubuntu 11916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_arn.cc 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289418 4 -rw-r--r-- 1 ubuntu ubuntu 597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period_puller.h 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289322 4 -rw-r--r-- 1 ubuntu ubuntu 2783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_es_main.cc 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289356 4 -rw-r--r-- 1 ubuntu ubuntu 2823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kms.h 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289337 12 -rw-r--r-- 1 ubuntu ubuntu 9106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_http_client.h 2024-03-27T21:32:58.997 INFO:teuthology.orchestra.run.smithi063.stdout: 289378 4 -rw-r--r-- 1 ubuntu ubuntu 530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_request.h 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289298 8 -rw-r--r-- 1 ubuntu ubuntu 6518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cors.cc 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289498 4 -rw-r--r-- 1 ubuntu ubuntu 2217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_signal.cc 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289373 8 -rw-r--r-- 1 ubuntu ubuntu 6256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua_background.cc 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289268 32 -rw-r--r-- 1 ubuntu ubuntu 28822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth.h 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289520 4 -rw-r--r-- 1 ubuntu ubuntu 1639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_torrent.h 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289444 4 -rw-r--r-- 1 ubuntu ubuntu 430 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_req_context.h 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289333 4 -rw-r--r-- 1 ubuntu ubuntu 2318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_frontend.cc 2024-03-27T21:32:58.998 INFO:teuthology.orchestra.run.smithi063.stdout: 289262 8 -rw-r--r-- 1 ubuntu ubuntu 5296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_asio_client.cc 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289310 8 -rw-r--r-- 1 ubuntu ubuntu 5434 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_data_access.cc 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289295 4 -rw-r--r-- 1 ubuntu ubuntu 2124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_compression_types.h 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289364 8 -rw-r--r-- 1 ubuntu ubuntu 5464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lib.h 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289320 4 -rw-r--r-- 1 ubuntu ubuntu 2478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_dmclock_sync_scheduler.h 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289530 12 -rw-r--r-- 1 ubuntu ubuntu 11080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_website.cc 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289401 8 -rw-r--r-- 1 ubuntu ubuntu 4483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_oidc_provider.cc 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289384 8 -rw-r--r-- 1 ubuntu ubuntu 5465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_mdlog.h 2024-03-27T21:32:58.999 INFO:teuthology.orchestra.run.smithi063.stdout: 289450 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_admin.h 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289465 56 -rw-r--r-- 1 ubuntu ubuntu 53501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_pubsub.cc 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289488 8 -rw-r--r-- 1 ubuntu ubuntu 6862 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_s3select_private.h 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289355 40 -rw-r--r-- 1 ubuntu ubuntu 40817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kms.cc 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289296 32 -rw-r--r-- 1 ubuntu ubuntu 29529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_coroutine.cc 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289321 4 -rw-r--r-- 1 ubuntu ubuntu 3768 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_env.cc 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289479 4 -rw-r--r-- 1 ubuntu ubuntu 876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_usage.h 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289297 20 -rw-r--r-- 1 ubuntu ubuntu 19440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_coroutine.h 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289360 4 -rw-r--r-- 1 ubuntu ubuntu 2063 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lc_s3.h 2024-03-27T21:32:59.000 INFO:teuthology.orchestra.run.smithi063.stdout: 289460 4 -rw-r--r-- 1 ubuntu ubuntu 839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_info.h 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289241 16 -rwxr-xr-x 1 ubuntu ubuntu 12828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw-gap-list 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289410 4 -rw-r--r-- 1 ubuntu ubuntu 1419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_os_lib.cc 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289281 4 -rw-r--r-- 1 ubuntu ubuntu 3562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_bucket_encryption.h 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289388 4 -rw-r--r-- 1 ubuntu ubuntu 2661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_multi.cc 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289526 4 -rw-r--r-- 1 ubuntu ubuntu 897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_usage.h 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289353 20 -rw-r--r-- 1 ubuntu ubuntu 20391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_kmip_client_impl.cc 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289446 4 -rw-r--r-- 1 ubuntu ubuntu 860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_resolve.cc 2024-03-27T21:32:59.001 INFO:teuthology.orchestra.run.smithi063.stdout: 289238 4 -rw-r--r-- 1 ubuntu ubuntu 1794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/librgw.cc 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289508 4 -rw-r--r-- 1 ubuntu ubuntu 1239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sync_checkpoint.h 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289273 56 -rw-r--r-- 1 ubuntu ubuntu 56453 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_auth_s3.cc 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289486 40 -rw-r--r-- 1 ubuntu ubuntu 38663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_s3select.cc 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289469 32 -rw-r--r-- 1 ubuntu ubuntu 29194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_role.cc 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289426 16 -rw-r--r-- 1 ubuntu ubuntu 15020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_process.cc 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289466 4 -rw-r--r-- 1 ubuntu ubuntu 1575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_pubsub.h 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289390 4 -rw-r--r-- 1 ubuntu ubuntu 1815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_multi_del.cc 2024-03-27T21:32:59.002 INFO:teuthology.orchestra.run.smithi063.stdout: 289487 4 -rw-r--r-- 1 ubuntu ubuntu 181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_s3select.h 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289489 16 -rw-r--r-- 1 ubuntu ubuntu 12770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sal.cc 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289404 80 -rw-r--r-- 1 ubuntu ubuntu 79551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_op.h 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289397 16 -rw-r--r-- 1 ubuntu ubuntu 15609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_obj_types.h 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289324 4 -rw-r--r-- 1 ubuntu ubuntu 3705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_es_query.h 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289263 4 -rw-r--r-- 1 ubuntu ubuntu 1640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_asio_client.h 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289528 4 -rw-r--r-- 1 ubuntu ubuntu 2984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_user_types.h 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289359 12 -rw-r--r-- 1 ubuntu ubuntu 11154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lc_s3.cc 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289455 24 -rw-r--r-- 1 ubuntu ubuntu 21958 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_conn.cc 2024-03-27T21:32:59.003 INFO:teuthology.orchestra.run.smithi063.stdout: 289372 4 -rw-r--r-- 1 ubuntu ubuntu 2458 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lua.h 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289437 4 -rw-r--r-- 1 ubuntu ubuntu 2097 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_quota_types.h 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289387 20 -rw-r--r-- 1 ubuntu ubuntu 18662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_metadata.cc 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289302 4 -rw-r--r-- 1 ubuntu ubuntu 2339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_cors_swift.h 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289326 76 -rw-r--r-- 1 ubuntu ubuntu 77366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_file_int.h 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289245 16 -rw-r--r-- 1 ubuntu ubuntu 13432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_acl.cc 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289239 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/picojson 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289240 36 -rw-r--r-- 1 ubuntu ubuntu 33607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/picojson/picojson.h 2024-03-27T21:32:59.004 INFO:teuthology.orchestra.run.smithi063.stdout: 289443 4 -rw-r--r-- 1 ubuntu ubuntu 1909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_realm_watcher.h 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289457 8 -rw-r--r-- 1 ubuntu ubuntu 4169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_iam.cc 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289534 12 -rw-r--r-- 1 ubuntu ubuntu 11069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_xml.h 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289507 12 -rw-r--r-- 1 ubuntu ubuntu 9380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_sync_checkpoint.cc 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289462 4 -rw-r--r-- 1 ubuntu ubuntu 3039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_rest_metadata.h 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289277 8 -rw-r--r-- 1 ubuntu ubuntu 7531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_basic_types.h 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289417 4 -rw-r--r-- 1 ubuntu ubuntu 3559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_period_puller.cc 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 289365 4 -rw-r--r-- 1 ubuntu ubuntu 3019 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rgw/rgw_lib_frontend.h 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 285215 4 drwxr-xr-x 22 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd 2024-03-27T21:32:59.005 INFO:teuthology.orchestra.run.smithi063.stdout: 285232 36 -rw-r--r-- 1 ubuntu ubuntu 33924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ImageCtx.cc 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285543 260 -rw-r--r-- 1 ubuntu ubuntu 263565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/librbd.cc 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285229 8 -rw-r--r-- 1 ubuntu ubuntu 4124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ExclusiveLock.h 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285706 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285713 4 -rw-r--r-- 1 ubuntu ubuntu 1455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/WriteLogImageCache.h 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285707 4 -rw-r--r-- 1 ubuntu ubuntu 2862 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/Api.cc 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285710 4 -rw-r--r-- 1 ubuntu ubuntu 927 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/ParentCache.h 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285712 4 -rw-r--r-- 1 ubuntu ubuntu 3129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/WriteLogImageCache.cc 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285711 4 -rw-r--r-- 1 ubuntu ubuntu 1152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/Types.h 2024-03-27T21:32:59.006 INFO:teuthology.orchestra.run.smithi063.stdout: 285708 4 -rw-r--r-- 1 ubuntu ubuntu 2076 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/Api.h 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285709 4 -rw-r--r-- 1 ubuntu ubuntu 2338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/plugin/ParentCache.cc 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285228 12 -rw-r--r-- 1 ubuntu ubuntu 11476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ExclusiveLock.cc 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285231 4 -rw-r--r-- 1 ubuntu ubuntu 359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Features.h 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285719 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash_watcher 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285720 4 -rw-r--r-- 1 ubuntu ubuntu 3267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash_watcher/Types.cc 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285721 4 -rw-r--r-- 1 ubuntu ubuntu 2375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash_watcher/Types.h 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285394 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy 2024-03-27T21:32:59.007 INFO:teuthology.orchestra.run.smithi063.stdout: 285399 4 -rw-r--r-- 1 ubuntu ubuntu 1854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/MetadataCopyRequest.h 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285400 32 -rw-r--r-- 1 ubuntu ubuntu 30571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/ObjectCopyRequest.cc 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285405 8 -rw-r--r-- 1 ubuntu ubuntu 4112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/SnapshotCopyRequest.h 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285406 8 -rw-r--r-- 1 ubuntu ubuntu 5980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/SnapshotCreateRequest.cc 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285404 24 -rw-r--r-- 1 ubuntu ubuntu 23008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/SnapshotCopyRequest.cc 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285402 8 -rw-r--r-- 1 ubuntu ubuntu 6500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/SetHeadRequest.cc 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285401 8 -rw-r--r-- 1 ubuntu ubuntu 4396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/ObjectCopyRequest.h 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285407 4 -rw-r--r-- 1 ubuntu ubuntu 2564 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/SnapshotCreateRequest.h 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285403 4 -rw-r--r-- 1 ubuntu ubuntu 2011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/SetHeadRequest.h 2024-03-27T21:32:59.008 INFO:teuthology.orchestra.run.smithi063.stdout: 285398 4 -rw-r--r-- 1 ubuntu ubuntu 3296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/MetadataCopyRequest.cc 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285396 12 -rw-r--r-- 1 ubuntu ubuntu 9199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/ImageCopyRequest.cc 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285395 4 -rw-r--r-- 1 ubuntu ubuntu 1188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/Handler.h 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285408 4 -rw-r--r-- 1 ubuntu ubuntu 720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/Types.h 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285410 4 -rw-r--r-- 1 ubuntu ubuntu 804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/Utils.h 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285409 4 -rw-r--r-- 1 ubuntu ubuntu 1954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/Utils.cc 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285397 4 -rw-r--r-- 1 ubuntu ubuntu 3503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/deep_copy/ImageCopyRequest.h 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285665 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation 2024-03-27T21:32:59.009 INFO:teuthology.orchestra.run.smithi063.stdout: 285683 4 -rw-r--r-- 1 ubuntu ubuntu 1884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/RenameRequest.h 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285694 16 -rw-r--r-- 1 ubuntu ubuntu 13782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotRemoveRequest.cc 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285682 8 -rw-r--r-- 1 ubuntu ubuntu 7682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/RenameRequest.cc 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285703 4 -rw-r--r-- 1 ubuntu ubuntu 1404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SparsifyRequest.h 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285685 4 -rw-r--r-- 1 ubuntu ubuntu 2749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/Request.h 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285692 4 -rw-r--r-- 1 ubuntu ubuntu 3244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotProtectRequest.cc 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285677 4 -rw-r--r-- 1 ubuntu ubuntu 1477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/MigrateRequest.h 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285701 4 -rw-r--r-- 1 ubuntu ubuntu 2390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotUnprotectRequest.h 2024-03-27T21:32:59.010 INFO:teuthology.orchestra.run.smithi063.stdout: 285697 4 -rw-r--r-- 1 ubuntu ubuntu 1288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotRenameRequest.h 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285695 4 -rw-r--r-- 1 ubuntu ubuntu 3047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotRemoveRequest.h 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285681 4 -rw-r--r-- 1 ubuntu ubuntu 2232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/RebuildObjectMapRequest.h 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285668 16 -rw-r--r-- 1 ubuntu ubuntu 14977 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/EnableFeaturesRequest.cc 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285674 4 -rw-r--r-- 1 ubuntu ubuntu 1821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/MetadataSetRequest.cc 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285698 16 -rw-r--r-- 1 ubuntu ubuntu 13321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotRollbackRequest.cc 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285666 20 -rw-r--r-- 1 ubuntu ubuntu 19969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/DisableFeaturesRequest.cc 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285688 16 -rw-r--r-- 1 ubuntu ubuntu 14041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotCreateRequest.cc 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285678 12 -rw-r--r-- 1 ubuntu ubuntu 8962 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/ObjectMapIterate.cc 2024-03-27T21:32:59.011 INFO:teuthology.orchestra.run.smithi063.stdout: 285691 4 -rw-r--r-- 1 ubuntu ubuntu 1018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotLimitRequest.h 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285676 8 -rw-r--r-- 1 ubuntu ubuntu 6993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/MigrateRequest.cc 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285669 4 -rw-r--r-- 1 ubuntu ubuntu 3231 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/EnableFeaturesRequest.h 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285686 16 -rw-r--r-- 1 ubuntu ubuntu 14389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/ResizeRequest.cc 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285689 8 -rw-r--r-- 1 ubuntu ubuntu 5112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotCreateRequest.h 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285687 8 -rw-r--r-- 1 ubuntu ubuntu 5353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/ResizeRequest.h 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285690 4 -rw-r--r-- 1 ubuntu ubuntu 1793 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotLimitRequest.cc 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285693 4 -rw-r--r-- 1 ubuntu ubuntu 1469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotProtectRequest.h 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285705 4 -rw-r--r-- 1 ubuntu ubuntu 3361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/TrimRequest.h 2024-03-27T21:32:59.012 INFO:teuthology.orchestra.run.smithi063.stdout: 285667 8 -rw-r--r-- 1 ubuntu ubuntu 4650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/DisableFeaturesRequest.h 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285702 16 -rw-r--r-- 1 ubuntu ubuntu 14249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SparsifyRequest.cc 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285684 8 -rw-r--r-- 1 ubuntu ubuntu 5347 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/Request.cc 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285679 4 -rw-r--r-- 1 ubuntu ubuntu 1633 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/ObjectMapIterate.h 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285699 4 -rw-r--r-- 1 ubuntu ubuntu 3587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotRollbackRequest.h 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285704 12 -rw-r--r-- 1 ubuntu ubuntu 12254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/TrimRequest.cc 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285700 12 -rw-r--r-- 1 ubuntu ubuntu 10926 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotUnprotectRequest.cc 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285680 8 -rw-r--r-- 1 ubuntu ubuntu 7683 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/RebuildObjectMapRequest.cc 2024-03-27T21:32:59.013 INFO:teuthology.orchestra.run.smithi063.stdout: 285696 4 -rw-r--r-- 1 ubuntu ubuntu 2978 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/SnapshotRenameRequest.cc 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285670 8 -rw-r--r-- 1 ubuntu ubuntu 7802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/FlattenRequest.cc 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285671 4 -rw-r--r-- 1 ubuntu ubuntu 1739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/FlattenRequest.h 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285673 4 -rw-r--r-- 1 ubuntu ubuntu 1048 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/MetadataRemoveRequest.h 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285672 4 -rw-r--r-- 1 ubuntu ubuntu 1748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/MetadataRemoveRequest.cc 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285675 4 -rw-r--r-- 1 ubuntu ubuntu 1145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/operation/MetadataSetRequest.h 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285254 4 -rw-r--r-- 1 ubuntu ubuntu 2075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/TrashWatcher.h 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285223 12 -rw-r--r-- 1 ubuntu ubuntu 9826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/CMakeLists.txt 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285227 8 -rw-r--r-- 1 ubuntu ubuntu 4194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/DeepCopyRequest.h 2024-03-27T21:32:59.014 INFO:teuthology.orchestra.run.smithi063.stdout: 285253 4 -rw-r--r-- 1 ubuntu ubuntu 3586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/TrashWatcher.cc 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285714 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285716 4 -rw-r--r-- 1 ubuntu ubuntu 1897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash/MoveRequest.h 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285718 4 -rw-r--r-- 1 ubuntu ubuntu 3589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash/RemoveRequest.h 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285715 4 -rw-r--r-- 1 ubuntu ubuntu 3186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash/MoveRequest.cc 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285717 8 -rw-r--r-- 1 ubuntu ubuntu 4427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/trash/RemoveRequest.cc 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285476 4 -rw-r--r-- 1 ubuntu ubuntu 3639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/FlushTracker.cc 2024-03-27T21:32:59.015 INFO:teuthology.orchestra.run.smithi063.stdout: 285501 8 -rw-r--r-- 1 ubuntu ubuntu 4696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/QosImageDispatch.h 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285472 24 -rw-r--r-- 1 ubuntu ubuntu 23931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/CopyupRequest.cc 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285492 4 -rw-r--r-- 1 ubuntu ubuntu 3719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatchInterface.h 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285509 8 -rw-r--r-- 1 ubuntu ubuntu 7396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/SimpleSchedulerObjectDispatch.h 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285500 12 -rw-r--r-- 1 ubuntu ubuntu 10317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/QosImageDispatch.cc 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285505 4 -rw-r--r-- 1 ubuntu ubuntu 2875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ReadResult.h 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285499 16 -rw-r--r-- 1 ubuntu ubuntu 15481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectRequest.h 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285475 4 -rw-r--r-- 1 ubuntu ubuntu 967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/DispatcherInterface.h 2024-03-27T21:32:59.016 INFO:teuthology.orchestra.run.smithi063.stdout: 285502 8 -rw-r--r-- 1 ubuntu ubuntu 5004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/QueueImageDispatch.cc 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285488 4 -rw-r--r-- 1 ubuntu ubuntu 2999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/IoOperations.cc 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285494 12 -rw-r--r-- 1 ubuntu ubuntu 11715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatchSpec.h 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285497 4 -rw-r--r-- 1 ubuntu ubuntu 984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatcherInterface.h 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285506 8 -rw-r--r-- 1 ubuntu ubuntu 5028 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/RefreshImageDispatch.cc 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285507 4 -rw-r--r-- 1 ubuntu ubuntu 3518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/RefreshImageDispatch.h 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285504 12 -rw-r--r-- 1 ubuntu ubuntu 8592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ReadResult.cc 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285511 4 -rw-r--r-- 1 ubuntu ubuntu 1024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/Types.cc 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285479 4 -rw-r--r-- 1 ubuntu ubuntu 3345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatch.h 2024-03-27T21:32:59.017 INFO:teuthology.orchestra.run.smithi063.stdout: 285471 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/AsyncOperation.h 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285485 4 -rw-r--r-- 1 ubuntu ubuntu 1163 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatcherInterface.h 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285481 4 -rw-r--r-- 1 ubuntu ubuntu 1403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatchSpec.cc 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285491 4 -rw-r--r-- 1 ubuntu ubuntu 3809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatch.h 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285493 4 -rw-r--r-- 1 ubuntu ubuntu 995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatchSpec.cc 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285512 12 -rw-r--r-- 1 ubuntu ubuntu 9684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/Types.h 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285477 4 -rw-r--r-- 1 ubuntu ubuntu 1234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/FlushTracker.h 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285508 20 -rw-r--r-- 1 ubuntu ubuntu 18211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/SimpleSchedulerObjectDispatch.cc 2024-03-27T21:32:59.018 INFO:teuthology.orchestra.run.smithi063.stdout: 285480 4 -rw-r--r-- 1 ubuntu ubuntu 3262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatchInterface.h 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285484 4 -rw-r--r-- 1 ubuntu ubuntu 2067 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatcher.h 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285496 4 -rw-r--r-- 1 ubuntu ubuntu 1651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatcher.h 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285498 36 -rw-r--r-- 1 ubuntu ubuntu 35152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectRequest.cc 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285495 8 -rw-r--r-- 1 ubuntu ubuntu 7792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatcher.cc 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285515 8 -rw-r--r-- 1 ubuntu ubuntu 8189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/WriteBlockImageDispatch.cc 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285470 4 -rw-r--r-- 1 ubuntu ubuntu 2761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/AsyncOperation.cc 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285478 8 -rw-r--r-- 1 ubuntu ubuntu 7057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatch.cc 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285483 12 -rw-r--r-- 1 ubuntu ubuntu 10264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatcher.cc 2024-03-27T21:32:59.019 INFO:teuthology.orchestra.run.smithi063.stdout: 285514 4 -rw-r--r-- 1 ubuntu ubuntu 2803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/Utils.h 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285513 12 -rw-r--r-- 1 ubuntu ubuntu 8849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/Utils.cc 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285490 8 -rw-r--r-- 1 ubuntu ubuntu 6378 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ObjectDispatch.cc 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285516 8 -rw-r--r-- 1 ubuntu ubuntu 4333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/WriteBlockImageDispatch.h 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285473 4 -rw-r--r-- 1 ubuntu ubuntu 3844 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/CopyupRequest.h 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285486 32 -rw-r--r-- 1 ubuntu ubuntu 31202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageRequest.cc 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285510 4 -rw-r--r-- 1 ubuntu ubuntu 400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/TypeTraits.h 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285474 8 -rw-r--r-- 1 ubuntu ubuntu 7351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/Dispatcher.h 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285482 12 -rw-r--r-- 1 ubuntu ubuntu 8864 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageDispatchSpec.h 2024-03-27T21:32:59.020 INFO:teuthology.orchestra.run.smithi063.stdout: 285489 4 -rw-r--r-- 1 ubuntu ubuntu 473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/IoOperations.h 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285503 4 -rw-r--r-- 1 ubuntu ubuntu 3749 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/QueueImageDispatch.h 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285468 8 -rw-r--r-- 1 ubuntu ubuntu 7328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/AioCompletion.cc 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285469 8 -rw-r--r-- 1 ubuntu ubuntu 5107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/AioCompletion.h 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285487 16 -rw-r--r-- 1 ubuntu ubuntu 12482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/io/ImageRequest.h 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285544 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285548 4 -rw-r--r-- 1 ubuntu ubuntu 2824 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/BreakRequest.h 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285546 4 -rw-r--r-- 1 ubuntu ubuntu 2727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/AcquireRequest.h 2024-03-27T21:32:59.021 INFO:teuthology.orchestra.run.smithi063.stdout: 285552 4 -rw-r--r-- 1 ubuntu ubuntu 1618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/ReacquireRequest.h 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285550 4 -rw-r--r-- 1 ubuntu ubuntu 1384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/GetLockerRequest.h 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285547 8 -rw-r--r-- 1 ubuntu ubuntu 6969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/BreakRequest.cc 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285553 4 -rw-r--r-- 1 ubuntu ubuntu 3016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/ReleaseRequest.cc 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285551 4 -rw-r--r-- 1 ubuntu ubuntu 2561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/ReacquireRequest.cc 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285549 4 -rw-r--r-- 1 ubuntu ubuntu 3942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/GetLockerRequest.cc 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285555 4 -rw-r--r-- 1 ubuntu ubuntu 1018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/Types.h 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285545 8 -rw-r--r-- 1 ubuntu ubuntu 5791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/AcquireRequest.cc 2024-03-27T21:32:59.022 INFO:teuthology.orchestra.run.smithi063.stdout: 285557 4 -rw-r--r-- 1 ubuntu ubuntu 575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/Utils.h 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285556 4 -rw-r--r-- 1 ubuntu ubuntu 974 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/Utils.cc 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285554 4 -rw-r--r-- 1 ubuntu ubuntu 1571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/managed_lock/ReleaseRequest.h 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285219 4 -rw-r--r-- 1 ubuntu ubuntu 2043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/AsyncObjectThrottle.h 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285233 16 -rw-r--r-- 1 ubuntu ubuntu 13091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ImageCtx.h 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285238 60 -rw-r--r-- 1 ubuntu ubuntu 59886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Journal.cc 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285242 24 -rw-r--r-- 1 ubuntu ubuntu 23779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ManagedLock.cc 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285722 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher 2024-03-27T21:32:59.023 INFO:teuthology.orchestra.run.smithi063.stdout: 285725 4 -rw-r--r-- 1 ubuntu ubuntu 2987 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/RewatchRequest.cc 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285726 4 -rw-r--r-- 1 ubuntu ubuntu 1697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/RewatchRequest.h 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285724 4 -rw-r--r-- 1 ubuntu ubuntu 1437 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/Notifier.h 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285727 4 -rw-r--r-- 1 ubuntu ubuntu 1041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/Types.cc 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285723 4 -rw-r--r-- 1 ubuntu ubuntu 2897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/Notifier.cc 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285728 4 -rw-r--r-- 1 ubuntu ubuntu 1597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/Types.h 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285729 4 -rw-r--r-- 1 ubuntu ubuntu 1804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/watcher/Utils.h 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285222 8 -rw-r--r-- 1 ubuntu ubuntu 5596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/BlockGuard.h 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285237 16 -rw-r--r-- 1 ubuntu ubuntu 12304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ImageWatcher.h 2024-03-27T21:32:59.024 INFO:teuthology.orchestra.run.smithi063.stdout: 285240 4 -rw-r--r-- 1 ubuntu ubuntu 2245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/LibrbdAdminSocketHook.cc 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285241 4 -rw-r--r-- 1 ubuntu ubuntu 801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/LibrbdAdminSocketHook.h 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285258 16 -rw-r--r-- 1 ubuntu ubuntu 15460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/WatchNotifyTypes.cc 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285248 64 -rw-r--r-- 1 ubuntu ubuntu 62994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Operations.cc 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285250 4 -rw-r--r-- 1 ubuntu ubuntu 2788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/PluginRegistry.cc 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285359 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285367 4 -rw-r--r-- 1 ubuntu ubuntu 1018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/DataCryptor.h 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285362 4 -rw-r--r-- 1 ubuntu ubuntu 1174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/CryptoContextPool.cc 2024-03-27T21:32:59.025 INFO:teuthology.orchestra.run.smithi063.stdout: 285360 8 -rw-r--r-- 1 ubuntu ubuntu 4344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/BlockCrypto.cc 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285363 4 -rw-r--r-- 1 ubuntu ubuntu 2036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/CryptoContextPool.h 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285361 4 -rw-r--r-- 1 ubuntu ubuntu 1693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/BlockCrypto.h 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285378 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285384 4 -rw-r--r-- 1 ubuntu ubuntu 1484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/Header.h 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285385 4 -rw-r--r-- 1 ubuntu ubuntu 3031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/LUKSEncryptionFormat.cc 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285389 4 -rw-r--r-- 1 ubuntu ubuntu 3708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/Magic.cc 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285383 8 -rw-r--r-- 1 ubuntu ubuntu 6924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/Header.cc 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285381 8 -rw-r--r-- 1 ubuntu ubuntu 5870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/FormatRequest.cc 2024-03-27T21:32:59.026 INFO:teuthology.orchestra.run.smithi063.stdout: 285388 4 -rw-r--r-- 1 ubuntu ubuntu 2167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/LoadRequest.h 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285390 4 -rw-r--r-- 1 ubuntu ubuntu 875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/Magic.h 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285386 4 -rw-r--r-- 1 ubuntu ubuntu 2993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/LUKSEncryptionFormat.h 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285379 8 -rw-r--r-- 1 ubuntu ubuntu 4572 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/FlattenRequest.cc 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285387 8 -rw-r--r-- 1 ubuntu ubuntu 7928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/LoadRequest.cc 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285380 4 -rw-r--r-- 1 ubuntu ubuntu 1342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/FlattenRequest.h 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285382 4 -rw-r--r-- 1 ubuntu ubuntu 1732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/luks/FormatRequest.h 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285369 4 -rw-r--r-- 1 ubuntu ubuntu 3873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/FormatRequest.cc 2024-03-27T21:32:59.027 INFO:teuthology.orchestra.run.smithi063.stdout: 285374 4 -rw-r--r-- 1 ubuntu ubuntu 950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/ShutDownCryptoRequest.h 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285372 4 -rw-r--r-- 1 ubuntu ubuntu 1413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/LoadRequest.h 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285375 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/Types.h 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285365 24 -rw-r--r-- 1 ubuntu ubuntu 23386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/CryptoObjectDispatch.cc 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285371 8 -rw-r--r-- 1 ubuntu ubuntu 5769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/LoadRequest.cc 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285377 4 -rw-r--r-- 1 ubuntu ubuntu 810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/Utils.h 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285370 4 -rw-r--r-- 1 ubuntu ubuntu 1139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/FormatRequest.h 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285366 4 -rw-r--r-- 1 ubuntu ubuntu 4094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/CryptoObjectDispatch.h 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285376 4 -rw-r--r-- 1 ubuntu ubuntu 2307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/Utils.cc 2024-03-27T21:32:59.028 INFO:teuthology.orchestra.run.smithi063.stdout: 285368 4 -rw-r--r-- 1 ubuntu ubuntu 851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/EncryptionFormat.h 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285391 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/openssl 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285393 4 -rw-r--r-- 1 ubuntu ubuntu 1486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/openssl/DataCryptor.h 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285392 4 -rw-r--r-- 1 ubuntu ubuntu 3903 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/openssl/DataCryptor.cc 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285373 4 -rw-r--r-- 1 ubuntu ubuntu 2387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/ShutDownCryptoRequest.cc 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285364 4 -rw-r--r-- 1 ubuntu ubuntu 3953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/crypto/CryptoInterface.h 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285236 56 -rw-r--r-- 1 ubuntu ubuntu 56554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ImageWatcher.cc 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285425 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image 2024-03-27T21:32:59.029 INFO:teuthology.orchestra.run.smithi063.stdout: 285454 4 -rw-r--r-- 1 ubuntu ubuntu 2169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/SetFlagsRequest.cc 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285433 4 -rw-r--r-- 1 ubuntu ubuntu 2543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/CloseRequest.h 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285437 4 -rw-r--r-- 1 ubuntu ubuntu 3437 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/DetachChildRequest.h 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285453 8 -rw-r--r-- 1 ubuntu ubuntu 6373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/RemoveRequest.h 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285439 4 -rw-r--r-- 1 ubuntu ubuntu 1326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/DetachParentRequest.h 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285445 8 -rw-r--r-- 1 ubuntu ubuntu 4830 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/OpenRequest.h 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285441 4 -rw-r--r-- 1 ubuntu ubuntu 2014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/GetMetadataRequest.h 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285442 8 -rw-r--r-- 1 ubuntu ubuntu 5382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/ListWatchersRequest.cc 2024-03-27T21:32:59.030 INFO:teuthology.orchestra.run.smithi063.stdout: 285430 20 -rw-r--r-- 1 ubuntu ubuntu 16558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/CloneRequest.cc 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285447 4 -rw-r--r-- 1 ubuntu ubuntu 2292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/PreRemoveRequest.h 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285426 8 -rw-r--r-- 1 ubuntu ubuntu 7622 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/AttachChildRequest.cc 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285431 8 -rw-r--r-- 1 ubuntu ubuntu 5123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/CloneRequest.h 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285461 4 -rw-r--r-- 1 ubuntu ubuntu 2228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/ValidatePoolRequest.h 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285451 12 -rw-r--r-- 1 ubuntu ubuntu 10041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/RefreshRequest.h 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285450 52 -rw-r--r-- 1 ubuntu ubuntu 50603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/RefreshRequest.cc 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285460 8 -rw-r--r-- 1 ubuntu ubuntu 5952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/ValidatePoolRequest.cc 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285459 4 -rw-r--r-- 1 ubuntu ubuntu 499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/Types.h 2024-03-27T21:32:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 285448 8 -rw-r--r-- 1 ubuntu ubuntu 8121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/RefreshParentRequest.cc 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285438 4 -rw-r--r-- 1 ubuntu ubuntu 2017 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/DetachParentRequest.cc 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285436 12 -rw-r--r-- 1 ubuntu ubuntu 11042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/DetachChildRequest.cc 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285446 12 -rw-r--r-- 1 ubuntu ubuntu 9251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/PreRemoveRequest.cc 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285449 4 -rw-r--r-- 1 ubuntu ubuntu 3653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/RefreshParentRequest.h 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285457 4 -rw-r--r-- 1 ubuntu ubuntu 3340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/SetSnapRequest.h 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285440 4 -rw-r--r-- 1 ubuntu ubuntu 3391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/GetMetadataRequest.cc 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285428 4 -rw-r--r-- 1 ubuntu ubuntu 2419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/AttachParentRequest.cc 2024-03-27T21:32:59.032 INFO:teuthology.orchestra.run.smithi063.stdout: 285429 4 -rw-r--r-- 1 ubuntu ubuntu 1961 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/AttachParentRequest.h 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285444 24 -rw-r--r-- 1 ubuntu ubuntu 22061 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/OpenRequest.cc 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285434 24 -rw-r--r-- 1 ubuntu ubuntu 24258 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/CreateRequest.cc 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285456 12 -rw-r--r-- 1 ubuntu ubuntu 9795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/SetSnapRequest.cc 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285455 4 -rw-r--r-- 1 ubuntu ubuntu 1235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/SetFlagsRequest.h 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285452 16 -rw-r--r-- 1 ubuntu ubuntu 15781 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/RemoveRequest.cc 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285435 8 -rw-r--r-- 1 ubuntu ubuntu 6757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/CreateRequest.h 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285432 12 -rw-r--r-- 1 ubuntu ubuntu 10339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/CloseRequest.cc 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285458 4 -rw-r--r-- 1 ubuntu ubuntu 434 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/TypeTraits.h 2024-03-27T21:32:59.033 INFO:teuthology.orchestra.run.smithi063.stdout: 285427 4 -rw-r--r-- 1 ubuntu ubuntu 3250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/AttachChildRequest.h 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285443 4 -rw-r--r-- 1 ubuntu ubuntu 1824 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image/ListWatchersRequest.h 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285216 4 -rw-r--r-- 1 ubuntu ubuntu 1827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/AsioEngine.cc 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285589 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285598 4 -rw-r--r-- 1 ubuntu ubuntu 3208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/GetStatusRequest.cc 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285604 8 -rw-r--r-- 1 ubuntu ubuntu 4136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/ImageStateUpdateRequest.cc 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285597 4 -rw-r--r-- 1 ubuntu ubuntu 3844 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/GetInfoRequest.h 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285605 4 -rw-r--r-- 1 ubuntu ubuntu 2026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/ImageStateUpdateRequest.h 2024-03-27T21:32:59.034 INFO:teuthology.orchestra.run.smithi063.stdout: 285603 4 -rw-r--r-- 1 ubuntu ubuntu 1717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/ImageRemoveRequest.h 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285594 12 -rw-r--r-- 1 ubuntu ubuntu 9157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/EnableRequest.cc 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285592 16 -rw-r--r-- 1 ubuntu ubuntu 13445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/DisableRequest.cc 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285591 4 -rw-r--r-- 1 ubuntu ubuntu 1723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/DemoteRequest.h 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285608 4 -rw-r--r-- 1 ubuntu ubuntu 428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/Types.h 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285593 8 -rw-r--r-- 1 ubuntu ubuntu 5050 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/DisableRequest.h 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285607 4 -rw-r--r-- 1 ubuntu ubuntu 1479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/PromoteRequest.h 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285600 4 -rw-r--r-- 1 ubuntu ubuntu 2198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/GetUuidRequest.cc 2024-03-27T21:32:59.035 INFO:teuthology.orchestra.run.smithi063.stdout: 285601 4 -rw-r--r-- 1 ubuntu ubuntu 1351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/GetUuidRequest.h 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285606 4 -rw-r--r-- 1 ubuntu ubuntu 3337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/PromoteRequest.cc 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285602 4 -rw-r--r-- 1 ubuntu ubuntu 2680 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/ImageRemoveRequest.cc 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285596 12 -rw-r--r-- 1 ubuntu ubuntu 8718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/GetInfoRequest.cc 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285599 4 -rw-r--r-- 1 ubuntu ubuntu 2124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/GetStatusRequest.h 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285590 8 -rw-r--r-- 1 ubuntu ubuntu 5882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/DemoteRequest.cc 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285623 4 -rw-r--r-- 1 ubuntu ubuntu 1635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/RemoveImageStateRequest.h 2024-03-27T21:32:59.036 INFO:teuthology.orchestra.run.smithi063.stdout: 285611 4 -rw-r--r-- 1 ubuntu ubuntu 3139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/CreateNonPrimaryRequest.h 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285610 8 -rw-r--r-- 1 ubuntu ubuntu 7423 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/CreateNonPrimaryRequest.cc 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285616 4 -rw-r--r-- 1 ubuntu ubuntu 2818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/GetImageStateRequest.cc 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285625 4 -rw-r--r-- 1 ubuntu ubuntu 1930 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/SetImageStateRequest.h 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285613 4 -rw-r--r-- 1 ubuntu ubuntu 2689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/CreatePrimaryRequest.h 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285629 4 -rw-r--r-- 1 ubuntu ubuntu 2629 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/UnlinkPeerRequest.h 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285632 4 -rw-r--r-- 1 ubuntu ubuntu 3143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/WriteImageStateRequest.cc 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285633 4 -rw-r--r-- 1 ubuntu ubuntu 1664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/WriteImageStateRequest.h 2024-03-27T21:32:59.037 INFO:teuthology.orchestra.run.smithi063.stdout: 285622 4 -rw-r--r-- 1 ubuntu ubuntu 3387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/RemoveImageStateRequest.cc 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285626 4 -rw-r--r-- 1 ubuntu ubuntu 2888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/Types.cc 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285619 4 -rw-r--r-- 1 ubuntu ubuntu 1467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/ImageMeta.h 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285615 4 -rw-r--r-- 1 ubuntu ubuntu 1593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/DemoteRequest.h 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285612 12 -rw-r--r-- 1 ubuntu ubuntu 8304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/CreatePrimaryRequest.cc 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285627 4 -rw-r--r-- 1 ubuntu ubuntu 3272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/Types.h 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285621 4 -rw-r--r-- 1 ubuntu ubuntu 4036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/PromoteRequest.h 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285620 12 -rw-r--r-- 1 ubuntu ubuntu 11030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/PromoteRequest.cc 2024-03-27T21:32:59.038 INFO:teuthology.orchestra.run.smithi063.stdout: 285631 4 -rw-r--r-- 1 ubuntu ubuntu 1103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/Utils.h 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285614 4 -rw-r--r-- 1 ubuntu ubuntu 3049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/DemoteRequest.cc 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285617 4 -rw-r--r-- 1 ubuntu ubuntu 1724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/GetImageStateRequest.h 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285628 8 -rw-r--r-- 1 ubuntu ubuntu 6813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/UnlinkPeerRequest.cc 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285630 8 -rw-r--r-- 1 ubuntu ubuntu 5746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/Utils.cc 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285624 8 -rw-r--r-- 1 ubuntu ubuntu 6489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/SetImageStateRequest.cc 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285618 8 -rw-r--r-- 1 ubuntu ubuntu 5464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/snapshot/ImageMeta.cc 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285595 4 -rw-r--r-- 1 ubuntu ubuntu 4018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirror/EnableRequest.h 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285289 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/asio 2024-03-27T21:32:59.039 INFO:teuthology.orchestra.run.smithi063.stdout: 285291 4 -rw-r--r-- 1 ubuntu ubuntu 1270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/asio/ContextWQ.h 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285292 4 -rw-r--r-- 1 ubuntu ubuntu 792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/asio/Utils.h 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285290 4 -rw-r--r-- 1 ubuntu ubuntu 1263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/asio/ContextWQ.cc 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285220 4 -rw-r--r-- 1 ubuntu ubuntu 1866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/AsyncRequest.cc 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285221 4 -rw-r--r-- 1 ubuntu ubuntu 1604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/AsyncRequest.h 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285465 52 -rw-r--r-- 1 ubuntu ubuntu 49410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/internal.cc 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285239 16 -rw-r--r-- 1 ubuntu ubuntu 13084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Journal.h 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285255 4 -rw-r--r-- 1 ubuntu ubuntu 3665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Types.h 2024-03-27T21:32:59.040 INFO:teuthology.orchestra.run.smithi063.stdout: 285517 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285533 8 -rw-r--r-- 1 ubuntu ubuntu 7233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Replay.h 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285531 4 -rw-r--r-- 1 ubuntu ubuntu 2045 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/RemoveRequest.h 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285526 4 -rw-r--r-- 1 ubuntu ubuntu 1883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/OpenRequest.h 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285532 40 -rw-r--r-- 1 ubuntu ubuntu 38979 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Replay.cc 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285522 4 -rw-r--r-- 1 ubuntu ubuntu 640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/DisabledPolicy.h 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285539 28 -rw-r--r-- 1 ubuntu ubuntu 24589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Types.cc 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285521 4 -rw-r--r-- 1 ubuntu ubuntu 2305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/DemoteRequest.h 2024-03-27T21:32:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 285527 4 -rw-r--r-- 1 ubuntu ubuntu 513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Policy.h 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285524 8 -rw-r--r-- 1 ubuntu ubuntu 4291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/ObjectDispatch.h 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285540 20 -rw-r--r-- 1 ubuntu ubuntu 19656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Types.h 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285529 4 -rw-r--r-- 1 ubuntu ubuntu 2360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/PromoteRequest.h 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285528 8 -rw-r--r-- 1 ubuntu ubuntu 6417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/PromoteRequest.cc 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285536 4 -rw-r--r-- 1 ubuntu ubuntu 894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/StandardPolicy.cc 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285525 8 -rw-r--r-- 1 ubuntu ubuntu 4117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/OpenRequest.cc 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285542 4 -rw-r--r-- 1 ubuntu ubuntu 1729 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Utils.h 2024-03-27T21:32:59.042 INFO:teuthology.orchestra.run.smithi063.stdout: 285518 8 -rw-r--r-- 1 ubuntu ubuntu 6623 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/CreateRequest.cc 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285520 8 -rw-r--r-- 1 ubuntu ubuntu 6801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/DemoteRequest.cc 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285530 8 -rw-r--r-- 1 ubuntu ubuntu 4141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/RemoveRequest.cc 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285519 4 -rw-r--r-- 1 ubuntu ubuntu 2939 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/CreateRequest.h 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285541 4 -rw-r--r-- 1 ubuntu ubuntu 2361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/Utils.cc 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285523 12 -rw-r--r-- 1 ubuntu ubuntu 9041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/ObjectDispatch.cc 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285537 4 -rw-r--r-- 1 ubuntu ubuntu 840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/StandardPolicy.h 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285538 4 -rw-r--r-- 1 ubuntu ubuntu 617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/TypeTraits.h 2024-03-27T21:32:59.043 INFO:teuthology.orchestra.run.smithi063.stdout: 285535 4 -rw-r--r-- 1 ubuntu ubuntu 2630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/ResetRequest.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285534 8 -rw-r--r-- 1 ubuntu ubuntu 4348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/journal/ResetRequest.cc 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285260 12 -rw-r--r-- 1 ubuntu ubuntu 10531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Watcher.cc 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285261 8 -rw-r--r-- 1 ubuntu ubuntu 4543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Watcher.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285243 12 -rw-r--r-- 1 ubuntu ubuntu 8221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ManagedLock.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285247 8 -rw-r--r-- 1 ubuntu ubuntu 6316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ObjectMap.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285249 8 -rw-r--r-- 1 ubuntu ubuntu 5716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Operations.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285245 4 -rw-r--r-- 1 ubuntu ubuntu 2638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/MirroringWatcher.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285217 4 -rw-r--r-- 1 ubuntu ubuntu 2010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/AsioEngine.h 2024-03-27T21:32:59.044 INFO:teuthology.orchestra.run.smithi063.stdout: 285252 8 -rw-r--r-- 1 ubuntu ubuntu 4727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/TaskFinisher.h 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285411 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285418 4 -rw-r--r-- 1 ubuntu ubuntu 2910 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/PostAcquireRequest.h 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285422 4 -rw-r--r-- 1 ubuntu ubuntu 3252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/PreReleaseRequest.h 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285415 8 -rw-r--r-- 1 ubuntu ubuntu 4518 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/ImageDispatch.h 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285416 4 -rw-r--r-- 1 ubuntu ubuntu 732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/Policy.h 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285420 4 -rw-r--r-- 1 ubuntu ubuntu 1420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/PreAcquireRequest.h 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285414 12 -rw-r--r-- 1 ubuntu ubuntu 10081 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/ImageDispatch.cc 2024-03-27T21:32:59.045 INFO:teuthology.orchestra.run.smithi063.stdout: 285417 12 -rw-r--r-- 1 ubuntu ubuntu 9778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/PostAcquireRequest.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285421 12 -rw-r--r-- 1 ubuntu ubuntu 10457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/PreReleaseRequest.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285423 4 -rw-r--r-- 1 ubuntu ubuntu 825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/StandardPolicy.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285424 4 -rw-r--r-- 1 ubuntu ubuntu 812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/StandardPolicy.h 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285419 4 -rw-r--r-- 1 ubuntu ubuntu 2609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/PreAcquireRequest.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285413 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/AutomaticPolicy.h 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285412 4 -rw-r--r-- 1 ubuntu ubuntu 839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/exclusive_lock/AutomaticPolicy.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285234 28 -rw-r--r-- 1 ubuntu ubuntu 28604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ImageState.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285246 16 -rw-r--r-- 1 ubuntu ubuntu 13119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ObjectMap.cc 2024-03-27T21:32:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 285257 12 -rw-r--r-- 1 ubuntu ubuntu 8251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Utils.h 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285230 4 -rw-r--r-- 1 ubuntu ubuntu 3181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Features.cc 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285259 16 -rw-r--r-- 1 ubuntu ubuntu 14766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/WatchNotifyTypes.h 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285226 12 -rw-r--r-- 1 ubuntu ubuntu 9954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/DeepCopyRequest.cc 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285225 4 -rw-r--r-- 1 ubuntu ubuntu 917 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ConfigWatcher.h 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285256 8 -rw-r--r-- 1 ubuntu ubuntu 6934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/Utils.cc 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285656 8 -rw-r--r-- 1 ubuntu ubuntu 7246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/SnapshotRemoveRequest.cc 2024-03-27T21:32:59.047 INFO:teuthology.orchestra.run.smithi063.stdout: 285651 4 -rw-r--r-- 1 ubuntu ubuntu 1401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/Request.h 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285657 4 -rw-r--r-- 1 ubuntu ubuntu 2517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/SnapshotRemoveRequest.h 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285640 16 -rw-r--r-- 1 ubuntu ubuntu 12372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/DiffRequest.cc 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285663 4 -rw-r--r-- 1 ubuntu ubuntu 3980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/UpdateRequest.cc 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285649 4 -rw-r--r-- 1 ubuntu ubuntu 1347 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/RemoveRequest.h 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285658 4 -rw-r--r-- 1 ubuntu ubuntu 3848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/SnapshotRollbackRequest.cc 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285642 4 -rw-r--r-- 1 ubuntu ubuntu 2600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/InvalidateRequest.cc 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285654 8 -rw-r--r-- 1 ubuntu ubuntu 4253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/SnapshotCreateRequest.cc 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285661 4 -rw-r--r-- 1 ubuntu ubuntu 1885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/UnlockRequest.cc 2024-03-27T21:32:59.048 INFO:teuthology.orchestra.run.smithi063.stdout: 285644 8 -rw-r--r-- 1 ubuntu ubuntu 4758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/LockRequest.cc 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285652 4 -rw-r--r-- 1 ubuntu ubuntu 2144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/ResizeRequest.cc 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285655 4 -rw-r--r-- 1 ubuntu ubuntu 1791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/SnapshotCreateRequest.h 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285653 4 -rw-r--r-- 1 ubuntu ubuntu 1340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/ResizeRequest.h 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285664 4 -rw-r--r-- 1 ubuntu ubuntu 3250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/UpdateRequest.h 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285647 4 -rw-r--r-- 1 ubuntu ubuntu 3126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/RefreshRequest.h 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285662 4 -rw-r--r-- 1 ubuntu ubuntu 950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/UnlockRequest.h 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285650 4 -rw-r--r-- 1 ubuntu ubuntu 1960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/Request.cc 2024-03-27T21:32:59.049 INFO:teuthology.orchestra.run.smithi063.stdout: 285646 12 -rw-r--r-- 1 ubuntu ubuntu 9804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/RefreshRequest.cc 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285660 4 -rw-r--r-- 1 ubuntu ubuntu 868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/Types.h 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285659 4 -rw-r--r-- 1 ubuntu ubuntu 1727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/SnapshotRollbackRequest.h 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285638 4 -rw-r--r-- 1 ubuntu ubuntu 2710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/CreateRequest.cc 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285648 4 -rw-r--r-- 1 ubuntu ubuntu 2326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/RemoveRequest.cc 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285639 4 -rw-r--r-- 1 ubuntu ubuntu 1206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/CreateRequest.h 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285645 4 -rw-r--r-- 1 ubuntu ubuntu 2431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/LockRequest.h 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285641 4 -rw-r--r-- 1 ubuntu ubuntu 2246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/DiffRequest.h 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285643 4 -rw-r--r-- 1 ubuntu ubuntu 1122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/object_map/InvalidateRequest.h 2024-03-27T21:32:59.050 INFO:teuthology.orchestra.run.smithi063.stdout: 285244 8 -rw-r--r-- 1 ubuntu ubuntu 4595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/MirroringWatcher.cc 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285224 4 -rw-r--r-- 1 ubuntu ubuntu 3053 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ConfigWatcher.cc 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285293 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285309 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285318 4 -rw-r--r-- 1 ubuntu ubuntu 2182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/InitRequest.h 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285327 12 -rw-r--r-- 1 ubuntu ubuntu 11409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/Request.h 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285314 4 -rw-r--r-- 1 ubuntu ubuntu 1719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/DiscardRequest.h 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285322 4 -rw-r--r-- 1 ubuntu ubuntu 2540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/LogMap.h 2024-03-27T21:32:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: 285329 4 -rw-r--r-- 1 ubuntu ubuntu 1913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ShutdownRequest.h 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285324 12 -rw-r--r-- 1 ubuntu ubuntu 8440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/LogOperation.h 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285325 4 -rw-r--r-- 1 ubuntu ubuntu 1132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ReadRequest.h 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285328 8 -rw-r--r-- 1 ubuntu ubuntu 4455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ShutdownRequest.cc 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285331 4 -rw-r--r-- 1 ubuntu ubuntu 2776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/SyncPoint.h 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285334 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285340 4 -rw-r--r-- 1 ubuntu ubuntu 2326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/ReadRequest.cc 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285343 4 -rw-r--r-- 1 ubuntu ubuntu 3097 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/Request.h 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285345 8 -rw-r--r-- 1 ubuntu ubuntu 4695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/WriteLog.h 2024-03-27T21:32:59.052 INFO:teuthology.orchestra.run.smithi063.stdout: 285339 4 -rw-r--r-- 1 ubuntu ubuntu 1957 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/LogOperation.h 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285341 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/ReadRequest.h 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285337 4 -rw-r--r-- 1 ubuntu ubuntu 2712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/LogEntry.h 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285335 8 -rw-r--r-- 1 ubuntu ubuntu 4540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/Builder.h 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285342 4 -rw-r--r-- 1 ubuntu ubuntu 3092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/Request.cc 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285336 4 -rw-r--r-- 1 ubuntu ubuntu 3299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/LogEntry.cc 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285338 4 -rw-r--r-- 1 ubuntu ubuntu 1289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/LogOperation.cc 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285344 40 -rw-r--r-- 1 ubuntu ubuntu 36933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/rwl/WriteLog.cc 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285320 12 -rw-r--r-- 1 ubuntu ubuntu 10315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/LogEntry.h 2024-03-27T21:32:59.053 INFO:teuthology.orchestra.run.smithi063.stdout: 285346 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285352 4 -rw-r--r-- 1 ubuntu ubuntu 3374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/ReadRequest.cc 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285355 4 -rw-r--r-- 1 ubuntu ubuntu 3081 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/Request.h 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285358 8 -rw-r--r-- 1 ubuntu ubuntu 5926 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/WriteLog.h 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285351 4 -rw-r--r-- 1 ubuntu ubuntu 1131 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/LogOperation.h 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285353 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/ReadRequest.h 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285349 4 -rw-r--r-- 1 ubuntu ubuntu 2804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/LogEntry.h 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285347 8 -rw-r--r-- 1 ubuntu ubuntu 4536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/Builder.h 2024-03-27T21:32:59.054 INFO:teuthology.orchestra.run.smithi063.stdout: 285354 4 -rw-r--r-- 1 ubuntu ubuntu 2219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/Request.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285356 4 -rw-r--r-- 1 ubuntu ubuntu 1221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/Types.h 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285348 4 -rw-r--r-- 1 ubuntu ubuntu 1847 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/LogEntry.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285350 4 -rw-r--r-- 1 ubuntu ubuntu 1036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/LogOperation.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285357 44 -rw-r--r-- 1 ubuntu ubuntu 41635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ssd/WriteLog.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285317 8 -rw-r--r-- 1 ubuntu ubuntu 6206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/InitRequest.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285310 88 -rw-r--r-- 1 ubuntu ubuntu 86929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/AbstractWriteLog.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285332 8 -rw-r--r-- 1 ubuntu ubuntu 6030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/Types.cc 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285312 4 -rw-r--r-- 1 ubuntu ubuntu 2842 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/Builder.h 2024-03-27T21:32:59.055 INFO:teuthology.orchestra.run.smithi063.stdout: 285330 4 -rw-r--r-- 1 ubuntu ubuntu 4009 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/SyncPoint.cc 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285311 16 -rw-r--r-- 1 ubuntu ubuntu 14906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/AbstractWriteLog.h 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285326 24 -rw-r--r-- 1 ubuntu ubuntu 21501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/Request.cc 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285313 8 -rw-r--r-- 1 ubuntu ubuntu 4243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/DiscardRequest.cc 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285333 16 -rw-r--r-- 1 ubuntu ubuntu 16288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/Types.h 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285315 8 -rw-r--r-- 1 ubuntu ubuntu 6512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ImageCacheState.cc 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285319 4 -rw-r--r-- 1 ubuntu ubuntu 4025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/LogEntry.cc 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285321 12 -rw-r--r-- 1 ubuntu ubuntu 10025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/LogMap.cc 2024-03-27T21:32:59.056 INFO:teuthology.orchestra.run.smithi063.stdout: 285323 12 -rw-r--r-- 1 ubuntu ubuntu 11626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/LogOperation.cc 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285316 4 -rw-r--r-- 1 ubuntu ubuntu 2251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/pwl/ImageCacheState.h 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285307 8 -rw-r--r-- 1 ubuntu ubuntu 7751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/WriteLogImageDispatch.cc 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285294 8 -rw-r--r-- 1 ubuntu ubuntu 5731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ImageWriteback.cc 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285308 4 -rw-r--r-- 1 ubuntu ubuntu 3942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/WriteLogImageDispatch.h 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285297 8 -rw-r--r-- 1 ubuntu ubuntu 4671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ObjectCacherObjectDispatch.h 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285296 20 -rw-r--r-- 1 ubuntu ubuntu 17646 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ObjectCacherObjectDispatch.cc 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285303 4 -rw-r--r-- 1 ubuntu ubuntu 557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/Types.h 2024-03-27T21:32:59.057 INFO:teuthology.orchestra.run.smithi063.stdout: 285299 4 -rw-r--r-- 1 ubuntu ubuntu 2594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ObjectCacherWriteback.h 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285298 12 -rw-r--r-- 1 ubuntu ubuntu 10164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ObjectCacherWriteback.cc 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285305 20 -rw-r--r-- 1 ubuntu ubuntu 18026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/WriteAroundObjectDispatch.cc 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285304 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/Utils.h 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285301 8 -rw-r--r-- 1 ubuntu ubuntu 5482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ParentCacheObjectDispatch.h 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285302 4 -rw-r--r-- 1 ubuntu ubuntu 515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/TypeTraits.h 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285306 8 -rw-r--r-- 1 ubuntu ubuntu 7237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/WriteAroundObjectDispatch.h 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285300 12 -rw-r--r-- 1 ubuntu ubuntu 8298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ParentCacheObjectDispatch.cc 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285295 4 -rw-r--r-- 1 ubuntu ubuntu 2899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/cache/ImageWriteback.h 2024-03-27T21:32:59.058 INFO:teuthology.orchestra.run.smithi063.stdout: 285462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image_watcher 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285463 4 -rw-r--r-- 1 ubuntu ubuntu 2508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image_watcher/NotifyLockOwner.cc 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285464 4 -rw-r--r-- 1 ubuntu ubuntu 1179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/image_watcher/NotifyLockOwner.h 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285262 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285266 4 -rw-r--r-- 1 ubuntu ubuntu 1851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/DiffIterate.h 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285274 8 -rw-r--r-- 1 ubuntu ubuntu 4328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Migration.h 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285277 8 -rw-r--r-- 1 ubuntu ubuntu 5911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Namespace.cc 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285267 36 -rw-r--r-- 1 ubuntu ubuntu 35799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Group.cc 2024-03-27T21:32:59.059 INFO:teuthology.orchestra.run.smithi063.stdout: 285275 68 -rw-r--r-- 1 ubuntu ubuntu 66186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Mirror.cc 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285280 4 -rw-r--r-- 1 ubuntu ubuntu 913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Pool.h 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285286 4 -rw-r--r-- 1 ubuntu ubuntu 1783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Trash.h 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285284 4 -rw-r--r-- 1 ubuntu ubuntu 2125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Snapshot.h 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285268 4 -rw-r--r-- 1 ubuntu ubuntu 2386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Group.h 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285281 8 -rw-r--r-- 1 ubuntu ubuntu 4276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/PoolMetadata.cc 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285272 4 -rw-r--r-- 1 ubuntu ubuntu 3000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Io.h 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285271 20 -rw-r--r-- 1 ubuntu ubuntu 17870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Io.cc 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285269 32 -rw-r--r-- 1 ubuntu ubuntu 30982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Image.cc 2024-03-27T21:32:59.060 INFO:teuthology.orchestra.run.smithi063.stdout: 285278 4 -rw-r--r-- 1 ubuntu ubuntu 863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Namespace.h 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285263 8 -rw-r--r-- 1 ubuntu ubuntu 6087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Config.cc 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285273 64 -rw-r--r-- 1 ubuntu ubuntu 65448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Migration.cc 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285265 16 -rw-r--r-- 1 ubuntu ubuntu 16165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/DiffIterate.cc 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285282 4 -rw-r--r-- 1 ubuntu ubuntu 1030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/PoolMetadata.h 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285264 4 -rw-r--r-- 1 ubuntu ubuntu 1032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Config.h 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285276 8 -rw-r--r-- 1 ubuntu ubuntu 5990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Mirror.h 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285288 4 -rw-r--r-- 1 ubuntu ubuntu 701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Utils.h 2024-03-27T21:32:59.061 INFO:teuthology.orchestra.run.smithi063.stdout: 285283 12 -rw-r--r-- 1 ubuntu ubuntu 12026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Snapshot.cc 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285285 28 -rw-r--r-- 1 ubuntu ubuntu 24816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Trash.cc 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285270 4 -rw-r--r-- 1 ubuntu ubuntu 3265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Image.h 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285287 4 -rw-r--r-- 1 ubuntu ubuntu 3607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Utils.cc 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285279 12 -rw-r--r-- 1 ubuntu ubuntu 10605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/api/Pool.cc 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285235 4 -rw-r--r-- 1 ubuntu ubuntu 3735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/ImageState.h 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285218 4 -rw-r--r-- 1 ubuntu ubuntu 2763 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/AsyncObjectThrottle.cc 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285251 4 -rw-r--r-- 1 ubuntu ubuntu 1120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/PluginRegistry.h 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285558 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration 2024-03-27T21:32:59.062 INFO:teuthology.orchestra.run.smithi063.stdout: 285569 12 -rw-r--r-- 1 ubuntu ubuntu 9909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/NativeFormat.cc 2024-03-27T21:32:59.063 INFO:teuthology.orchestra.run.smithi063.stdout: 285575 8 -rw-r--r-- 1 ubuntu ubuntu 5972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/QCOWFormat.h 2024-03-27T21:32:59.063 INFO:teuthology.orchestra.run.smithi063.stdout: 285576 8 -rw-r--r-- 1 ubuntu ubuntu 7465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/RawFormat.cc 2024-03-27T21:32:59.063 INFO:teuthology.orchestra.run.smithi063.stdout: 285572 4 -rw-r--r-- 1 ubuntu ubuntu 2644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/OpenSourceImageRequest.h 2024-03-27T21:32:59.063 INFO:teuthology.orchestra.run.smithi063.stdout: 285578 8 -rw-r--r-- 1 ubuntu ubuntu 6330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/RawSnapshot.cc 2024-03-27T21:32:59.063 INFO:teuthology.orchestra.run.smithi063.stdout: 285579 4 -rw-r--r-- 1 ubuntu ubuntu 2256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/RawSnapshot.h 2024-03-27T21:32:59.063 INFO:teuthology.orchestra.run.smithi063.stdout: 285559 8 -rw-r--r-- 1 ubuntu ubuntu 6301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/FileStream.cc 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285564 4 -rw-r--r-- 1 ubuntu ubuntu 702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/HttpProcessorInterface.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285581 4 -rw-r--r-- 1 ubuntu ubuntu 2039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/S3Stream.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285563 8 -rw-r--r-- 1 ubuntu ubuntu 6322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/HttpClient.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285568 4 -rw-r--r-- 1 ubuntu ubuntu 3741 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/ImageDispatch.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285570 4 -rw-r--r-- 1 ubuntu ubuntu 2579 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/NativeFormat.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285585 4 -rw-r--r-- 1 ubuntu ubuntu 783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/StreamInterface.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285584 4 -rw-r--r-- 1 ubuntu ubuntu 1437 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/SourceSpecBuilder.h 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285571 8 -rw-r--r-- 1 ubuntu ubuntu 7603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/OpenSourceImageRequest.cc 2024-03-27T21:32:59.064 INFO:teuthology.orchestra.run.smithi063.stdout: 285560 4 -rw-r--r-- 1 ubuntu ubuntu 1840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/FileStream.h 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285577 4 -rw-r--r-- 1 ubuntu ubuntu 2455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/RawFormat.h 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285583 8 -rw-r--r-- 1 ubuntu ubuntu 4674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/SourceSpecBuilder.cc 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285586 4 -rw-r--r-- 1 ubuntu ubuntu 936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/Types.h 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285562 32 -rw-r--r-- 1 ubuntu ubuntu 28892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/HttpClient.cc 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285574 52 -rw-r--r-- 1 ubuntu ubuntu 51953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/QCOWFormat.cc 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285580 8 -rw-r--r-- 1 ubuntu ubuntu 6118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/S3Stream.cc 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285567 8 -rw-r--r-- 1 ubuntu ubuntu 5213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/ImageDispatch.cc 2024-03-27T21:32:59.065 INFO:teuthology.orchestra.run.smithi063.stdout: 285588 4 -rw-r--r-- 1 ubuntu ubuntu 943 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/Utils.h 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285565 4 -rw-r--r-- 1 ubuntu ubuntu 2171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/HttpStream.cc 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285587 8 -rw-r--r-- 1 ubuntu ubuntu 4523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/Utils.cc 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285582 4 -rw-r--r-- 1 ubuntu ubuntu 1348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/SnapshotInterface.h 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285566 4 -rw-r--r-- 1 ubuntu ubuntu 1750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/HttpStream.h 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285561 4 -rw-r--r-- 1 ubuntu ubuntu 1563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/FormatInterface.h 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285573 16 -rw-r--r-- 1 ubuntu ubuntu 15822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/migration/QCOW.h 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285634 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirroring_watcher 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285635 4 -rw-r--r-- 1 ubuntu ubuntu 3770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirroring_watcher/Types.cc 2024-03-27T21:32:59.066 INFO:teuthology.orchestra.run.smithi063.stdout: 285636 4 -rw-r--r-- 1 ubuntu ubuntu 2681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/mirroring_watcher/Types.h 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 285466 8 -rw-r--r-- 1 ubuntu ubuntu 5956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librbd/internal.h 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 290998 4 drwxr-xr-x 17 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 291370 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_nbd 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 291374 4 -rwxr-xr-x 1 ubuntu ubuntu 552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_nbd/rbd-nbd_quiesce 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 291372 4 -rw-r--r-- 1 ubuntu ubuntu 2423 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_nbd/nbd-netlink.h 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 291371 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_nbd/CMakeLists.txt 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 291373 64 -rw-r--r-- 1 ubuntu ubuntu 64293 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_nbd/rbd-nbd.cc 2024-03-27T21:32:59.067 INFO:teuthology.orchestra.run.smithi063.stdout: 291404 12 -rw-r--r-- 1 ubuntu ubuntu 10273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rebuild_mondb.cc 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291033 4 -rw-r--r-- 1 ubuntu ubuntu 1481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_objectstore_tool.h 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291408 12 -rw-r--r-- 1 ubuntu ubuntu 8798 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/scratchtool.c 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291410 4 -rwxr-xr-x 1 ubuntu ubuntu 2994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/setup-virtualenv.sh 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291035 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291059 12 -rw-r--r-- 1 ubuntu ubuntu 10711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/TableTool.cc 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291036 4 -rw-r--r-- 1 ubuntu ubuntu 1522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/CMakeLists.txt 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291050 4 -rw-r--r-- 1 ubuntu ubuntu 1602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/MDSUtility.h 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291061 4 -rw-r--r-- 1 ubuntu ubuntu 1012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/cephfs-data-scan.cc 2024-03-27T21:32:59.068 INFO:teuthology.orchestra.run.smithi063.stdout: 291053 8 -rw-r--r-- 1 ubuntu ubuntu 4937 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/PgFiles.cc 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291039 16 -rw-r--r-- 1 ubuntu ubuntu 13264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/Dumper.cc 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291048 4 -rw-r--r-- 1 ubuntu ubuntu 2745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/JournalTool.h 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291066 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/shell 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291067 4 -rw-r--r-- 1 ubuntu ubuntu 134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/shell/CMakeLists.txt 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291070 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/shell/tox.ini 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291068 72 -rwxr-xr-x 1 ubuntu ubuntu 71725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/shell/cephfs-shell 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291069 4 -rw-r--r-- 1 ubuntu ubuntu 704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/shell/setup.py 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291040 4 -rw-r--r-- 1 ubuntu ubuntu 1125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/Dumper.h 2024-03-27T21:32:59.069 INFO:teuthology.orchestra.run.smithi063.stdout: 291052 8 -rw-r--r-- 1 ubuntu ubuntu 6916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/MetaTool.h 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291058 4 -rw-r--r-- 1 ubuntu ubuntu 761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/RoleSelector.h 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291055 8 -rw-r--r-- 1 ubuntu ubuntu 5621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/Resetter.cc 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291063 4 -rw-r--r-- 1 ubuntu ubuntu 3394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/cephfs-meta-injection.cc 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291042 4 -rw-r--r-- 1 ubuntu ubuntu 920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/EventOutput.h 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291076 4 -rw-r--r-- 1 ubuntu ubuntu 745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/type_helper.hpp 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291047 40 -rw-r--r-- 1 ubuntu ubuntu 39285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/JournalTool.cc 2024-03-27T21:32:59.070 INFO:teuthology.orchestra.run.smithi063.stdout: 291056 4 -rw-r--r-- 1 ubuntu ubuntu 1161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/Resetter.h 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291071 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/top 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291072 4 -rw-r--r-- 1 ubuntu ubuntu 255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/top/CMakeLists.txt 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291075 4 -rw-r--r-- 1 ubuntu ubuntu 131 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/top/tox.ini 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291073 56 -rwxr-xr-x 1 ubuntu ubuntu 54103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/top/cephfs-top 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291074 4 -rw-r--r-- 1 ubuntu ubuntu 662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/top/setup.py 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291038 12 -rw-r--r-- 1 ubuntu ubuntu 8566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/DataScan.h 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291045 16 -rw-r--r-- 1 ubuntu ubuntu 13240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/JournalScanner.cc 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291057 4 -rw-r--r-- 1 ubuntu ubuntu 1543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/RoleSelector.cc 2024-03-27T21:32:59.071 INFO:teuthology.orchestra.run.smithi063.stdout: 291054 4 -rw-r--r-- 1 ubuntu ubuntu 1161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/PgFiles.h 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291049 4 -rw-r--r-- 1 ubuntu ubuntu 3492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/MDSUtility.cc 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291060 4 -rw-r--r-- 1 ubuntu ubuntu 931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/TableTool.h 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291041 8 -rw-r--r-- 1 ubuntu ubuntu 4601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/EventOutput.cc 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291064 4 -rw-r--r-- 1 ubuntu ubuntu 994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/cephfs-table-tool.cc 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291062 4 -rw-r--r-- 1 ubuntu ubuntu 1391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/cephfs-journal-tool.cc 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291065 8 -rw-r--r-- 1 ubuntu ubuntu 5901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/first-damage.py 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291046 4 -rw-r--r-- 1 ubuntu ubuntu 3519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/JournalScanner.h 2024-03-27T21:32:59.072 INFO:teuthology.orchestra.run.smithi063.stdout: 291051 28 -rw-r--r-- 1 ubuntu ubuntu 28460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/MetaTool.cc 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291044 4 -rw-r--r-- 1 ubuntu ubuntu 1719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/JournalFilter.h 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291043 12 -rw-r--r-- 1 ubuntu ubuntu 9467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/JournalFilter.cc 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291037 72 -rw-r--r-- 1 ubuntu ubuntu 73118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs/DataScan.cc 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291139 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rados 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291140 8 -rw-r--r-- 1 ubuntu ubuntu 4559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rados/PoolDump.cc 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291141 4 -rw-r--r-- 1 ubuntu ubuntu 695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rados/PoolDump.h 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291142 12 -rw-r--r-- 1 ubuntu ubuntu 11332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rados/RadosImport.cc 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291144 128 -rw-r--r-- 1 ubuntu ubuntu 129291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rados/rados.cc 2024-03-27T21:32:59.073 INFO:teuthology.orchestra.run.smithi063.stdout: 291143 4 -rw-r--r-- 1 ubuntu ubuntu 1120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rados/RadosImport.h 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 290999 8 -rw-r--r-- 1 ubuntu ubuntu 4707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/CMakeLists.txt 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291032 136 -rw-r--r-- 1 ubuntu ubuntu 136972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_objectstore_tool.cc 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291133 12 -rw-r--r-- 1 ubuntu ubuntu 9897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/kvstore_tool.cc 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291077 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291078 4 -rw-r--r-- 1 ubuntu ubuntu 523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/CMakeLists.txt 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291088 4 -rw-r--r-- 1 ubuntu ubuntu 2187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/MirrorWatcher.h 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291085 20 -rw-r--r-- 1 ubuntu ubuntu 19517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Mirror.cc 2024-03-27T21:32:59.074 INFO:teuthology.orchestra.run.smithi063.stdout: 291100 4 -rw-r--r-- 1 ubuntu ubuntu 3429 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/main.cc 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291084 4 -rw-r--r-- 1 ubuntu ubuntu 2321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/InstanceWatcher.h 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291101 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/watcher 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291102 4 -rw-r--r-- 1 ubuntu ubuntu 2617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/watcher/RewatchRequest.cc 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291103 4 -rw-r--r-- 1 ubuntu ubuntu 1581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/watcher/RewatchRequest.h 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291089 56 -rw-r--r-- 1 ubuntu ubuntu 53279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/PeerReplayer.cc 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291093 4 -rw-r--r-- 1 ubuntu ubuntu 555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Types.cc 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291099 4 -rw-r--r-- 1 ubuntu ubuntu 1137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/aio_utils.h 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291080 4 -rw-r--r-- 1 ubuntu ubuntu 2000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/ClusterWatcher.h 2024-03-27T21:32:59.075 INFO:teuthology.orchestra.run.smithi063.stdout: 291094 4 -rw-r--r-- 1 ubuntu ubuntu 2221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Types.h 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291097 8 -rw-r--r-- 1 ubuntu ubuntu 8024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Watcher.cc 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291098 4 -rw-r--r-- 1 ubuntu ubuntu 2590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Watcher.h 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291086 8 -rw-r--r-- 1 ubuntu ubuntu 4300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Mirror.h 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291082 8 -rw-r--r-- 1 ubuntu ubuntu 4438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/FSMirror.h 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291081 16 -rw-r--r-- 1 ubuntu ubuntu 14015 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/FSMirror.cc 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291096 4 -rw-r--r-- 1 ubuntu ubuntu 621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Utils.h 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291092 4 -rw-r--r-- 1 ubuntu ubuntu 1713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/ServiceDaemon.h 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291095 8 -rw-r--r-- 1 ubuntu ubuntu 4870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/Utils.cc 2024-03-27T21:32:59.076 INFO:teuthology.orchestra.run.smithi063.stdout: 291079 8 -rw-r--r-- 1 ubuntu ubuntu 5203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/ClusterWatcher.cc 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291090 12 -rw-r--r-- 1 ubuntu ubuntu 11406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/PeerReplayer.h 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291091 8 -rw-r--r-- 1 ubuntu ubuntu 6223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/ServiceDaemon.cc 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291083 8 -rw-r--r-- 1 ubuntu ubuntu 6861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/InstanceWatcher.cc 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291087 8 -rw-r--r-- 1 ubuntu ubuntu 4298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/cephfs_mirror/MirrorWatcher.cc 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291031 48 -rw-r--r-- 1 ubuntu ubuntu 46350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_monstore_tool.cc 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291034 8 -rw-r--r-- 1 ubuntu ubuntu 6624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_osdomap_tool.cc 2024-03-27T21:32:59.077 INFO:teuthology.orchestra.run.smithi063.stdout: 291001 12 -rw-r--r-- 1 ubuntu ubuntu 10275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/RadosDump.h 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291030 12 -rw-r--r-- 1 ubuntu ubuntu 9644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_kvstore_tool.cc 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291409 12 -rw-r--r-- 1 ubuntu ubuntu 8612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/scratchtoolpp.cc 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291137 36 -rw-r--r-- 1 ubuntu ubuntu 35117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/osdmaptool.cc 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291375 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291387 4 -rwxr-xr-x 1 ubuntu ubuntu 3759 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/osd_job 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291385 4 -rw-r--r-- 1 ubuntu ubuntu 2837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/epoch_h 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291376 4 -rw-r--r-- 1 ubuntu ubuntu 834 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/FAQ 2024-03-27T21:32:59.078 INFO:teuthology.orchestra.run.smithi063.stdout: 291389 16 -rwxr-xr-x 1 ubuntu ubuntu 13603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/test_rbd_recover_tool.sh 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291379 12 -rw-r--r-- 1 ubuntu ubuntu 9845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/common_h 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291377 4 -rw-r--r-- 1 ubuntu ubuntu 4072 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/README 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291378 4 -rw-r--r-- 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/TODO 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291386 12 -rw-r--r-- 1 ubuntu ubuntu 10554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/metadata_h 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291384 36 -rw-r--r-- 1 ubuntu ubuntu 35184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/database_h 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291380 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/config 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291382 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/config/mon_host 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291381 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/config/mds_host 2024-03-27T21:32:59.079 INFO:teuthology.orchestra.run.smithi063.stdout: 291383 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/config/osd_host_path 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291388 8 -rwxr-xr-x 1 ubuntu ubuntu 7864 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_recover_tool/rbd-recover-tool 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291406 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rgw 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291407 8 -rwxr-xr-x 1 ubuntu ubuntu 5850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rgw/parse-cr-dump.py 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291145 4 -rw-r--r-- 1 ubuntu ubuntu 3802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/radosacl.cc 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291022 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-lazy 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291025 20 -rwxr-xr-x 1 ubuntu ubuntu 16653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-lazy/ceph-lazy 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291023 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-lazy/bash_completion.d 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291024 4 -rw-r--r-- 1 ubuntu ubuntu 916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-lazy/bash_completion.d/ceph-lazy 2024-03-27T21:32:59.080 INFO:teuthology.orchestra.run.smithi063.stdout: 291108 44 -rw-r--r-- 1 ubuntu ubuntu 44467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/crushtool.cc 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291135 16 -rw-r--r-- 1 ubuntu ubuntu 14244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/monmaptool.cc 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291138 4 -rw-r--r-- 1 ubuntu ubuntu 3210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/psim.cc 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291136 12 -rw-r--r-- 1 ubuntu ubuntu 10459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/neorados.cc 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291000 4 -rw-r--r-- 1 ubuntu ubuntu 3225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/RadosDump.cc 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291112 8 -rwxr-xr-x 1 ubuntu ubuntu 5003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/histogram_dump.py 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291208 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291210 4 -rw-r--r-- 1 ubuntu ubuntu 3501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Driver.cc 2024-03-27T21:32:59.081 INFO:teuthology.orchestra.run.smithi063.stdout: 291212 4 -rw-r--r-- 1 ubuntu ubuntu 936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Request.h 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291213 8 -rw-r--r-- 1 ubuntu ubuntu 6259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Server.cc 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291209 4 -rw-r--r-- 1 ubuntu ubuntu 202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/CMakeLists.txt 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291219 12 -rw-r--r-- 1 ubuntu ubuntu 9251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/ggate_drv.c 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291221 16 -rw-r--r-- 1 ubuntu ubuntu 13814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/main.cc 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291220 4 -rw-r--r-- 1 ubuntu ubuntu 1618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/ggate_drv.h 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291217 4 -rw-r--r-- 1 ubuntu ubuntu 1058 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/debug.cc 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291215 4 -rw-r--r-- 1 ubuntu ubuntu 1210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Watcher.cc 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291218 4 -rw-r--r-- 1 ubuntu ubuntu 405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/debug.h 2024-03-27T21:32:59.082 INFO:teuthology.orchestra.run.smithi063.stdout: 291216 4 -rw-r--r-- 1 ubuntu ubuntu 616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Watcher.h 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291214 4 -rw-r--r-- 1 ubuntu ubuntu 1803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Server.h 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291211 4 -rw-r--r-- 1 ubuntu ubuntu 987 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_ggate/Driver.h 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291002 8 -rw-r--r-- 1 ubuntu ubuntu 4709 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-client-debug.cc 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291028 12 -rw-r--r-- 1 ubuntu ubuntu 8788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_conf.cc 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291003 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291011 4 -rw-r--r-- 1 ubuntu ubuntu 812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/mds_types.cc 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291017 4 -rw-r--r-- 1 ubuntu ubuntu 812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/rgw_types.cc 2024-03-27T21:32:59.083 INFO:teuthology.orchestra.run.smithi063.stdout: 291015 4 -rw-r--r-- 1 ubuntu ubuntu 812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/rbd_types.cc 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291004 4 -rw-r--r-- 1 ubuntu ubuntu 2621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/CMakeLists.txt 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291018 8 -rw-r--r-- 1 ubuntu ubuntu 5163 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/rgw_types.h 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291005 12 -rw-r--r-- 1 ubuntu ubuntu 8299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/ceph_dencoder.cc 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291013 4 -rw-r--r-- 1 ubuntu ubuntu 989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/osd_types.cc 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291014 8 -rw-r--r-- 1 ubuntu ubuntu 5173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/osd_types.h 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291009 4 -rw-r--r-- 1 ubuntu ubuntu 2671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/denc_plugin.h 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291012 4 -rw-r--r-- 1 ubuntu ubuntu 2515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/mds_types.h 2024-03-27T21:32:59.084 INFO:teuthology.orchestra.run.smithi063.stdout: 291007 4 -rw-r--r-- 1 ubuntu ubuntu 818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/common_types.cc 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291006 4 -rw-r--r-- 1 ubuntu ubuntu 1918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/ceph_time.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291019 4 -rw-r--r-- 1 ubuntu ubuntu 1240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/sstring.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291020 4 -rw-r--r-- 1 ubuntu ubuntu 821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/str.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291008 16 -rw-r--r-- 1 ubuntu ubuntu 12589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/common_types.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291010 8 -rw-r--r-- 1 ubuntu ubuntu 6212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/denc_registry.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291016 4 -rw-r--r-- 1 ubuntu ubuntu 1601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-dencoder/rbd_types.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291146 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291157 4 -rw-r--r-- 1 ubuntu ubuntu 1759 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/Schedule.h 2024-03-27T21:32:59.085 INFO:teuthology.orchestra.run.smithi063.stdout: 291153 4 -rw-r--r-- 1 ubuntu ubuntu 1886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/MirrorDaemonServiceInfo.h 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291149 4 -rw-r--r-- 1 ubuntu ubuntu 2107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/CMakeLists.txt 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291159 4 -rw-r--r-- 1 ubuntu ubuntu 2482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/Shell.h 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291156 12 -rw-r--r-- 1 ubuntu ubuntu 9856 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/Schedule.cc 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291155 4 -rw-r--r-- 1 ubuntu ubuntu 1207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/OptionPrinter.h 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291207 4 -rw-r--r-- 1 ubuntu ubuntu 283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/rbd.cc 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291148 12 -rw-r--r-- 1 ubuntu ubuntu 9170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/ArgumentTypes.h 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291151 4 -rw-r--r-- 1 ubuntu ubuntu 1429 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/IndentStream.h 2024-03-27T21:32:59.086 INFO:teuthology.orchestra.run.smithi063.stdout: 291158 20 -rw-r--r-- 1 ubuntu ubuntu 16481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/Shell.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291147 20 -rw-r--r-- 1 ubuntu ubuntu 19433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/ArgumentTypes.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291152 12 -rw-r--r-- 1 ubuntu ubuntu 8701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/MirrorDaemonServiceInfo.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291161 12 -rw-r--r-- 1 ubuntu ubuntu 9916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/Utils.h 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291160 36 -rw-r--r-- 1 ubuntu ubuntu 35865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/Utils.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291150 4 -rw-r--r-- 1 ubuntu ubuntu 1532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/IndentStream.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291165 4 -rw-r--r-- 1 ubuntu ubuntu 2991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Clone.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291190 8 -rw-r--r-- 1 ubuntu ubuntu 5038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Namespace.cc 2024-03-27T21:32:59.087 INFO:teuthology.orchestra.run.smithi063.stdout: 291199 32 -rw-r--r-- 1 ubuntu ubuntu 29881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Snap.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291205 8 -rw-r--r-- 1 ubuntu ubuntu 4189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Watch.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291194 4 -rw-r--r-- 1 ubuntu ubuntu 3569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/PersistentCache.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291177 28 -rw-r--r-- 1 ubuntu ubuntu 27199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Group.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291176 8 -rw-r--r-- 1 ubuntu ubuntu 4794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Ggate.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291180 16 -rw-r--r-- 1 ubuntu ubuntu 13586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Info.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291174 4 -rw-r--r-- 1 ubuntu ubuntu 3523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Feature.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291182 24 -rw-r--r-- 1 ubuntu ubuntu 20752 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Kernel.cc 2024-03-27T21:32:59.088 INFO:teuthology.orchestra.run.smithi063.stdout: 291191 12 -rw-r--r-- 1 ubuntu ubuntu 11882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Nbd.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291173 20 -rw-r--r-- 1 ubuntu ubuntu 17153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Export.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291172 4 -rw-r--r-- 1 ubuntu ubuntu 3826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Encryption.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291181 36 -rw-r--r-- 1 ubuntu ubuntu 33778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Journal.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291193 20 -rw-r--r-- 1 ubuntu ubuntu 19365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Perf.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291188 56 -rw-r--r-- 1 ubuntu ubuntu 54433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/MirrorPool.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291197 4 -rw-r--r-- 1 ubuntu ubuntu 2878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Rename.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291164 8 -rw-r--r-- 1 ubuntu ubuntu 5139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Children.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291198 4 -rw-r--r-- 1 ubuntu ubuntu 3434 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Resize.cc 2024-03-27T21:32:59.089 INFO:teuthology.orchestra.run.smithi063.stdout: 291189 12 -rw-r--r-- 1 ubuntu ubuntu 8440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/MirrorSnapshotSchedule.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291171 12 -rw-r--r-- 1 ubuntu ubuntu 11669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/DiskUsage.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291196 8 -rw-r--r-- 1 ubuntu ubuntu 5037 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Remove.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291167 8 -rw-r--r-- 1 ubuntu ubuntu 5909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Copy.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291203 12 -rw-r--r-- 1 ubuntu ubuntu 9404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/TrashPurgeSchedule.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291200 4 -rw-r--r-- 1 ubuntu ubuntu 2271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Sparsify.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291187 20 -rw-r--r-- 1 ubuntu ubuntu 19713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/MirrorImage.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291166 24 -rw-r--r-- 1 ubuntu ubuntu 23927 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Config.cc 2024-03-27T21:32:59.090 INFO:teuthology.orchestra.run.smithi063.stdout: 291186 16 -rw-r--r-- 1 ubuntu ubuntu 13322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Migration.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291175 4 -rw-r--r-- 1 ubuntu ubuntu 2483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Flatten.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291185 12 -rw-r--r-- 1 ubuntu ubuntu 10854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/MergeDiff.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291184 8 -rw-r--r-- 1 ubuntu ubuntu 7862 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Lock.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291192 4 -rw-r--r-- 1 ubuntu ubuntu 3767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/ObjectMap.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291179 28 -rw-r--r-- 1 ubuntu ubuntu 27270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Import.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291170 4 -rw-r--r-- 1 ubuntu ubuntu 3928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Diff.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291202 20 -rw-r--r-- 1 ubuntu ubuntu 16639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Trash.cc 2024-03-27T21:32:59.091 INFO:teuthology.orchestra.run.smithi063.stdout: 291168 8 -rw-r--r-- 1 ubuntu ubuntu 6794 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Create.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291195 8 -rw-r--r-- 1 ubuntu ubuntu 5047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Pool.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291183 12 -rw-r--r-- 1 ubuntu ubuntu 9866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/List.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291206 8 -rw-r--r-- 1 ubuntu ubuntu 4551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Wnbd.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291169 12 -rw-r--r-- 1 ubuntu ubuntu 10206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Device.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291204 8 -rw-r--r-- 1 ubuntu ubuntu 7271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Ubbd.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291163 20 -rw-r--r-- 1 ubuntu ubuntu 17128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Bench.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291201 16 -rw-r--r-- 1 ubuntu ubuntu 13634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/Status.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291178 12 -rw-r--r-- 1 ubuntu ubuntu 9620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/action/ImageMeta.cc 2024-03-27T21:32:59.092 INFO:teuthology.orchestra.run.smithi063.stdout: 291154 8 -rw-r--r-- 1 ubuntu ubuntu 5415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd/OptionPrinter.cc 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291222 4 drwxr-xr-x 11 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291251 12 -rw-r--r-- 1 ubuntu ubuntu 11836 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/NamespaceReplayer.h 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291263 4 -rw-r--r-- 1 ubuntu ubuntu 882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Threads.cc 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291258 4 -rw-r--r-- 1 ubuntu ubuntu 459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ProgressContext.h 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291224 4 -rw-r--r-- 1 ubuntu ubuntu 2467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/CMakeLists.txt 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291237 8 -rw-r--r-- 1 ubuntu ubuntu 4375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/InstanceReplayer.h 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291246 12 -rw-r--r-- 1 ubuntu ubuntu 11172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/MirrorStatusUpdater.cc 2024-03-27T21:32:59.093 INFO:teuthology.orchestra.run.smithi063.stdout: 291244 20 -rw-r--r-- 1 ubuntu ubuntu 19591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Mirror.cc 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291266 4 -rw-r--r-- 1 ubuntu ubuntu 1856 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Throttler.h 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291362 8 -rw-r--r-- 1 ubuntu ubuntu 4454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/main.cc 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291247 4 -rw-r--r-- 1 ubuntu ubuntu 3803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/MirrorStatusUpdater.h 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291265 8 -rw-r--r-- 1 ubuntu ubuntu 6593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Throttler.cc 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291242 28 -rw-r--r-- 1 ubuntu ubuntu 27856 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/LeaderWatcher.cc 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291252 4 -rw-r--r-- 1 ubuntu ubuntu 2195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/PoolMetaCache.cc 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291230 20 -rw-r--r-- 1 ubuntu ubuntu 18046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageMap.cc 2024-03-27T21:32:59.094 INFO:teuthology.orchestra.run.smithi063.stdout: 291292 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291293 16 -rw-r--r-- 1 ubuntu ubuntu 14292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/BootstrapRequest.cc 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291294 8 -rw-r--r-- 1 ubuntu ubuntu 6112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/BootstrapRequest.h 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291313 4 -rw-r--r-- 1 ubuntu ubuntu 785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/TimeRollingMean.cc 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291298 8 -rw-r--r-- 1 ubuntu ubuntu 4941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/CreateImageRequest.h 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291302 4 -rw-r--r-- 1 ubuntu ubuntu 1692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/OpenImageRequest.h 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291309 4 -rw-r--r-- 1 ubuntu ubuntu 937 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/Replayer.h 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291300 4 -rw-r--r-- 1 ubuntu ubuntu 1873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/GetMirrorImageIdRequest.h 2024-03-27T21:32:59.095 INFO:teuthology.orchestra.run.smithi063.stdout: 291299 4 -rw-r--r-- 1 ubuntu ubuntu 2312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/GetMirrorImageIdRequest.cc 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291310 4 -rw-r--r-- 1 ubuntu ubuntu 505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/ReplayerListener.h 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291306 4 -rw-r--r-- 1 ubuntu ubuntu 2893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/PrepareLocalImageRequest.h 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291303 8 -rw-r--r-- 1 ubuntu ubuntu 8058 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/OpenLocalImageRequest.cc 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291296 4 -rw-r--r-- 1 ubuntu ubuntu 1191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/CloseImageRequest.h 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291297 16 -rw-r--r-- 1 ubuntu ubuntu 14206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/CreateImageRequest.cc 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291295 4 -rw-r--r-- 1 ubuntu ubuntu 1545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/CloseImageRequest.cc 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291308 8 -rw-r--r-- 1 ubuntu ubuntu 4596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/PrepareRemoteImageRequest.h 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291301 4 -rw-r--r-- 1 ubuntu ubuntu 2150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/OpenImageRequest.cc 2024-03-27T21:32:59.096 INFO:teuthology.orchestra.run.smithi063.stdout: 291311 4 -rw-r--r-- 1 ubuntu ubuntu 3716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/StateBuilder.cc 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291314 4 -rw-r--r-- 1 ubuntu ubuntu 989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/TimeRollingMean.h 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291315 4 -rw-r--r-- 1 ubuntu ubuntu 465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/Types.h 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291318 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291326 4 -rw-r--r-- 1 ubuntu ubuntu 2204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/ReplayStatusFormatter.h 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291325 12 -rw-r--r-- 1 ubuntu ubuntu 8484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/ReplayStatusFormatter.cc 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291321 8 -rw-r--r-- 1 ubuntu ubuntu 5959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/EventPreprocessor.cc 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291323 12 -rw-r--r-- 1 ubuntu ubuntu 10297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/PrepareReplayRequest.cc 2024-03-27T21:32:59.097 INFO:teuthology.orchestra.run.smithi063.stdout: 291328 12 -rw-r--r-- 1 ubuntu ubuntu 10900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/Replayer.h 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291331 4 -rw-r--r-- 1 ubuntu ubuntu 3318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/SyncPointHandler.cc 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291332 4 -rw-r--r-- 1 ubuntu ubuntu 1620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/SyncPointHandler.h 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291320 4 -rw-r--r-- 1 ubuntu ubuntu 3223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/CreateLocalImageRequest.h 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291329 8 -rw-r--r-- 1 ubuntu ubuntu 4535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/StateBuilder.cc 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291322 4 -rw-r--r-- 1 ubuntu ubuntu 3562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/EventPreprocessor.h 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291327 40 -rw-r--r-- 1 ubuntu ubuntu 40251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/Replayer.cc 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291319 8 -rw-r--r-- 1 ubuntu ubuntu 5096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/CreateLocalImageRequest.cc 2024-03-27T21:32:59.098 INFO:teuthology.orchestra.run.smithi063.stdout: 291324 4 -rw-r--r-- 1 ubuntu ubuntu 2768 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/PrepareReplayRequest.h 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291330 4 -rw-r--r-- 1 ubuntu ubuntu 2810 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/journal/StateBuilder.h 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291305 8 -rw-r--r-- 1 ubuntu ubuntu 6027 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/PrepareLocalImageRequest.cc 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291307 12 -rw-r--r-- 1 ubuntu ubuntu 9702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/PrepareRemoteImageRequest.cc 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291312 4 -rw-r--r-- 1 ubuntu ubuntu 3121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/StateBuilder.h 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291317 4 -rw-r--r-- 1 ubuntu ubuntu 847 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/Utils.h 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291316 4 -rw-r--r-- 1 ubuntu ubuntu 1732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/Utils.cc 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291304 4 -rw-r--r-- 1 ubuntu ubuntu 2718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/OpenLocalImageRequest.h 2024-03-27T21:32:59.099 INFO:teuthology.orchestra.run.smithi063.stdout: 291333 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291334 20 -rw-r--r-- 1 ubuntu ubuntu 20398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/ApplyImageStateRequest.cc 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291338 4 -rw-r--r-- 1 ubuntu ubuntu 2039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/PrepareReplayRequest.cc 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291341 12 -rw-r--r-- 1 ubuntu ubuntu 11210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/Replayer.h 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291335 4 -rw-r--r-- 1 ubuntu ubuntu 3754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/ApplyImageStateRequest.h 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291337 4 -rw-r--r-- 1 ubuntu ubuntu 3377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/CreateLocalImageRequest.h 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291342 4 -rw-r--r-- 1 ubuntu ubuntu 3553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/StateBuilder.cc 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291340 52 -rw-r--r-- 1 ubuntu ubuntu 53099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/Replayer.cc 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291336 8 -rw-r--r-- 1 ubuntu ubuntu 6315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/CreateLocalImageRequest.cc 2024-03-27T21:32:59.100 INFO:teuthology.orchestra.run.smithi063.stdout: 291339 4 -rw-r--r-- 1 ubuntu ubuntu 2212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/PrepareReplayRequest.h 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291343 4 -rw-r--r-- 1 ubuntu ubuntu 2490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/StateBuilder.h 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291345 4 -rw-r--r-- 1 ubuntu ubuntu 838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/Utils.h 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291344 4 -rw-r--r-- 1 ubuntu ubuntu 2269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_replayer/snapshot/Utils.cc 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291239 12 -rw-r--r-- 1 ubuntu ubuntu 9612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/InstanceWatcher.h 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291249 4 -rw-r--r-- 1 ubuntu ubuntu 1157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/MirrorStatusWatcher.h 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291367 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/service_daemon 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291368 4 -rw-r--r-- 1 ubuntu ubuntu 609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/service_daemon/Types.cc 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291369 4 -rw-r--r-- 1 ubuntu ubuntu 782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/service_daemon/Types.h 2024-03-27T21:32:59.101 INFO:teuthology.orchestra.run.smithi063.stdout: 291279 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291290 4 -rw-r--r-- 1 ubuntu ubuntu 2686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/UpdateRequest.cc 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291284 4 -rw-r--r-- 1 ubuntu ubuntu 2559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/SimplePolicy.cc 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291281 4 -rw-r--r-- 1 ubuntu ubuntu 1758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/LoadRequest.h 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291288 4 -rw-r--r-- 1 ubuntu ubuntu 3182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/Types.cc 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291291 4 -rw-r--r-- 1 ubuntu ubuntu 1811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/UpdateRequest.h 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291287 4 -rw-r--r-- 1 ubuntu ubuntu 2103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/StateTransition.h 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291282 16 -rw-r--r-- 1 ubuntu ubuntu 13796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/Policy.cc 2024-03-27T21:32:59.102 INFO:teuthology.orchestra.run.smithi063.stdout: 291283 4 -rw-r--r-- 1 ubuntu ubuntu 3826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/Policy.h 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291289 4 -rw-r--r-- 1 ubuntu ubuntu 2955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/Types.h 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291285 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/SimplePolicy.h 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291280 8 -rw-r--r-- 1 ubuntu ubuntu 4296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/LoadRequest.cc 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291286 4 -rw-r--r-- 1 ubuntu ubuntu 3531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_map/StateTransition.cc 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291363 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/pool_watcher 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291364 4 -rw-r--r-- 1 ubuntu ubuntu 2281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/pool_watcher/RefreshImagesRequest.cc 2024-03-27T21:32:59.103 INFO:teuthology.orchestra.run.smithi063.stdout: 291366 4 -rw-r--r-- 1 ubuntu ubuntu 656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/pool_watcher/Types.h 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291365 4 -rw-r--r-- 1 ubuntu ubuntu 1718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/pool_watcher/RefreshImagesRequest.h 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291233 12 -rw-r--r-- 1 ubuntu ubuntu 8195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageReplayer.h 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291250 24 -rw-r--r-- 1 ubuntu ubuntu 24303 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/NamespaceReplayer.cc 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291264 4 -rw-r--r-- 1 ubuntu ubuntu 1059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Threads.h 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291232 36 -rw-r--r-- 1 ubuntu ubuntu 34092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageReplayer.cc 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291231 8 -rw-r--r-- 1 ubuntu ubuntu 5441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageMap.h 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/instances 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291358 4 -rw-r--r-- 1 ubuntu ubuntu 624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/instances/Types.h 2024-03-27T21:32:59.104 INFO:teuthology.orchestra.run.smithi063.stdout: 291267 4 -rw-r--r-- 1 ubuntu ubuntu 946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Types.cc 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291243 12 -rw-r--r-- 1 ubuntu ubuntu 10829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/LeaderWatcher.h 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291255 12 -rw-r--r-- 1 ubuntu ubuntu 8480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/PoolReplayer.h 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291227 4 -rw-r--r-- 1 ubuntu ubuntu 1918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ClusterWatcher.h 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291236 16 -rw-r--r-- 1 ubuntu ubuntu 16149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/InstanceReplayer.cc 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291260 4 -rw-r--r-- 1 ubuntu ubuntu 3308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/RemotePoolPoller.h 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291228 16 -rw-r--r-- 1 ubuntu ubuntu 16376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageDeleter.cc 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291253 4 -rw-r--r-- 1 ubuntu ubuntu 1411 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/PoolMetaCache.h 2024-03-27T21:32:59.105 INFO:teuthology.orchestra.run.smithi063.stdout: 291234 16 -rw-r--r-- 1 ubuntu ubuntu 12538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageSync.cc 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291268 8 -rw-r--r-- 1 ubuntu ubuntu 4427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Types.h 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291229 8 -rw-r--r-- 1 ubuntu ubuntu 5576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageDeleter.h 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291346 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291350 4 -rw-r--r-- 1 ubuntu ubuntu 2121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/SyncPointPruneRequest.h 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291348 4 -rw-r--r-- 1 ubuntu ubuntu 2266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/SyncPointCreateRequest.h 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291347 8 -rw-r--r-- 1 ubuntu ubuntu 4667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/SyncPointCreateRequest.cc 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291349 8 -rw-r--r-- 1 ubuntu ubuntu 5936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/SyncPointPruneRequest.cc 2024-03-27T21:32:59.106 INFO:teuthology.orchestra.run.smithi063.stdout: 291351 4 -rw-r--r-- 1 ubuntu ubuntu 2017 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/Types.h 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291353 4 -rw-r--r-- 1 ubuntu ubuntu 358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/Utils.h 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291352 4 -rw-r--r-- 1 ubuntu ubuntu 519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_sync/Utils.cc 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291259 8 -rw-r--r-- 1 ubuntu ubuntu 7198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/RemotePoolPoller.cc 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291241 8 -rw-r--r-- 1 ubuntu ubuntu 4452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Instances.h 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291235 8 -rw-r--r-- 1 ubuntu ubuntu 4287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ImageSync.h 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291245 4 -rw-r--r-- 1 ubuntu ubuntu 2376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Mirror.h 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291248 4 -rw-r--r-- 1 ubuntu ubuntu 2060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/MirrorStatusWatcher.cc 2024-03-27T21:32:59.107 INFO:teuthology.orchestra.run.smithi063.stdout: 291269 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291273 4 -rw-r--r-- 1 ubuntu ubuntu 3322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/TrashMoveRequest.h 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291277 4 -rw-r--r-- 1 ubuntu ubuntu 3602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/TrashWatcher.h 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291276 12 -rw-r--r-- 1 ubuntu ubuntu 10581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/TrashWatcher.cc 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291270 8 -rw-r--r-- 1 ubuntu ubuntu 7618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/SnapshotPurgeRequest.cc 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291274 8 -rw-r--r-- 1 ubuntu ubuntu 7343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/TrashRemoveRequest.cc 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291275 4 -rw-r--r-- 1 ubuntu ubuntu 2883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/TrashRemoveRequest.h 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291278 4 -rw-r--r-- 1 ubuntu ubuntu 1177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/Types.h 2024-03-27T21:32:59.108 INFO:teuthology.orchestra.run.smithi063.stdout: 291271 4 -rw-r--r-- 1 ubuntu ubuntu 2399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/SnapshotPurgeRequest.h 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291272 12 -rw-r--r-- 1 ubuntu ubuntu 11458 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/image_deleter/TrashMoveRequest.cc 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291223 4 -rw-r--r-- 1 ubuntu ubuntu 609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/BaseRequest.h 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291354 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/instance_watcher 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291355 8 -rw-r--r-- 1 ubuntu ubuntu 6332 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/instance_watcher/Types.cc 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291356 8 -rw-r--r-- 1 ubuntu ubuntu 5146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/instance_watcher/Types.h 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291240 12 -rw-r--r-- 1 ubuntu ubuntu 9765 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/Instances.cc 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291225 4 -rw-r--r-- 1 ubuntu ubuntu 998 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/CancelableRequest.h 2024-03-27T21:32:59.109 INFO:teuthology.orchestra.run.smithi063.stdout: 291262 4 -rw-r--r-- 1 ubuntu ubuntu 2775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ServiceDaemon.h 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291226 8 -rw-r--r-- 1 ubuntu ubuntu 7708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ClusterWatcher.cc 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291359 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/leader_watcher 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291360 4 -rw-r--r-- 1 ubuntu ubuntu 3880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/leader_watcher/Types.cc 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291361 4 -rw-r--r-- 1 ubuntu ubuntu 2870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/leader_watcher/Types.h 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291256 16 -rw-r--r-- 1 ubuntu ubuntu 13360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/PoolWatcher.cc 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291261 12 -rw-r--r-- 1 ubuntu ubuntu 9242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/ServiceDaemon.cc 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291238 40 -rw-r--r-- 1 ubuntu ubuntu 38105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/InstanceWatcher.cc 2024-03-27T21:32:59.110 INFO:teuthology.orchestra.run.smithi063.stdout: 291257 8 -rw-r--r-- 1 ubuntu ubuntu 4213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/PoolWatcher.h 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291254 36 -rw-r--r-- 1 ubuntu ubuntu 32868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_mirror/PoolReplayer.cc 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291107 12 -rwxr-xr-x 1 ubuntu ubuntu 10743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/crushdiff 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291021 4 -rw-r--r-- 1 ubuntu ubuntu 3698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-diff-sorted.cc 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291390 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291392 4 -rw-r--r-- 1 ubuntu ubuntu 2458 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rados_client_cache.cc 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291391 4 -rw-r--r-- 1 ubuntu ubuntu 479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/CMakeLists.txt 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291396 4 -rw-r--r-- 1 ubuntu ubuntu 3257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rbd_mapping_config.cc 2024-03-27T21:32:59.111 INFO:teuthology.orchestra.run.smithi063.stdout: 291403 4 -rw-r--r-- 1 ubuntu ubuntu 2059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/wnbd_wmi.h 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291395 4 -rw-r--r-- 1 ubuntu ubuntu 2714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rbd_mapping.h 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291397 4 -rw-r--r-- 1 ubuntu ubuntu 2207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rbd_mapping_config.h 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291402 8 -rw-r--r-- 1 ubuntu ubuntu 6511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/wnbd_wmi.cc 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291398 48 -rw-r--r-- 1 ubuntu ubuntu 46531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rbd_wnbd.cc 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291393 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rados_client_cache.h 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291400 16 -rw-r--r-- 1 ubuntu ubuntu 13075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/wnbd_handler.cc 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291394 8 -rw-r--r-- 1 ubuntu ubuntu 7175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rbd_mapping.cc 2024-03-27T21:32:59.112 INFO:teuthology.orchestra.run.smithi063.stdout: 291399 4 -rw-r--r-- 1 ubuntu ubuntu 2897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/rbd_wnbd.h 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291401 8 -rw-r--r-- 1 ubuntu ubuntu 4827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rbd_wnbd/wnbd_handler.h 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291026 8 -rwxr-xr-x 1 ubuntu ubuntu 4950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph-monstore-update-crush.sh 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291104 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/contrib 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291106 12 -rwxr-xr-x 1 ubuntu ubuntu 9550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/contrib/ceph-migrate-bluestore.bash 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291105 4 -rw-r--r-- 1 ubuntu ubuntu 397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/contrib/README.rst 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291029 60 -rw-r--r-- 1 ubuntu ubuntu 58089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_dedup_tool.cc 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291115 16 -rw-r--r-- 1 ubuntu ubuntu 13620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheClient.cc 2024-03-27T21:32:59.113 INFO:teuthology.orchestra.run.smithi063.stdout: 291116 4 -rw-r--r-- 1 ubuntu ubuntu 2704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheClient.h 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291114 4 -rw-r--r-- 1 ubuntu ubuntu 504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CMakeLists.txt 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291118 4 -rw-r--r-- 1 ubuntu ubuntu 894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheController.h 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291132 4 -rw-r--r-- 1 ubuntu ubuntu 2413 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/main.cc 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291122 4 -rw-r--r-- 1 ubuntu ubuntu 1605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheSession.h 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291120 4 -rw-r--r-- 1 ubuntu ubuntu 996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheServer.h 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291121 8 -rw-r--r-- 1 ubuntu ubuntu 4126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheSession.cc 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291126 8 -rw-r--r-- 1 ubuntu ubuntu 5870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/SimplePolicy.cc 2024-03-27T21:32:59.114 INFO:teuthology.orchestra.run.smithi063.stdout: 291129 8 -rw-r--r-- 1 ubuntu ubuntu 5478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/Types.cc 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291125 4 -rw-r--r-- 1 ubuntu ubuntu 818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/Policy.h 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291117 4 -rw-r--r-- 1 ubuntu ubuntu 3854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheController.cc 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291119 4 -rw-r--r-- 1 ubuntu ubuntu 2664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/CacheServer.cc 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291130 8 -rw-r--r-- 1 ubuntu ubuntu 4398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/Types.h 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291124 4 -rw-r--r-- 1 ubuntu ubuntu 2857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/ObjectCacheStore.h 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291127 4 -rw-r--r-- 1 ubuntu ubuntu 1735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/SimplePolicy.h 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291131 4 -rw-r--r-- 1 ubuntu ubuntu 802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/Utils.h 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291123 16 -rw-r--r-- 1 ubuntu ubuntu 14441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/ObjectCacheStore.cc 2024-03-27T21:32:59.115 INFO:teuthology.orchestra.run.smithi063.stdout: 291128 4 -rw-r--r-- 1 ubuntu ubuntu 968 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/immutable_object_cache/SocketCommon.h 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 291109 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/erasure-code 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 291110 4 -rw-r--r-- 1 ubuntu ubuntu 230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/erasure-code/CMakeLists.txt 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 291111 12 -rw-r--r-- 1 ubuntu ubuntu 9905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/erasure-code/ceph-erasure-code-tool.cc 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 291027 12 -rw-r--r-- 1 ubuntu ubuntu 9844 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/ceph_authtool.cc 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 291134 4 -rw-r--r-- 1 ubuntu ubuntu 2363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/kvstore_tool.h 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 291405 4 -rw-r--r-- 1 ubuntu ubuntu 228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tools/rebuild_mondb.h 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 289603 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/s3select 2024-03-27T21:32:59.116 INFO:teuthology.orchestra.run.smithi063.stdout: 283292 4 -rw-r--r-- 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/TODO 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 285075 16 -rwxr-xr-x 1 ubuntu ubuntu 14414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/init-ceph.in 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 283702 28 -rw-r--r-- 1 ubuntu ubuntu 25438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_osd.cc 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 286298 4 -rwxr-xr-x 1 ubuntu ubuntu 2246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mypy.ini 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 289062 8 -rwxr-xr-x 1 ubuntu ubuntu 4481 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbdmap 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 289604 20 -rw-r--r-- 1 ubuntu ubuntu 19213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/sample.ceph.conf 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 283695 4 -rw-r--r-- 1 ubuntu ubuntu 2397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph.conf.twoosds 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 284795 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto 2024-03-27T21:32:59.117 INFO:teuthology.orchestra.run.smithi063.stdout: 284798 4 -rw-r--r-- 1 ubuntu ubuntu 1109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/crypto_plugin.h 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284796 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/CMakeLists.txt 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284799 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284802 4 -rw-r--r-- 1 ubuntu ubuntu 1770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l/isal_crypto_accel.cc 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284801 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l/isa-l_crypto 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284800 4 -rw-r--r-- 1 ubuntu ubuntu 1371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l/CMakeLists.txt 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284804 4 -rw-r--r-- 1 ubuntu ubuntu 966 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l/isal_crypto_plugin.cc 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284805 4 -rw-r--r-- 1 ubuntu ubuntu 1345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l/isal_crypto_plugin.h 2024-03-27T21:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout: 284803 4 -rw-r--r-- 1 ubuntu ubuntu 1707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/isa-l/isal_crypto_accel.h 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284797 4 -rw-r--r-- 1 ubuntu ubuntu 1869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/crypto_accel.h 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284806 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/openssl 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284807 4 -rw-r--r-- 1 ubuntu ubuntu 564 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/openssl/CMakeLists.txt 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284808 4 -rw-r--r-- 1 ubuntu ubuntu 3626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/openssl/openssl_crypto_accel.cc 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284811 4 -rw-r--r-- 1 ubuntu ubuntu 1023 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/openssl/openssl_crypto_plugin.h 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284810 4 -rw-r--r-- 1 ubuntu ubuntu 813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/openssl/openssl_crypto_plugin.cc 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284809 4 -rw-r--r-- 1 ubuntu ubuntu 1725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/openssl/openssl_crypto_accel.h 2024-03-27T21:32:59.119 INFO:teuthology.orchestra.run.smithi063.stdout: 284812 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284813 4 -rw-r--r-- 1 ubuntu ubuntu 562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/CMakeLists.txt 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284817 4 -rw-r--r-- 1 ubuntu ubuntu 1117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/qat_crypto_plugin.h 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284814 4 -rw-r--r-- 1 ubuntu ubuntu 1498 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/qat_crypto_accel.cc 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284816 4 -rw-r--r-- 1 ubuntu ubuntu 872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/qat_crypto_plugin.cc 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284815 4 -rw-r--r-- 1 ubuntu ubuntu 1825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/qat_crypto_accel.h 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284819 8 -rw-r--r-- 1 ubuntu ubuntu 6361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/qcccrypto.h 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 284818 20 -rw-r--r-- 1 ubuntu ubuntu 19881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crypto/qat/qcccrypto.cc 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 283703 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_release 2024-03-27T21:32:59.120 INFO:teuthology.orchestra.run.smithi063.stdout: 286497 8 -rw-r--r-- 1 ubuntu ubuntu 7206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/perf_histogram.h 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 284820 4 -rwxr-xr-x 1 ubuntu ubuntu 1965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cstart.sh 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283698 12 -rw-r--r-- 1 ubuntu ubuntu 10720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_fuse.cc 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283405 4 -rw-r--r-- 1 ubuntu ubuntu 1251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-osd-prestart.sh 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283409 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283667 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283668 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283669 4 -rw-r--r-- 1 ubuntu ubuntu 90 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/CMakeLists.txt 2024-03-27T21:32:59.121 INFO:teuthology.orchestra.run.smithi063.stdout: 283670 4 -rw-r--r-- 1 ubuntu ubuntu 1513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/LICENSE 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283672 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283676 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283678 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/zfs 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283681 4 -rw-r--r-- 1 ubuntu ubuntu 890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/zfs/main.py 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283683 4 -rw-r--r-- 1 ubuntu ubuntu 871 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/zfs/zap.py 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283682 4 -rw-r--r-- 1 ubuntu ubuntu 581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/zfs/prepare.py 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283679 4 -rwxr-xr-x 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/zfs/__init__.py 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283680 4 -rw-r--r-- 1 ubuntu ubuntu 1363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/zfs/inventory.py 2024-03-27T21:32:59.122 INFO:teuthology.orchestra.run.smithi063.stdout: 283677 4 -rwxr-xr-x 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/devices/__init__.py 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283687 8 -rwxr-xr-x 1 ubuntu ubuntu 5044 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/zfs.py 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283684 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/util 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283685 4 -rw-r--r-- 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/util/__init__.py 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283686 4 -rw-r--r-- 1 ubuntu ubuntu 3995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/util/disk.py 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283673 4 -rwxr-xr-x 1 ubuntu ubuntu 281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/__init__.py 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283674 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/api 2024-03-27T21:32:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 283675 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/ceph_volume_zfs/api/__init__.py 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283690 4 -rw-r--r-- 1 ubuntu ubuntu 276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/tox.ini 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283671 4 -rw-r--r-- 1 ubuntu ubuntu 174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/MANIFEST.in 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283688 4 -rw-r--r-- 1 ubuntu ubuntu 65 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/requirements_dev.txt 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283689 4 -rw-r--r-- 1 ubuntu ubuntu 1330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/plugin/zfs/setup.py 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283692 4 -rw-r--r-- 1 ubuntu ubuntu 258 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/shell_tox.ini 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283411 4 -rw-r--r-- 1 ubuntu ubuntu 1033 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/CMakeLists.txt 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283694 4 -rwxr-xr-x 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/tox_install_command.sh 2024-03-27T21:32:59.124 INFO:teuthology.orchestra.run.smithi063.stdout: 283693 4 -rw-r--r-- 1 ubuntu ubuntu 499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/tox.ini 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283412 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/MANIFEST.in 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283413 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283466 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283647 8 -rw-r--r-- 1 ubuntu ubuntu 4519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/test_terminal.py 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283470 12 -rw-r--r-- 1 ubuntu ubuntu 10342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/conftest.py 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283471 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283473 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm 2024-03-27T21:32:59.125 INFO:teuthology.orchestra.run.smithi063.stdout: 283481 116 -rw-r--r-- 1 ubuntu ubuntu 116248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_migrate.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283478 4 -rw-r--r-- 1 ubuntu ubuntu 595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_create.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283482 8 -rw-r--r-- 1 ubuntu ubuntu 6360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_prepare.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283477 4 -rw-r--r-- 1 ubuntu ubuntu 192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_common.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283476 16 -rw-r--r-- 1 ubuntu ubuntu 16322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_batch.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283484 12 -rw-r--r-- 1 ubuntu ubuntu 10275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_zap.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283480 16 -rw-r--r-- 1 ubuntu ubuntu 15261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_listing.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283483 4 -rw-r--r-- 1 ubuntu ubuntu 1543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_trigger.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283474 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/__init__.py 2024-03-27T21:32:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: 283479 4 -rw-r--r-- 1 ubuntu ubuntu 2512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_deactivate.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283475 16 -rw-r--r-- 1 ubuntu ubuntu 13393 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/lvm/test_activate.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283493 4 -rw-r--r-- 1 ubuntu ubuntu 1350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/test_zap.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283489 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/simple 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283492 4 -rw-r--r-- 1 ubuntu ubuntu 1546 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/simple/test_trigger.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283490 8 -rw-r--r-- 1 ubuntu ubuntu 7905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/simple/test_activate.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283491 4 -rw-r--r-- 1 ubuntu ubuntu 2691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/simple/test_scan.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283472 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/__init__.py 2024-03-27T21:32:59.127 INFO:teuthology.orchestra.run.smithi063.stdout: 283485 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/raw 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283488 8 -rw-r--r-- 1 ubuntu ubuntu 4558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/raw/test_prepare.py 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283487 12 -rw-r--r-- 1 ubuntu ubuntu 10354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/raw/test_list.py 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283486 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/devices/raw/__init__.py 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283494 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283590 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/playbooks 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283591 8 -rw-r--r-- 1 ubuntu ubuntu 4353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/playbooks/deploy.yml 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283496 4 -rw-r--r-- 1 ubuntu ubuntu 1061 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/README.md 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283632 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/tests 2024-03-27T21:32:59.128 INFO:teuthology.orchestra.run.smithi063.stdout: 283634 4 -rw-r--r-- 1 ubuntu ubuntu 3983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/tests/conftest.py 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283635 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/tests/osd 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283637 4 -rw-r--r-- 1 ubuntu ubuntu 2609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/tests/osd/test_osds.py 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283636 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/tests/osd/__init__.py 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283633 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/tests/__init__.py 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283567 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283586 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/playbooks 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283587 4 -rw-r--r-- 1 ubuntu ubuntu 487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/playbooks/setup_partitions.yml 2024-03-27T21:32:59.129 INFO:teuthology.orchestra.run.smithi063.stdout: 283588 8 -rw-r--r-- 1 ubuntu ubuntu 4367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/playbooks/test_bluestore.yml 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283568 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283569 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283570 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283576 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/test.yml -> ../../../playbooks/test_bluestore.yml 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283577 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/group_vars 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283573 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/group_vars/all -> ../../../../../group_vars/bluestore_lvm 2024-03-27T21:32:59.130 INFO:teuthology.orchestra.run.smithi063.stdout: 283575 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/setup.yml -> ../../../playbooks/setup_partitions.yml 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283571 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283574 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/create/hosts 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283578 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283584 4 -rw-r--r-- 1 ubuntu ubuntu 3158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/test.yml 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283585 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283580 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/group_vars 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283581 0 lrwxrwxrwx 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/group_vars/all -> ../../../../../group_vars/bluestore_lvm_dmcrypt 2024-03-27T21:32:59.131 INFO:teuthology.orchestra.run.smithi063.stdout: 283583 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/setup.yml -> ../../../playbooks/setup_partitions.yml 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283579 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283582 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/centos8/bluestore/dmcrypt/hosts 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283589 4 -rw-r--r-- 1 ubuntu ubuntu 3262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/lvm/tox.ini 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283638 4 -rw-r--r-- 1 ubuntu ubuntu 2346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/vagrant_variables.yml 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283498 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283555 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/playbooks 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283559 4 -rw-r--r-- 1 ubuntu ubuntu 2350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/playbooks/test_explicit.yml 2024-03-27T21:32:59.132 INFO:teuthology.orchestra.run.smithi063.stdout: 283558 4 -rw-r--r-- 1 ubuntu ubuntu 2145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/playbooks/test.yml 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283557 8 -rw-r--r-- 1 ubuntu ubuntu 5678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/playbooks/setup_mixed_type.yml 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283560 4 -rw-r--r-- 1 ubuntu ubuntu 755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/playbooks/test_zap.yml 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283556 4 -rw-r--r-- 1 ubuntu ubuntu 277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/playbooks/noop.yml 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283499 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283500 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283528 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283534 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/test.yml -> ../../../playbooks/test.yml 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283536 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.133 INFO:teuthology.orchestra.run.smithi063.stdout: 283530 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/group_vars 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283531 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/group_vars/all -> ../../../../../group_vars/bluestore 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283533 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/setup.yml -> ../../../playbooks/setup_mixed_type.yml 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283529 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283535 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/test_zap.yml -> ../../../playbooks/test_zap.yml 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283532 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type/hosts 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283537 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt 2024-03-27T21:32:59.134 INFO:teuthology.orchestra.run.smithi063.stdout: 283543 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/test.yml -> ../../../playbooks/test.yml 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283545 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283539 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/group_vars 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283540 0 lrwxrwxrwx 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/group_vars/all -> ../../../../../group_vars/bluestore_single 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283542 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/setup.yml -> ../../../playbooks/noop.yml 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283538 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283544 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/test_zap.yml -> ../../../playbooks/test_zap.yml 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283541 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type-dmcrypt/hosts 2024-03-27T21:32:59.135 INFO:teuthology.orchestra.run.smithi063.stdout: 283510 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283516 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/test.yml -> ../../../playbooks/test.yml 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283518 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283512 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/group_vars 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283513 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/group_vars/all -> ../../../../../group_vars/bluestore 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283515 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/setup.yml -> ../../../playbooks/setup_mixed_type.yml 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283511 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283517 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/test_zap.yml -> ../../../playbooks/test_zap.yml 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283514 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt/hosts 2024-03-27T21:32:59.136 INFO:teuthology.orchestra.run.smithi063.stdout: 283519 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283525 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/test.yml -> ../../../playbooks/test_explicit.yml 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283527 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/group_vars 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283522 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/group_vars/all -> ../../../../../group_vars/bluestore 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283524 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/setup.yml -> ../../../playbooks/setup_mixed_type.yml 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283520 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283526 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/test_zap.yml -> ../../../playbooks/test_zap.yml 2024-03-27T21:32:59.137 INFO:teuthology.orchestra.run.smithi063.stdout: 283523 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-explicit/hosts 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283546 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283552 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/test.yml -> ../../../playbooks/test.yml 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283554 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283548 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/group_vars 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283549 0 lrwxrwxrwx 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/group_vars/all -> ../../../../../group_vars/bluestore_single 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283551 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/setup.yml -> ../../../playbooks/noop.yml 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283547 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283553 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/test_zap.yml -> ../../../playbooks/test_zap.yml 2024-03-27T21:32:59.138 INFO:teuthology.orchestra.run.smithi063.stdout: 283550 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/single-type/hosts 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283501 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283507 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/test.yml -> ../../../playbooks/test_explicit.yml 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283509 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/vagrant_variables.yml -> ../../../../vagrant_variables.yml 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283503 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/group_vars 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283504 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/group_vars/all -> ../../../../../group_vars/bluestore 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283506 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/setup.yml -> ../../../playbooks/setup_mixed_type.yml 2024-03-27T21:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout: 283502 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283508 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/test_zap.yml -> ../../../playbooks/test_zap.yml 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283505 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/centos8/bluestore/mixed-type-dmcrypt-explicit/hosts 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283561 4 -rw-r--r-- 1 ubuntu ubuntu 3499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/batch/tox.ini 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283562 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/group_vars 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283563 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/group_vars/bluestore 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283565 4 -rw-r--r-- 1 ubuntu ubuntu 732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/group_vars/bluestore_lvm_dmcrypt 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283566 4 -rw-r--r-- 1 ubuntu ubuntu 604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/group_vars/bluestore_single 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283564 4 -rw-r--r-- 1 ubuntu ubuntu 681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/group_vars/bluestore_lvm 2024-03-27T21:32:59.140 INFO:teuthology.orchestra.run.smithi063.stdout: 283592 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/scripts 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283596 4 -rw-r--r-- 1 ubuntu ubuntu 593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/scripts/vagrant_reload.sh 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283593 4 -rw-r--r-- 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/scripts/generate_ssh_config.sh 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283597 4 -rw-r--r-- 1 ubuntu ubuntu 200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/scripts/vagrant_up.sh 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283595 4 -rw-r--r-- 1 ubuntu ubuntu 911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/scripts/test_unicode.sh 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283594 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/scripts/output.py 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283598 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283599 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7 2024-03-27T21:32:59.141 INFO:teuthology.orchestra.run.smithi063.stdout: 283600 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283611 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283619 4 -rw-r--r-- 1 ubuntu ubuntu 352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/test.yml 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283620 4 -rw-r--r-- 1 ubuntu ubuntu 2607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/vagrant_variables.yml 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/group_vars 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283614 4 -rw-r--r-- 1 ubuntu ubuntu 488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/group_vars/all 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283612 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/host_vars 2024-03-27T21:32:59.142 INFO:teuthology.orchestra.run.smithi063.stdout: 283617 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/host_vars/osd1.yml 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283616 4 -rw-r--r-- 1 ubuntu ubuntu 94 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/host_vars/osd0.yml 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283618 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-luks/hosts 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283621 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283629 4 -rw-r--r-- 1 ubuntu ubuntu 762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/test.yml 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283630 4 -rw-r--r-- 1 ubuntu ubuntu 2607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/vagrant_variables.yml 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/group_vars 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283624 4 -rw-r--r-- 1 ubuntu ubuntu 489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/group_vars/all 2024-03-27T21:32:59.143 INFO:teuthology.orchestra.run.smithi063.stdout: 283622 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/host_vars 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283627 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/host_vars/osd1.yml 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283626 4 -rw-r--r-- 1 ubuntu ubuntu 94 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/host_vars/osd0.yml 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283628 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/dmcrypt-plain/hosts 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283601 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283609 4 -rw-r--r-- 1 ubuntu ubuntu 762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/test.yml 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283610 4 -rw-r--r-- 1 ubuntu ubuntu 2607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/vagrant_variables.yml 2024-03-27T21:32:59.144 INFO:teuthology.orchestra.run.smithi063.stdout: 283603 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/group_vars 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283604 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/group_vars/all 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283602 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/Vagrantfile -> ../../../../Vagrantfile 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/host_vars 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283607 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/host_vars/osd1.yml 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283606 4 -rw-r--r-- 1 ubuntu ubuntu 94 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/host_vars/osd0.yml 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283608 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/centos7/bluestore/activate/hosts 2024-03-27T21:32:59.145 INFO:teuthology.orchestra.run.smithi063.stdout: 283631 4 -rw-r--r-- 1 ubuntu ubuntu 2587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/simple/tox.ini 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283497 12 -rw-r--r-- 1 ubuntu ubuntu 12215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/Vagrantfile 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283495 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/functional/.gitignore 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283643 4 -rw-r--r-- 1 ubuntu ubuntu 2487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/test_decorators.py 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/systemd 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283641 4 -rw-r--r-- 1 ubuntu ubuntu 765 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/systemd/test_systemctl.py 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283640 4 -rw-r--r-- 1 ubuntu ubuntu 1377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/systemd/test_main.py 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283642 4 -rw-r--r-- 1 ubuntu ubuntu 3819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/test_configuration.py 2024-03-27T21:32:59.146 INFO:teuthology.orchestra.run.smithi063.stdout: 283645 4 -rw-r--r-- 1 ubuntu ubuntu 2823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/test_main.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283648 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283650 32 -rw-r--r-- 1 ubuntu ubuntu 32026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_device.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283653 12 -rw-r--r-- 1 ubuntu ubuntu 11024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_prepare.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283649 16 -rw-r--r-- 1 ubuntu ubuntu 14940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_arg_validators.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283655 4 -rw-r--r-- 1 ubuntu ubuntu 3642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_util.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283654 16 -rw-r--r-- 1 ubuntu ubuntu 12909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_system.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283652 8 -rw-r--r-- 1 ubuntu ubuntu 4386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_encryption.py 2024-03-27T21:32:59.147 INFO:teuthology.orchestra.run.smithi063.stdout: 283651 24 -rw-r--r-- 1 ubuntu ubuntu 20506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/util/test_disk.py 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283467 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/__init__.py 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283646 4 -rw-r--r-- 1 ubuntu ubuntu 3292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/test_process.py 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/api 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283469 36 -rw-r--r-- 1 ubuntu ubuntu 35822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/api/test_lvm.py 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283644 12 -rw-r--r-- 1 ubuntu ubuntu 8545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/tests/test_inventory.py 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283451 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/drive_group 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283453 4 -rw-r--r-- 1 ubuntu ubuntu 3197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/drive_group/main.py 2024-03-27T21:32:59.148 INFO:teuthology.orchestra.run.smithi063.stdout: 283452 4 -rw-r--r-- 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/drive_group/__init__.py 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283459 8 -rw-r--r-- 1 ubuntu ubuntu 6471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/main.py 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283423 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283425 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283430 4 -rw-r--r-- 1 ubuntu ubuntu 2925 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/create.py 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283433 4 -rw-r--r-- 1 ubuntu ubuntu 1409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/main.py 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283436 4 -rw-r--r-- 1 ubuntu ubuntu 2174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/trigger.py 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283428 24 -rw-r--r-- 1 ubuntu ubuntu 23244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/batch.py 2024-03-27T21:32:59.149 INFO:teuthology.orchestra.run.smithi063.stdout: 283431 4 -rw-r--r-- 1 ubuntu ubuntu 2751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/deactivate.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283427 12 -rw-r--r-- 1 ubuntu ubuntu 11116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/activate.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283437 16 -rw-r--r-- 1 ubuntu ubuntu 14561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/zap.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283429 8 -rw-r--r-- 1 ubuntu ubuntu 5310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/common.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283434 28 -rw-r--r-- 1 ubuntu ubuntu 27903 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/migrate.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283435 16 -rw-r--r-- 1 ubuntu ubuntu 12778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/prepare.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283426 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/__init__.py 2024-03-27T21:32:59.150 INFO:teuthology.orchestra.run.smithi063.stdout: 283432 8 -rw-r--r-- 1 ubuntu ubuntu 7286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/lvm/listing.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283445 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/simple 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283448 4 -rw-r--r-- 1 ubuntu ubuntu 1116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/simple/main.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283450 4 -rw-r--r-- 1 ubuntu ubuntu 2202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/simple/trigger.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283447 12 -rw-r--r-- 1 ubuntu ubuntu 11830 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/simple/activate.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283449 16 -rw-r--r-- 1 ubuntu ubuntu 15700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/simple/scan.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283446 4 -rw-r--r-- 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/simple/__init__.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283424 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/__init__.py 2024-03-27T21:32:59.151 INFO:teuthology.orchestra.run.smithi063.stdout: 283438 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283443 4 -rw-r--r-- 1 ubuntu ubuntu 1069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw/main.py 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283442 8 -rw-r--r-- 1 ubuntu ubuntu 7259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw/list.py 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283440 8 -rw-r--r-- 1 ubuntu ubuntu 5575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw/activate.py 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283441 4 -rw-r--r-- 1 ubuntu ubuntu 1694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw/common.py 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283444 8 -rw-r--r-- 1 ubuntu ubuntu 5797 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw/prepare.py 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283439 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/devices/raw/__init__.py 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/systemd 2024-03-27T21:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 283463 4 -rw-r--r-- 1 ubuntu ubuntu 3566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/systemd/main.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283464 4 -rw-r--r-- 1 ubuntu ubuntu 2306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/systemd/systemctl.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283462 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/systemd/__init__.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283460 12 -rw-r--r-- 1 ubuntu ubuntu 8463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/process.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283656 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283658 12 -rw-r--r-- 1 ubuntu ubuntu 9853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/arg_validators.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283660 28 -rw-r--r-- 1 ubuntu ubuntu 25742 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/device.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283662 12 -rw-r--r-- 1 ubuntu ubuntu 11095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/encryption.py 2024-03-27T21:32:59.153 INFO:teuthology.orchestra.run.smithi063.stdout: 283664 16 -rw-r--r-- 1 ubuntu ubuntu 15676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/prepare.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283657 4 -rw-r--r-- 1 ubuntu ubuntu 3072 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/__init__.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283665 16 -rw-r--r-- 1 ubuntu ubuntu 13375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/system.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283661 32 -rw-r--r-- 1 ubuntu ubuntu 31039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/disk.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283659 4 -rw-r--r-- 1 ubuntu ubuntu 2743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/constants.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283663 8 -rw-r--r-- 1 ubuntu ubuntu 6866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/lsmdisk.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283666 4 -rw-r--r-- 1 ubuntu ubuntu 881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/util/templates.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283414 4 -rw-r--r-- 1 ubuntu ubuntu 681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/__init__.py 2024-03-27T21:32:59.154 INFO:teuthology.orchestra.run.smithi063.stdout: 283458 4 -rw-r--r-- 1 ubuntu ubuntu 1718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/log.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283455 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/inventory 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283457 4 -rw-r--r-- 1 ubuntu ubuntu 2560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/inventory/main.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283456 4 -rw-r--r-- 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/inventory/__init__.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283465 8 -rw-r--r-- 1 ubuntu ubuntu 5516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/terminal.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283422 4 -rw-r--r-- 1 ubuntu ubuntu 2535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/decorators.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283415 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/activate 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283417 4 -rw-r--r-- 1 ubuntu ubuntu 2588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/activate/main.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283416 4 -rw-r--r-- 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/activate/__init__.py 2024-03-27T21:32:59.155 INFO:teuthology.orchestra.run.smithi063.stdout: 283421 12 -rw-r--r-- 1 ubuntu ubuntu 8831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/configuration.py 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 283454 4 -rw-r--r-- 1 ubuntu ubuntu 1616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/exceptions.py 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 283418 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/api 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 283420 40 -rw-r--r-- 1 ubuntu ubuntu 40881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/api/lvm.py 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 283419 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/ceph_volume/api/__init__.py 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 283410 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/.gitignore 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 283691 4 -rw-r--r-- 1 ubuntu ubuntu 1387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-volume/setup.py 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 286510 4 -rwxr-xr-x 1 ubuntu ubuntu 1516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ps-ceph.pl 2024-03-27T21:32:59.156 INFO:teuthology.orchestra.run.smithi063.stdout: 289648 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/seastar 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 283291 8 -rw-r--r-- 1 ubuntu ubuntu 4281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/SimpleRADOSStriper.h 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 286191 4 -rwxr-xr-x 1 ubuntu ubuntu 1543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mrgw.sh 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 285183 28 -rw-r--r-- 1 ubuntu ubuntu 27917 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libcephsqlite.cc 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 283408 4 -rwxr-xr-x 1 ubuntu ubuntu 400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-run 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 286299 4 -rwxr-xr-x 1 ubuntu ubuntu 1066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/nasm-wrapper 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 291443 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/zstd 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 291440 4 -rwxr-xr-x 1 ubuntu ubuntu 437 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/vnewosd.sh 2024-03-27T21:32:59.157 INFO:teuthology.orchestra.run.smithi063.stdout: 283385 4 -rwxr-xr-x 1 ubuntu ubuntu 1478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-clsinfo 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284389 4 drwxr-xr-x 12 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284451 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/mgr 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284453 4 -rw-r--r-- 1 ubuntu ubuntu 2006 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/mgr/client.h 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284452 8 -rw-r--r-- 1 ubuntu ubuntu 5536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/mgr/client.cc 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284448 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/crush 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284449 8 -rw-r--r-- 1 ubuntu ubuntu 5942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/crush/CrushLocation.cc 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284450 4 -rw-r--r-- 1 ubuntu ubuntu 884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/crush/CrushLocation.h 2024-03-27T21:32:59.158 INFO:teuthology.orchestra.run.smithi063.stdout: 284390 8 -rw-r--r-- 1 ubuntu ubuntu 7945 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/CMakeLists.txt 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284454 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/mon 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284456 8 -rw-r--r-- 1 ubuntu ubuntu 6818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/mon/MonClient.h 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284455 40 -rw-r--r-- 1 ubuntu ubuntu 36926 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/mon/MonClient.cc 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284391 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284392 4 -rw-r--r-- 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/CMakeLists.txt 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284394 8 -rw-r--r-- 1 ubuntu ubuntu 5795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/admin_socket.h 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284393 20 -rw-r--r-- 1 ubuntu ubuntu 18398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/admin_socket.cc 2024-03-27T21:32:59.159 INFO:teuthology.orchestra.run.smithi063.stdout: 284398 4 -rw-r--r-- 1 ubuntu ubuntu 271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/pg_commands.h 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284397 8 -rw-r--r-- 1 ubuntu ubuntu 6796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/pg_commands.cc 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284396 4 -rw-r--r-- 1 ubuntu ubuntu 664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/osd_admin.h 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284395 20 -rw-r--r-- 1 ubuntu ubuntu 19362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/admin/osd_admin.cc 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284480 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284502 8 -rw-r--r-- 1 ubuntu ubuntu 6141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/futurized_store.h 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284501 4 -rw-r--r-- 1 ubuntu ubuntu 971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/futurized_store.cc 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284481 4 -rw-r--r-- 1 ubuntu ubuntu 357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/CMakeLists.txt 2024-03-27T21:32:59.160 INFO:teuthology.orchestra.run.smithi063.stdout: 284482 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284491 8 -rw-r--r-- 1 ubuntu ubuntu 5384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/thread_pool.h 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284483 4 -rw-r--r-- 1 ubuntu ubuntu 3256 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/CMakeLists.txt 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284485 4 -rw-r--r-- 1 ubuntu ubuntu 831 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/alien_log.cc 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284489 4 -rw-r--r-- 1 ubuntu ubuntu 2219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/semaphore.h 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284484 4 -rw-r--r-- 1 ubuntu ubuntu 1233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/alien_collection.h 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284487 20 -rw-r--r-- 1 ubuntu ubuntu 18995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/alien_store.cc 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284486 4 -rw-r--r-- 1 ubuntu ubuntu 565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/alien_log.h 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284490 4 -rw-r--r-- 1 ubuntu ubuntu 2520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/thread_pool.cc 2024-03-27T21:32:59.161 INFO:teuthology.orchestra.run.smithi063.stdout: 284488 8 -rw-r--r-- 1 ubuntu ubuntu 4695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/alienstore/alien_store.h 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284503 4 drwxr-xr-x 11 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284512 4 -rw-r--r-- 1 ubuntu ubuntu 470 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref_manager.cc 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284536 4 -rw-r--r-- 1 ubuntu ubuntu 628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal.cc 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284535 4 -rw-r--r-- 1 ubuntu ubuntu 997 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/extentmap_manager.cc 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284638 8 -rw-r--r-- 1 ubuntu ubuntu 6414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager.h 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284651 28 -rw-r--r-- 1 ubuntu ubuntu 28245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/transaction_manager.cc 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284632 4 -rw-r--r-- 1 ubuntu ubuntu 3419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/root_block.h 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284571 4 -rw-r--r-- 1 ubuntu ubuntu 389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode.cc 2024-03-27T21:32:59.162 INFO:teuthology.orchestra.run.smithi063.stdout: 284646 8 -rw-r--r-- 1 ubuntu ubuntu 5700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager_group.cc 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284630 4 -rw-r--r-- 1 ubuntu ubuntu 2932 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/record_scanner.h 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284560 4 -rw-r--r-- 1 ubuntu ubuntu 1225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager.cc 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284504 4 -rw-r--r-- 1 ubuntu ubuntu 2410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/CMakeLists.txt 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284537 4 -rw-r--r-- 1 ubuntu ubuntu 3290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal.h 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284521 56 -rw-r--r-- 1 ubuntu ubuntu 54312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/cache.h 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284532 8 -rw-r--r-- 1 ubuntu ubuntu 4399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/device.h 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284549 4 -rw-r--r-- 1 ubuntu ubuntu 878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager.cc 2024-03-27T21:32:59.163 INFO:teuthology.orchestra.run.smithi063.stdout: 284647 8 -rw-r--r-- 1 ubuntu ubuntu 4674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager_group.h 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284636 64 -rw-r--r-- 1 ubuntu ubuntu 64665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/seastore_types.h 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284507 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284509 4 -rw-r--r-- 1 ubuntu ubuntu 3877 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref/backref_tree_node.h 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284508 4 -rw-r--r-- 1 ubuntu ubuntu 416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref/backref_tree_node.cc 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284511 4 -rw-r--r-- 1 ubuntu ubuntu 2888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref/btree_backref_manager.h 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284510 20 -rw-r--r-- 1 ubuntu ubuntu 18977 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref/btree_backref_manager.cc 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284561 8 -rw-r--r-- 1 ubuntu ubuntu 6721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager.h 2024-03-27T21:32:59.164 INFO:teuthology.orchestra.run.smithi063.stdout: 284639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284641 8 -rw-r--r-- 1 ubuntu ubuntu 6606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager/block.h 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284642 8 -rw-r--r-- 1 ubuntu ubuntu 8041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager/ephemeral.cc 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284643 8 -rw-r--r-- 1 ubuntu ubuntu 4354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager/ephemeral.h 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284640 28 -rw-r--r-- 1 ubuntu ubuntu 24720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager/block.cc 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284645 8 -rw-r--r-- 1 ubuntu ubuntu 6464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager/zbd.h 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284644 24 -rw-r--r-- 1 ubuntu ubuntu 22318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager/zbd.cc 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284520 68 -rw-r--r-- 1 ubuntu ubuntu 69616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/cache.cc 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284616 4 -rw-r--r-- 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager.cc 2024-03-27T21:32:59.165 INFO:teuthology.orchestra.run.smithi063.stdout: 284618 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284621 8 -rw-r--r-- 1 ubuntu ubuntu 6307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/block_rb_manager.cc 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284625 12 -rw-r--r-- 1 ubuntu ubuntu 10069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/nvme_block_device.h 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284622 8 -rw-r--r-- 1 ubuntu ubuntu 4251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/block_rb_manager.h 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284626 8 -rw-r--r-- 1 ubuntu ubuntu 7657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/rbm_device.cc 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284624 12 -rw-r--r-- 1 ubuntu ubuntu 9555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/nvme_block_device.cc 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284619 8 -rw-r--r-- 1 ubuntu ubuntu 7604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/avlallocator.cc 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284620 8 -rw-r--r-- 1 ubuntu ubuntu 4543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/avlallocator.h 2024-03-27T21:32:59.166 INFO:teuthology.orchestra.run.smithi063.stdout: 284627 8 -rw-r--r-- 1 ubuntu ubuntu 7167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/rbm_device.h 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284623 4 -rw-r--r-- 1 ubuntu ubuntu 2245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager/extent_allocator.h 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284629 12 -rw-r--r-- 1 ubuntu ubuntu 8542 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/record_scanner.cc 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284574 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284575 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284585 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284586 8 -rw-r--r-- 1 ubuntu ubuntu 6425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager/dummy.h 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284587 4 -rw-r--r-- 1 ubuntu ubuntu 3145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager/seastore.cc 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284588 8 -rw-r--r-- 1 ubuntu ubuntu 6878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager/seastore.h 2024-03-27T21:32:59.167 INFO:teuthology.orchestra.run.smithi063.stdout: 284589 4 -rw-r--r-- 1 ubuntu ubuntu 2300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager/test_replay.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284578 8 -rw-r--r-- 1 ubuntu ubuntu 6567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/fwd.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284582 24 -rw-r--r-- 1 ubuntu ubuntu 21818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_accessor.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284591 4 -rw-r--r-- 1 ubuntu ubuntu 2416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_impl.cc 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284609 4 -rw-r--r-- 1 ubuntu ubuntu 567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/super.cc 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284577 12 -rw-r--r-- 1 ubuntu ubuntu 8204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/fltree_onode_manager.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284581 4 -rw-r--r-- 1 ubuntu ubuntu 1368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_delta_recorder.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284592 12 -rw-r--r-- 1 ubuntu ubuntu 9486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_impl.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284590 4 -rw-r--r-- 1 ubuntu ubuntu 3146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_mutable.h 2024-03-27T21:32:59.168 INFO:teuthology.orchestra.run.smithi063.stdout: 284595 8 -rw-r--r-- 1 ubuntu ubuntu 4460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_types.h 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284613 8 -rw-r--r-- 1 ubuntu ubuntu 5066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/value.cc 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284611 12 -rw-r--r-- 1 ubuntu ubuntu 11585 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/tree.h 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284614 12 -rw-r--r-- 1 ubuntu ubuntu 9925 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/value.h 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284576 12 -rw-r--r-- 1 ubuntu ubuntu 8710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/fltree_onode_manager.cc 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284580 28 -rw-r--r-- 1 ubuntu ubuntu 24933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node.h 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284583 4 -rw-r--r-- 1 ubuntu ubuntu 885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager.cc 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284584 4 -rw-r--r-- 1 ubuntu ubuntu 3120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_manager.h 2024-03-27T21:32:59.169 INFO:teuthology.orchestra.run.smithi063.stdout: 284593 36 -rw-r--r-- 1 ubuntu ubuntu 35617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_layout.h 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284610 4 -rw-r--r-- 1 ubuntu ubuntu 3839 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/super.h 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284594 8 -rw-r--r-- 1 ubuntu ubuntu 4486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node_layout_replayable.h 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284579 80 -rw-r--r-- 1 ubuntu ubuntu 78153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/node.cc 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284596 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284597 8 -rw-r--r-- 1 ubuntu ubuntu 5914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/item_iterator_stage.cc 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284602 8 -rw-r--r-- 1 ubuntu ubuntu 8009 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/node_stage.h 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284607 12 -rw-r--r-- 1 ubuntu ubuntu 11770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/sub_items_stage.cc 2024-03-27T21:32:59.170 INFO:teuthology.orchestra.run.smithi063.stdout: 284601 16 -rw-r--r-- 1 ubuntu ubuntu 15824 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/node_stage.cc 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284599 4 -rw-r--r-- 1 ubuntu ubuntu 949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/key_layout.cc 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284603 8 -rw-r--r-- 1 ubuntu ubuntu 5268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/node_stage_layout.cc 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284600 28 -rw-r--r-- 1 ubuntu ubuntu 26592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/key_layout.h 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284605 80 -rw-r--r-- 1 ubuntu ubuntu 80714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/stage.h 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284598 8 -rw-r--r-- 1 ubuntu ubuntu 6505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/item_iterator_stage.h 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284604 16 -rw-r--r-- 1 ubuntu ubuntu 14889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/node_stage_layout.h 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284606 16 -rw-r--r-- 1 ubuntu ubuntu 12496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/stage_types.h 2024-03-27T21:32:59.171 INFO:teuthology.orchestra.run.smithi063.stdout: 284608 16 -rw-r--r-- 1 ubuntu ubuntu 12455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/stages/sub_items_stage.h 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284612 20 -rw-r--r-- 1 ubuntu ubuntu 17436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager/staged-fltree/tree_utils.h 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284550 8 -rw-r--r-- 1 ubuntu ubuntu 6488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager.h 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284633 68 -rw-r--r-- 1 ubuntu ubuntu 67588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/seastore.cc 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284634 16 -rw-r--r-- 1 ubuntu ubuntu 16035 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/seastore.h 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284522 8 -rw-r--r-- 1 ubuntu ubuntu 4999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/cached_extent.cc 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284513 8 -rw-r--r-- 1 ubuntu ubuntu 4445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/backref_manager.h 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284628 4 -rw-r--r-- 1 ubuntu ubuntu 1787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/randomblock_manager_group.h 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284649 4 -rw-r--r-- 1 ubuntu ubuntu 277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/transaction.cc 2024-03-27T21:32:59.172 INFO:teuthology.orchestra.run.smithi063.stdout: 284652 32 -rw-r--r-- 1 ubuntu ubuntu 30674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/transaction_manager.h 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284531 4 -rw-r--r-- 1 ubuntu ubuntu 1359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/device.cc 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284631 4 -rw-r--r-- 1 ubuntu ubuntu 992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/root_block.cc 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284650 20 -rw-r--r-- 1 ubuntu ubuntu 18849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/transaction.h 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284533 28 -rw-r--r-- 1 ubuntu ubuntu 27805 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/extent_placement_manager.cc 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284562 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284563 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284567 28 -rw-r--r-- 1 ubuntu ubuntu 26266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/omap_btree_node_impl.cc 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284570 44 -rw-r--r-- 1 ubuntu ubuntu 42173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/string_kv_node_layout.h 2024-03-27T21:32:59.173 INFO:teuthology.orchestra.run.smithi063.stdout: 284566 4 -rw-r--r-- 1 ubuntu ubuntu 3874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/omap_btree_node.h 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284569 8 -rw-r--r-- 1 ubuntu ubuntu 4373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/omap_types.h 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284565 4 -rw-r--r-- 1 ubuntu ubuntu 3082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/btree_omap_manager.h 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284564 12 -rw-r--r-- 1 ubuntu ubuntu 9408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/btree_omap_manager.cc 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284568 8 -rw-r--r-- 1 ubuntu ubuntu 7350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/omap_manager/btree/omap_btree_node_impl.h 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284538 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284539 16 -rw-r--r-- 1 ubuntu ubuntu 13341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/circular_bounded_journal.cc 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284548 4 -rw-r--r-- 1 ubuntu ubuntu 3038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/segmented_journal.h 2024-03-27T21:32:59.174 INFO:teuthology.orchestra.run.smithi063.stdout: 284544 12 -rw-r--r-- 1 ubuntu ubuntu 9903 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/record_submitter.h 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284543 20 -rw-r--r-- 1 ubuntu ubuntu 17121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/record_submitter.cc 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284546 4 -rw-r--r-- 1 ubuntu ubuntu 3545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/segment_allocator.h 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284542 8 -rw-r--r-- 1 ubuntu ubuntu 7240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/circular_journal_space.h 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284541 8 -rw-r--r-- 1 ubuntu ubuntu 7295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/circular_journal_space.cc 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284540 8 -rw-r--r-- 1 ubuntu ubuntu 6157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/circular_bounded_journal.h 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284545 12 -rw-r--r-- 1 ubuntu ubuntu 8525 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/segment_allocator.cc 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284547 16 -rw-r--r-- 1 ubuntu ubuntu 14479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/journal/segmented_journal.cc 2024-03-27T21:32:59.175 INFO:teuthology.orchestra.run.smithi063.stdout: 284557 4 -rw-r--r-- 1 ubuntu ubuntu 1259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/logging.h 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284573 4 -rw-r--r-- 1 ubuntu ubuntu 2486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode_manager.h 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/btree 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284518 4 -rw-r--r-- 1 ubuntu ubuntu 436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/btree/fixed_kv_node.cc 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284519 40 -rw-r--r-- 1 ubuntu ubuntu 38909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/btree/fixed_kv_node.h 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284515 4 -rw-r--r-- 1 ubuntu ubuntu 1089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/btree/btree_range_pin.cc 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284517 72 -rw-r--r-- 1 ubuntu ubuntu 69892 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/btree/fixed_kv_btree.h 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284516 8 -rw-r--r-- 1 ubuntu ubuntu 5040 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/btree/btree_range_pin.h 2024-03-27T21:32:59.176 INFO:teuthology.orchestra.run.smithi063.stdout: 284505 60 -rw-r--r-- 1 ubuntu ubuntu 58811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/async_cleaner.cc 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284551 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284552 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager/btree 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284553 24 -rw-r--r-- 1 ubuntu ubuntu 22091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager/btree/btree_lba_manager.cc 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284554 12 -rw-r--r-- 1 ubuntu ubuntu 11590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager/btree/btree_lba_manager.h 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284555 4 -rw-r--r-- 1 ubuntu ubuntu 1474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager/btree/lba_btree_node.cc 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284556 12 -rw-r--r-- 1 ubuntu ubuntu 8679 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/lba_manager/btree/lba_btree_node.h 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284526 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284528 8 -rw-r--r-- 1 ubuntu ubuntu 5152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager/collection_flat_node.h 2024-03-27T21:32:59.177 INFO:teuthology.orchestra.run.smithi063.stdout: 284530 4 -rw-r--r-- 1 ubuntu ubuntu 1346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager/flat_collection_manager.h 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284527 4 -rw-r--r-- 1 ubuntu ubuntu 3070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager/collection_flat_node.cc 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284529 8 -rw-r--r-- 1 ubuntu ubuntu 4444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager/flat_collection_manager.cc 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284635 28 -rw-r--r-- 1 ubuntu ubuntu 25106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/seastore_types.cc 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284615 8 -rw-r--r-- 1 ubuntu ubuntu 5404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/ordering_handle.h 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284524 4 -rw-r--r-- 1 ubuntu ubuntu 494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager.cc 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284559 8 -rw-r--r-- 1 ubuntu ubuntu 5507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/object_data_handler.h 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284637 4 -rw-r--r-- 1 ubuntu ubuntu 2743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_manager.cc 2024-03-27T21:32:59.178 INFO:teuthology.orchestra.run.smithi063.stdout: 284534 32 -rw-r--r-- 1 ubuntu ubuntu 30423 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/extent_placement_manager.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284525 4 -rw-r--r-- 1 ubuntu ubuntu 2088 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/collection_manager.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284648 4 -rw-r--r-- 1 ubuntu ubuntu 1222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/segment_seq_allocator.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284617 8 -rw-r--r-- 1 ubuntu ubuntu 5690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/random_block_manager.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284572 4 -rw-r--r-- 1 ubuntu ubuntu 3052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/onode.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284523 40 -rw-r--r-- 1 ubuntu ubuntu 38985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/cached_extent.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284558 56 -rw-r--r-- 1 ubuntu ubuntu 55536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/object_data_handler.cc 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284506 48 -rw-r--r-- 1 ubuntu ubuntu 48576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/seastore/async_cleaner.h 2024-03-27T21:32:59.179 INFO:teuthology.orchestra.run.smithi063.stdout: 284500 4 -rw-r--r-- 1 ubuntu ubuntu 915 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/futurized_collection.h 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284492 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284494 4 -rw-r--r-- 1 ubuntu ubuntu 1537 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/cyan_collection.cc 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284493 4 -rw-r--r-- 1 ubuntu ubuntu 156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/CMakeLists.txt 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284497 4 -rw-r--r-- 1 ubuntu ubuntu 1198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/cyan_object.h 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284498 28 -rw-r--r-- 1 ubuntu ubuntu 26099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/cyan_store.cc 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284496 4 -rw-r--r-- 1 ubuntu ubuntu 1755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/cyan_object.cc 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284495 4 -rw-r--r-- 1 ubuntu ubuntu 1446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/cyan_collection.h 2024-03-27T21:32:59.180 INFO:teuthology.orchestra.run.smithi063.stdout: 284499 8 -rw-r--r-- 1 ubuntu ubuntu 6557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/os/cyanstore/cyan_store.h 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284757 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284761 8 -rw-r--r-- 1 ubuntu ubuntu 6016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/perf_staged_fltree.cc 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284762 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284765 8 -rw-r--r-- 1 ubuntu ubuntu 7101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/fs_driver.cc 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284764 4 -rw-r--r-- 1 ubuntu ubuntu 3328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/block_driver.h 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284769 4 -rw-r--r-- 1 ubuntu ubuntu 1513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/tm_driver.h 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284766 4 -rw-r--r-- 1 ubuntu ubuntu 1500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/fs_driver.h 2024-03-27T21:32:59.181 INFO:teuthology.orchestra.run.smithi063.stdout: 284763 4 -rw-r--r-- 1 ubuntu ubuntu 502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/block_driver.cc 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284768 8 -rw-r--r-- 1 ubuntu ubuntu 6162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/tm_driver.cc 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284767 16 -rw-r--r-- 1 ubuntu ubuntu 12641 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/store_nbd/store-nbd.cc 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284760 44 -rw-r--r-- 1 ubuntu ubuntu 44980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/perf_crimson_msgr.cc 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284758 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/CMakeLists.txt 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284759 8 -rw-r--r-- 1 ubuntu ubuntu 4761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/tools/perf_async_msgr.cc 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284653 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284732 16 -rw-r--r-- 1 ubuntu ubuntu 14999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_shard_manager.h 2024-03-27T21:32:59.182 INFO:teuthology.orchestra.run.smithi063.stdout: 284714 4 -rw-r--r-- 1 ubuntu ubuntu 2053 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osdmap_gate.h 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284720 60 -rw-r--r-- 1 ubuntu ubuntu 60941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_backend.cc 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284678 8 -rw-r--r-- 1 ubuntu ubuntu 8096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd.h 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284754 4 -rw-r--r-- 1 ubuntu ubuntu 2412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/stop_signal.h 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284681 4 -rw-r--r-- 1 ubuntu ubuntu 2258 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_meta.h 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284660 4 -rw-r--r-- 1 ubuntu ubuntu 1215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/ec_backend.h 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284668 16 -rw-r--r-- 1 ubuntu ubuntu 15070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/objclass.cc 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284735 8 -rw-r--r-- 1 ubuntu ubuntu 6345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/replicated_backend.cc 2024-03-27T21:32:59.183 INFO:teuthology.orchestra.run.smithi063.stdout: 284727 4 -rw-r--r-- 1 ubuntu ubuntu 516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_meta.h 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284654 4 -rw-r--r-- 1 ubuntu ubuntu 2238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/CMakeLists.txt 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284717 28 -rw-r--r-- 1 ubuntu ubuntu 25077 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg.h 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284721 16 -rw-r--r-- 1 ubuntu ubuntu 15522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_backend.h 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284725 4 -rw-r--r-- 1 ubuntu ubuntu 3926 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_map.h 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284726 4 -rw-r--r-- 1 ubuntu ubuntu 3325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_meta.cc 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284684 12 -rw-r--r-- 1 ubuntu ubuntu 11212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operation_external_tracking.h 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284685 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations 2024-03-27T21:32:59.184 INFO:teuthology.orchestra.run.smithi063.stdout: 284705 4 -rw-r--r-- 1 ubuntu ubuntu 1662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/recovery_subrequest.cc 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284703 4 -rw-r--r-- 1 ubuntu ubuntu 3711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/pg_advance_map.cc 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284710 8 -rw-r--r-- 1 ubuntu ubuntu 7637 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/scrub_events.h 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284698 4 -rw-r--r-- 1 ubuntu ubuntu 2192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/logmissing_request_reply.cc 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284694 8 -rw-r--r-- 1 ubuntu ubuntu 4361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/internal_client_request.cc 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284712 8 -rw-r--r-- 1 ubuntu ubuntu 6311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/snaptrim_event.h 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284699 4 -rw-r--r-- 1 ubuntu ubuntu 2694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/logmissing_request_reply.h 2024-03-27T21:32:59.185 INFO:teuthology.orchestra.run.smithi063.stdout: 284701 8 -rw-r--r-- 1 ubuntu ubuntu 6218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/peering_event.cc 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284709 16 -rw-r--r-- 1 ubuntu ubuntu 12739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/scrub_events.cc 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284686 8 -rw-r--r-- 1 ubuntu ubuntu 6043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/background_recovery.cc 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284696 4 -rw-r--r-- 1 ubuntu ubuntu 2710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/logmissing_request.cc 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284702 8 -rw-r--r-- 1 ubuntu ubuntu 5423 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/peering_event.h 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284688 16 -rw-r--r-- 1 ubuntu ubuntu 15374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/client_request.cc 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284707 4 -rw-r--r-- 1 ubuntu ubuntu 2577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/replicated_request.cc 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284704 4 -rw-r--r-- 1 ubuntu ubuntu 1325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/pg_advance_map.h 2024-03-27T21:32:59.186 INFO:teuthology.orchestra.run.smithi063.stdout: 284711 20 -rw-r--r-- 1 ubuntu ubuntu 16715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/snaptrim_event.cc 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284691 4 -rw-r--r-- 1 ubuntu ubuntu 703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/client_request_common.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284690 4 -rw-r--r-- 1 ubuntu ubuntu 3662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/client_request_common.cc 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284700 4 -rw-r--r-- 1 ubuntu ubuntu 714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/osdop_params.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284708 4 -rw-r--r-- 1 ubuntu ubuntu 2621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/replicated_request.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284695 4 -rw-r--r-- 1 ubuntu ubuntu 1855 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/internal_client_request.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284689 12 -rw-r--r-- 1 ubuntu ubuntu 9888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/client_request.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284687 4 -rw-r--r-- 1 ubuntu ubuntu 3950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/background_recovery.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284706 4 -rw-r--r-- 1 ubuntu ubuntu 2550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/recovery_subrequest.h 2024-03-27T21:32:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: 284692 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/common 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284693 4 -rw-r--r-- 1 ubuntu ubuntu 988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/common/pg_pipeline.h 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284697 4 -rw-r--r-- 1 ubuntu ubuntu 2758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operations/logmissing_request.h 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284665 12 -rw-r--r-- 1 ubuntu ubuntu 10334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/main.cc 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284680 8 -rw-r--r-- 1 ubuntu ubuntu 4318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_meta.cc 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284664 4 -rw-r--r-- 1 ubuntu ubuntu 863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/lsan_suppressions.cc 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284733 12 -rw-r--r-- 1 ubuntu ubuntu 10960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/recovery_backend.cc 2024-03-27T21:32:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 284736 4 -rw-r--r-- 1 ubuntu ubuntu 2173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/replicated_backend.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284719 4 -rw-r--r-- 1 ubuntu ubuntu 815 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_activation_blocker.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284679 4 -rw-r--r-- 1 ubuntu ubuntu 1047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_connection_priv.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284676 24 -rw-r--r-- 1 ubuntu ubuntu 20499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/ops_executer.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284663 16 -rw-r--r-- 1 ubuntu ubuntu 14078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/heartbeat.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284756 8 -rw-r--r-- 1 ubuntu ubuntu 7176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/watch.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284658 16 -rw-r--r-- 1 ubuntu ubuntu 12813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/backfill_state.h 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284671 12 -rw-r--r-- 1 ubuntu ubuntu 8825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/object_context_loader.cc 2024-03-27T21:32:59.189 INFO:teuthology.orchestra.run.smithi063.stdout: 284755 12 -rw-r--r-- 1 ubuntu ubuntu 10826 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/watch.cc 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284672 4 -rw-r--r-- 1 ubuntu ubuntu 2669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/object_context_loader.h 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284739 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scheduler 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284741 4 -rw-r--r-- 1 ubuntu ubuntu 3071 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scheduler/mclock_scheduler.h 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284743 4 -rw-r--r-- 1 ubuntu ubuntu 1891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scheduler/scheduler.h 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284740 8 -rw-r--r-- 1 ubuntu ubuntu 4857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scheduler/mclock_scheduler.cc 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284742 8 -rw-r--r-- 1 ubuntu ubuntu 5274 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scheduler/scheduler.cc 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284731 4 -rw-r--r-- 1 ubuntu ubuntu 3563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_shard_manager.cc 2024-03-27T21:32:59.190 INFO:teuthology.orchestra.run.smithi063.stdout: 284752 20 -rw-r--r-- 1 ubuntu ubuntu 18735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/shard_services.h 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284677 48 -rw-r--r-- 1 ubuntu ubuntu 47404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd.cc 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284724 12 -rw-r--r-- 1 ubuntu ubuntu 8977 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_map.cc 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284670 12 -rw-r--r-- 1 ubuntu ubuntu 8219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/object_context.h 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284713 4 -rw-r--r-- 1 ubuntu ubuntu 2578 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osdmap_gate.cc 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284734 8 -rw-r--r-- 1 ubuntu ubuntu 7147 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/recovery_backend.h 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284715 4 -rw-r--r-- 1 ubuntu ubuntu 743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osdmap_service.h 2024-03-27T21:32:59.191 INFO:teuthology.orchestra.run.smithi063.stdout: 284751 28 -rw-r--r-- 1 ubuntu ubuntu 28613 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/shard_services.cc 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284730 4 -rw-r--r-- 1 ubuntu ubuntu 1371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_recovery_listener.h 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284716 56 -rw-r--r-- 1 ubuntu ubuntu 53317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg.cc 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284728 24 -rw-r--r-- 1 ubuntu ubuntu 20584 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_recovery.cc 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284673 8 -rw-r--r-- 1 ubuntu ubuntu 6885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/object_metadata_helper.cc 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284753 4 -rw-r--r-- 1 ubuntu ubuntu 3658 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/state.h 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284661 4 -rw-r--r-- 1 ubuntu ubuntu 1000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/exceptions.h 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284675 52 -rw-r--r-- 1 ubuntu ubuntu 51993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/ops_executer.cc 2024-03-27T21:32:59.192 INFO:teuthology.orchestra.run.smithi063.stdout: 284738 8 -rw-r--r-- 1 ubuntu ubuntu 6329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/replicated_recovery_backend.h 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284737 52 -rw-r--r-- 1 ubuntu ubuntu 50218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/replicated_recovery_backend.cc 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284744 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284750 8 -rw-r--r-- 1 ubuntu ubuntu 5898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub/scrub_validator.h 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284749 16 -rw-r--r-- 1 ubuntu ubuntu 13855 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub/scrub_validator.cc 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284745 12 -rw-r--r-- 1 ubuntu ubuntu 8950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub/pg_scrubber.cc 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284746 4 -rw-r--r-- 1 ubuntu ubuntu 3858 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub/pg_scrubber.h 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284747 4 -rw-r--r-- 1 ubuntu ubuntu 2016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub/scrub_machine.cc 2024-03-27T21:32:59.193 INFO:teuthology.orchestra.run.smithi063.stdout: 284748 20 -rw-r--r-- 1 ubuntu ubuntu 18342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/scrub/scrub_machine.h 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284666 12 -rw-r--r-- 1 ubuntu ubuntu 8502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/main_config_bootstrap_helpers.cc 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284657 20 -rw-r--r-- 1 ubuntu ubuntu 20220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/backfill_state.cc 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284718 4 -rw-r--r-- 1 ubuntu ubuntu 821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_activation_blocker.cc 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284659 4 -rw-r--r-- 1 ubuntu ubuntu 1153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/ec_backend.cc 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284655 4 -rw-r--r-- 1 ubuntu ubuntu 298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/acked_peers.h 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284723 4 -rw-r--r-- 1 ubuntu ubuntu 1445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_interval_interrupt_condition.h 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284674 4 -rw-r--r-- 1 ubuntu ubuntu 613 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/object_metadata_helper.h 2024-03-27T21:32:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: 284656 4 -rw-r--r-- 1 ubuntu ubuntu 2311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/backfill_facades.h 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284669 4 -rw-r--r-- 1 ubuntu ubuntu 2260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/object_context.cc 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284729 4 -rw-r--r-- 1 ubuntu ubuntu 3796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_recovery.h 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284682 8 -rw-r--r-- 1 ubuntu ubuntu 7522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operation.cc 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284683 8 -rw-r--r-- 1 ubuntu ubuntu 8099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/osd_operation.h 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284722 4 -rw-r--r-- 1 ubuntu ubuntu 1253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/pg_interval_interrupt_condition.cc 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284662 24 -rw-r--r-- 1 ubuntu ubuntu 23237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/heartbeat.cc 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284667 4 -rw-r--r-- 1 ubuntu ubuntu 2214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/osd/main_config_bootstrap_helpers.h 2024-03-27T21:32:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: 284457 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284465 8 -rw-r--r-- 1 ubuntu ubuntu 6587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Interceptor.h 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284462 16 -rw-r--r-- 1 ubuntu ubuntu 13861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/FrameAssemblerV2.cc 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284475 8 -rw-r--r-- 1 ubuntu ubuntu 5289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/SocketMessenger.h 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284470 16 -rw-r--r-- 1 ubuntu ubuntu 15911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Socket.cc 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284474 16 -rw-r--r-- 1 ubuntu ubuntu 15763 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/SocketMessenger.cc 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284463 8 -rw-r--r-- 1 ubuntu ubuntu 6278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/FrameAssemblerV2.h 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284478 44 -rw-r--r-- 1 ubuntu ubuntu 44285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/io_handler.cc 2024-03-27T21:32:59.196 INFO:teuthology.orchestra.run.smithi063.stdout: 284473 8 -rw-r--r-- 1 ubuntu ubuntu 5732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/SocketConnection.h 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284476 4 -rw-r--r-- 1 ubuntu ubuntu 3054 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/chained_dispatchers.cc 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284460 4 -rw-r--r-- 1 ubuntu ubuntu 1363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Errors.cc 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284469 12 -rw-r--r-- 1 ubuntu ubuntu 9115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/ProtocolV2.h 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284466 4 -rw-r--r-- 1 ubuntu ubuntu 503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Messenger.cc 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284468 88 -rw-r--r-- 1 ubuntu ubuntu 89618 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/ProtocolV2.cc 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284467 4 -rw-r--r-- 1 ubuntu ubuntu 3456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Messenger.h 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284461 4 -rw-r--r-- 1 ubuntu ubuntu 1133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Errors.h 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284472 8 -rw-r--r-- 1 ubuntu ubuntu 5825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/SocketConnection.cc 2024-03-27T21:32:59.197 INFO:teuthology.orchestra.run.smithi063.stdout: 284479 16 -rw-r--r-- 1 ubuntu ubuntu 14879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/io_handler.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284477 4 -rw-r--r-- 1 ubuntu ubuntu 961 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/chained_dispatchers.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284464 4 -rw-r--r-- 1 ubuntu ubuntu 1583 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Fwd.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284471 8 -rw-r--r-- 1 ubuntu ubuntu 5090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Socket.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284459 4 -rw-r--r-- 1 ubuntu ubuntu 2331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Dispatcher.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284458 8 -rw-r--r-- 1 ubuntu ubuntu 4589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/net/Connection.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284399 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/auth 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284400 4 -rw-r--r-- 1 ubuntu ubuntu 1959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/auth/AuthClient.h 2024-03-27T21:32:59.198 INFO:teuthology.orchestra.run.smithi063.stdout: 284404 4 -rw-r--r-- 1 ubuntu ubuntu 420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/auth/KeyRing.h 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284403 4 -rw-r--r-- 1 ubuntu ubuntu 2455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/auth/KeyRing.cc 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284401 4 -rw-r--r-- 1 ubuntu ubuntu 1288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/auth/AuthServer.h 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284402 4 -rw-r--r-- 1 ubuntu ubuntu 2053 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/auth/DummyAuth.h 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284405 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284430 12 -rw-r--r-- 1 ubuntu ubuntu 10044 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/logclient.cc 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284427 8 -rw-r--r-- 1 ubuntu ubuntu 7380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/local_shared_foreign_ptr.h 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284416 4 -rw-r--r-- 1 ubuntu ubuntu 3003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/errorator-loop.h 2024-03-27T21:32:59.199 INFO:teuthology.orchestra.run.smithi063.stdout: 284419 8 -rw-r--r-- 1 ubuntu ubuntu 5453 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/fatal_signal.cc 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284440 4 -rw-r--r-- 1 ubuntu ubuntu 1107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/throttle.cc 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284417 52 -rw-r--r-- 1 ubuntu ubuntu 50680 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/errorator.h 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284409 4 -rw-r--r-- 1 ubuntu ubuntu 803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/buffer_io.h 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284433 24 -rw-r--r-- 1 ubuntu ubuntu 21198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/operation.h 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284437 4 -rw-r--r-- 1 ubuntu ubuntu 3782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/simple_lru.h 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284413 4 -rw-r--r-- 1 ubuntu ubuntu 3238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/config_proxy.cc 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284438 8 -rw-r--r-- 1 ubuntu ubuntu 5813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/smp_helpers.h 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284406 4 -rw-r--r-- 1 ubuntu ubuntu 2531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/assert.cc 2024-03-27T21:32:59.200 INFO:teuthology.orchestra.run.smithi063.stdout: 284411 4 -rw-r--r-- 1 ubuntu ubuntu 1651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/buffer_seastar.h 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284436 8 -rw-r--r-- 1 ubuntu ubuntu 5210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/shared_lru.h 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284421 20 -rw-r--r-- 1 ubuntu ubuntu 17059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/fixed_kv_node_layout.h 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284422 4 -rw-r--r-- 1 ubuntu ubuntu 1099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/formatter.cc 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284431 8 -rw-r--r-- 1 ubuntu ubuntu 6177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/logclient.h 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284442 4 -rw-r--r-- 1 ubuntu ubuntu 2583 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/tmap_helpers.cc 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284424 4 -rw-r--r-- 1 ubuntu ubuntu 1558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/gated.h 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284435 4 -rw-r--r-- 1 ubuntu ubuntu 1591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/perf_counters_collection.h 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284410 4 -rw-r--r-- 1 ubuntu ubuntu 3064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/buffer_seastar.cc 2024-03-27T21:32:59.201 INFO:teuthology.orchestra.run.smithi063.stdout: 284446 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/type_helpers.h 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284412 4 -rw-r--r-- 1 ubuntu ubuntu 1321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/condition_variable.h 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284444 8 -rw-r--r-- 1 ubuntu ubuntu 4250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/tri_mutex.cc 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284418 4 -rw-r--r-- 1 ubuntu ubuntu 1342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/exception.h 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284420 4 -rw-r--r-- 1 ubuntu ubuntu 461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/fatal_signal.h 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284425 60 -rw-r--r-- 1 ubuntu ubuntu 60013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/interruptible_future.h 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284432 4 -rw-r--r-- 1 ubuntu ubuntu 1703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/operation.cc 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284414 8 -rw-r--r-- 1 ubuntu ubuntu 8009 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/config_proxy.h 2024-03-27T21:32:59.202 INFO:teuthology.orchestra.run.smithi063.stdout: 284415 12 -rw-r--r-- 1 ubuntu ubuntu 9094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/coroutine.h 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284447 4 -rw-r--r-- 1 ubuntu ubuntu 1050 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/utility.h 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284434 4 -rw-r--r-- 1 ubuntu ubuntu 1129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/perf_counters_collection.cc 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284445 4 -rw-r--r-- 1 ubuntu ubuntu 3601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/tri_mutex.h 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284428 4 -rw-r--r-- 1 ubuntu ubuntu 532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/log.cc 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284443 4 -rw-r--r-- 1 ubuntu ubuntu 1186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/tmap_helpers.h 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284439 4 -rw-r--r-- 1 ubuntu ubuntu 1285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/subop_blocker.h 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284408 4 -rw-r--r-- 1 ubuntu ubuntu 1855 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/buffer_io.cc 2024-03-27T21:32:59.203 INFO:teuthology.orchestra.run.smithi063.stdout: 284423 4 -rw-r--r-- 1 ubuntu ubuntu 297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/formatter.h 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 284441 4 -rw-r--r-- 1 ubuntu ubuntu 1097 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/throttle.h 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 284407 4 -rw-r--r-- 1 ubuntu ubuntu 384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/auth_handler.h 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 284426 28 -rw-r--r-- 1 ubuntu ubuntu 26948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/layout.h 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 284429 8 -rw-r--r-- 1 ubuntu ubuntu 5863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/crimson/common/log.h 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 288991 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 288993 4 -rw-r--r-- 1 ubuntu ubuntu 145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/CMakeLists.txt 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 289030 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/requirements-lint.txt 2024-03-27T21:32:59.204 INFO:teuthology.orchestra.run.smithi063.stdout: 289033 4 -rw-r--r-- 1 ubuntu ubuntu 637 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/tox.ini 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 288994 4 -rw-r--r-- 1 ubuntu ubuntu 468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/README.rst 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289031 4 -rw-r--r-- 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/requirements.txt 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 288995 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289017 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289020 4 -rw-r--r-- 1 ubuntu ubuntu 3626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/factories.py 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289024 4 -rw-r--r-- 1 ubuntu ubuntu 1239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_hostspec.py 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289026 40 -rw-r--r-- 1 ubuntu ubuntu 38031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_service_spec.py 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289019 4 -rw-r--r-- 1 ubuntu ubuntu 3327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/c-v-inventory.json 2024-03-27T21:32:59.205 INFO:teuthology.orchestra.run.smithi063.stdout: 289022 24 -rw-r--r-- 1 ubuntu ubuntu 21500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_disk_selector.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289027 4 -rw-r--r-- 1 ubuntu ubuntu 2957 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_utils.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289021 4 -rw-r--r-- 1 ubuntu ubuntu 1744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_datetime.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289023 24 -rw-r--r-- 1 ubuntu ubuntu 21033 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_drive_group.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289018 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/__init__.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289028 4 -rw-r--r-- 1 ubuntu ubuntu 1359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/utils.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289025 4 -rw-r--r-- 1 ubuntu ubuntu 3427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/tests/test_inventory.py 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289012 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/rgw 2024-03-27T21:32:59.206 INFO:teuthology.orchestra.run.smithi063.stdout: 289014 4 -rw-r--r-- 1 ubuntu ubuntu 1898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/rgw/diff.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 289016 8 -rw-r--r-- 1 ubuntu ubuntu 5371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/rgw/types.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 289013 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/rgw/__init__.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 289015 36 -rw-r--r-- 1 ubuntu ubuntu 34361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/rgw/rgwam_core.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 288996 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/__init__.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 289011 4 -rw-r--r-- 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/py.typed 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 289029 8 -rw-r--r-- 1 ubuntu ubuntu 5249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/utils.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 288997 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 289009 8 -rw-r--r-- 1 ubuntu ubuntu 5381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/translate.py 2024-03-27T21:32:59.207 INFO:teuthology.orchestra.run.smithi063.stdout: 288999 16 -rw-r--r-- 1 ubuntu ubuntu 15399 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_group.py 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 288998 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/__init__.py 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289000 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_selection 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289003 4 -rw-r--r-- 1 ubuntu ubuntu 1234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_selection/filter.py 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289005 8 -rw-r--r-- 1 ubuntu ubuntu 7446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_selection/selector.py 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289004 16 -rw-r--r-- 1 ubuntu ubuntu 13115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_selection/matchers.py 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289001 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_selection/__init__.py 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289002 4 -rw-r--r-- 1 ubuntu ubuntu 394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/drive_selection/example.yaml 2024-03-27T21:32:59.208 INFO:teuthology.orchestra.run.smithi063.stdout: 289008 104 -rw-r--r-- 1 ubuntu ubuntu 102556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/service_spec.py 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 289006 8 -rw-r--r-- 1 ubuntu ubuntu 5213 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/hostspec.py 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 289007 8 -rw-r--r-- 1 ubuntu ubuntu 4965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/inventory.py 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 289010 4 -rw-r--r-- 1 ubuntu ubuntu 3124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/ceph/deployment/utils.py 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 288992 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/.gitignore 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 289032 4 -rw-r--r-- 1 ubuntu ubuntu 872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/python-common/setup.py 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 286377 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 286401 8 -rw-r--r-- 1 ubuntu ubuntu 8135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSDCap.h 2024-03-27T21:32:59.209 INFO:teuthology.orchestra.run.smithi063.stdout: 286433 8 -rw-r--r-- 1 ubuntu ubuntu 7546 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/Watch.h 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286389 8 -rw-r--r-- 1 ubuntu ubuntu 6138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECTransaction.h 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286417 4 -rw-r--r-- 1 ubuntu ubuntu 1469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGStateUtils.cc 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286414 56 -rw-r--r-- 1 ubuntu ubuntu 53934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGLog.h 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286392 8 -rw-r--r-- 1 ubuntu ubuntu 6010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ExtentCache.cc 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286379 12 -rw-r--r-- 1 ubuntu ubuntu 10011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ClassHandler.cc 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286430 16 -rw-r--r-- 1 ubuntu ubuntu 12701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/SnapMapper.h 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286426 4 -rw-r--r-- 1 ubuntu ubuntu 2776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/Session.cc 2024-03-27T21:32:59.210 INFO:teuthology.orchestra.run.smithi063.stdout: 286419 20 -rw-r--r-- 1 ubuntu ubuntu 18601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGTransaction.h 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286458 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286466 16 -rw-r--r-- 1 ubuntu ubuntu 13199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/osd_scrub_sched.h 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286479 4 -rw-r--r-- 1 ubuntu ubuntu 2543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_resources.h 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286476 12 -rw-r--r-- 1 ubuntu ubuntu 9208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_reservations.cc 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286459 12 -rw-r--r-- 1 ubuntu ubuntu 8804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/PrimaryLogScrub.cc 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286465 12 -rw-r--r-- 1 ubuntu ubuntu 11690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/osd_scrub_sched.cc 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286471 4 -rw-r--r-- 1 ubuntu ubuntu 3741 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_job.cc 2024-03-27T21:32:59.211 INFO:teuthology.orchestra.run.smithi063.stdout: 286475 12 -rw-r--r-- 1 ubuntu ubuntu 8307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_machine_lstnr.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286462 4 -rw-r--r-- 1 ubuntu ubuntu 1838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/ScrubStore.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286467 76 -rw-r--r-- 1 ubuntu ubuntu 75002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/pg_scrubber.cc 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286477 8 -rw-r--r-- 1 ubuntu ubuntu 6990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_reservations.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286468 32 -rw-r--r-- 1 ubuntu ubuntu 30336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/pg_scrubber.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286472 12 -rw-r--r-- 1 ubuntu ubuntu 8478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_job.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286460 4 -rw-r--r-- 1 ubuntu ubuntu 1360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/PrimaryLogScrub.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286464 12 -rw-r--r-- 1 ubuntu ubuntu 9982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/osd_scrub.h 2024-03-27T21:32:59.212 INFO:teuthology.orchestra.run.smithi063.stdout: 286469 64 -rw-r--r-- 1 ubuntu ubuntu 63722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_backend.cc 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286470 20 -rw-r--r-- 1 ubuntu ubuntu 18408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_backend.h 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286461 8 -rw-r--r-- 1 ubuntu ubuntu 4442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/ScrubStore.cc 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286478 4 -rw-r--r-- 1 ubuntu ubuntu 2415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_resources.cc 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286473 40 -rw-r--r-- 1 ubuntu ubuntu 40197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_machine.cc 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286463 16 -rw-r--r-- 1 ubuntu ubuntu 14703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/osd_scrub.cc 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286474 36 -rw-r--r-- 1 ubuntu ubuntu 36281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber/scrub_machine.h 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286432 16 -rw-r--r-- 1 ubuntu ubuntu 12915 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/Watch.cc 2024-03-27T21:32:59.213 INFO:teuthology.orchestra.run.smithi063.stdout: 286400 20 -rw-r--r-- 1 ubuntu ubuntu 17489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSDCap.cc 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286404 8 -rw-r--r-- 1 ubuntu ubuntu 5189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSDMapMapping.cc 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286421 88 -rw-r--r-- 1 ubuntu ubuntu 86318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PeeringState.h 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286436 24 -rw-r--r-- 1 ubuntu ubuntu 21112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/objclass.cc 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286480 20 -rw-r--r-- 1 ubuntu ubuntu 17007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scrubber_common.h 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286378 4 -rw-r--r-- 1 ubuntu ubuntu 2210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/CMakeLists.txt 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286439 12 -rw-r--r-- 1 ubuntu ubuntu 8217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_internal_types.h 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286428 4 -rw-r--r-- 1 ubuntu ubuntu 2119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/SnapMapReaderI.h 2024-03-27T21:32:59.214 INFO:teuthology.orchestra.run.smithi063.stdout: 286444 4 -rw-r--r-- 1 ubuntu ubuntu 228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_tracer.cc 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286422 476 -rw-r--r-- 1 ubuntu ubuntu 485520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PrimaryLogPG.cc 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286396 8 -rw-r--r-- 1 ubuntu ubuntu 6135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/MissingLoc.cc 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286446 212 -rw-r--r-- 1 ubuntu ubuntu 213110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_types.cc 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286394 8 -rw-r--r-- 1 ubuntu ubuntu 6492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/HitSet.cc 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286441 4 -rw-r--r-- 1 ubuntu ubuntu 2115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_op_util.h 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286447 212 -rw-r--r-- 1 ubuntu ubuntu 213762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_types.h 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286398 348 -rw-r--r-- 1 ubuntu ubuntu 352714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSD.cc 2024-03-27T21:32:59.215 INFO:teuthology.orchestra.run.smithi063.stdout: 286405 8 -rw-r--r-- 1 ubuntu ubuntu 8140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSDMapMapping.h 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286427 8 -rw-r--r-- 1 ubuntu ubuntu 6615 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/Session.h 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286425 16 -rw-r--r-- 1 ubuntu ubuntu 12368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ReplicatedBackend.h 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286381 12 -rw-r--r-- 1 ubuntu ubuntu 8446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/DynamicPerfStats.h 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286391 8 -rw-r--r-- 1 ubuntu ubuntu 5509 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECUtil.h 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286395 16 -rw-r--r-- 1 ubuntu ubuntu 12721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/HitSet.h 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286451 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286456 20 -rw-r--r-- 1 ubuntu ubuntu 18762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler/mClockScheduler.cc 2024-03-27T21:32:59.216 INFO:teuthology.orchestra.run.smithi063.stdout: 286453 4 -rw-r--r-- 1 ubuntu ubuntu 3870 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler/OpScheduler.h 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286452 4 -rw-r--r-- 1 ubuntu ubuntu 1682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler/OpScheduler.cc 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286454 8 -rw-r--r-- 1 ubuntu ubuntu 5614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler/OpSchedulerItem.cc 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286457 12 -rw-r--r-- 1 ubuntu ubuntu 8345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler/mClockScheduler.h 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286455 20 -rw-r--r-- 1 ubuntu ubuntu 18874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/scheduler/OpSchedulerItem.h 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286408 8 -rw-r--r-- 1 ubuntu ubuntu 5807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OpRequest.h 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286383 16 -rw-r--r-- 1 ubuntu ubuntu 13654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECBackend.h 2024-03-27T21:32:59.217 INFO:teuthology.orchestra.run.smithi063.stdout: 286449 4 -rw-r--r-- 1 ubuntu ubuntu 394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/recovery_types.cc 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286448 12 -rw-r--r-- 1 ubuntu ubuntu 10973 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_types_fmt.h 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286420 232 -rw-r--r-- 1 ubuntu ubuntu 237456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PeeringState.cc 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286390 8 -rw-r--r-- 1 ubuntu ubuntu 6782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECUtil.cc 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286416 8 -rw-r--r-- 1 ubuntu ubuntu 6510 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGPeeringEvent.h 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286382 60 -rw-r--r-- 1 ubuntu ubuntu 57847 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECBackend.cc 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286440 12 -rw-r--r-- 1 ubuntu ubuntu 8816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_op_util.cc 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286445 4 -rw-r--r-- 1 ubuntu ubuntu 251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_tracer.h 2024-03-27T21:32:59.218 INFO:teuthology.orchestra.run.smithi063.stdout: 286424 76 -rw-r--r-- 1 ubuntu ubuntu 74336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ReplicatedBackend.cc 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286438 4 -rw-r--r-- 1 ubuntu ubuntu 600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/object_state_fmt.h 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286412 20 -rw-r--r-- 1 ubuntu ubuntu 18704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGBackend.h 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286443 8 -rw-r--r-- 1 ubuntu ubuntu 5373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_perf_counters.h 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286407 8 -rw-r--r-- 1 ubuntu ubuntu 4532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OpRequest.cc 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286437 4 -rw-r--r-- 1 ubuntu ubuntu 4084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/object_state.h 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286380 4 -rw-r--r-- 1 ubuntu ubuntu 3455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ClassHandler.h 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286403 60 -rw-r--r-- 1 ubuntu ubuntu 59846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSDMap.h 2024-03-27T21:32:59.219 INFO:teuthology.orchestra.run.smithi063.stdout: 286415 4 -rw-r--r-- 1 ubuntu ubuntu 458 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGPeeringEvent.cc 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286434 4 -rw-r--r-- 1 ubuntu ubuntu 3304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/error_code.cc 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286384 32 -rw-r--r-- 1 ubuntu ubuntu 28906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECCommon.cc 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286423 68 -rw-r--r-- 1 ubuntu ubuntu 65904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PrimaryLogPG.h 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286409 84 -rw-r--r-- 1 ubuntu ubuntu 83302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PG.cc 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286411 20 -rw-r--r-- 1 ubuntu ubuntu 17716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGBackend.cc 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286386 12 -rw-r--r-- 1 ubuntu ubuntu 11275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECMsgTypes.cc 2024-03-27T21:32:59.220 INFO:teuthology.orchestra.run.smithi063.stdout: 286442 24 -rw-r--r-- 1 ubuntu ubuntu 21052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/osd_perf_counters.cc 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286397 12 -rw-r--r-- 1 ubuntu ubuntu 10587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/MissingLoc.h 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286410 44 -rw-r--r-- 1 ubuntu ubuntu 44975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PG.h 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286385 28 -rw-r--r-- 1 ubuntu ubuntu 26621 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECCommon.h 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286393 16 -rw-r--r-- 1 ubuntu ubuntu 14556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ExtentCache.h 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286413 40 -rw-r--r-- 1 ubuntu ubuntu 40687 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGLog.cc 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286402 236 -rw-r--r-- 1 ubuntu ubuntu 239133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSDMap.cc 2024-03-27T21:32:59.221 INFO:teuthology.orchestra.run.smithi063.stdout: 286399 64 -rw-r--r-- 1 ubuntu ubuntu 62758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/OSD.h 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286429 32 -rw-r--r-- 1 ubuntu ubuntu 30545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/SnapMapper.cc 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286387 8 -rw-r--r-- 1 ubuntu ubuntu 4930 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECMsgTypes.h 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286418 4 -rw-r--r-- 1 ubuntu ubuntu 2007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/PGStateUtils.h 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286406 4 -rw-r--r-- 1 ubuntu ubuntu 914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ObjectVersioner.h 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286435 4 -rw-r--r-- 1 ubuntu ubuntu 1499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/error_code.h 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286388 20 -rw-r--r-- 1 ubuntu ubuntu 18726 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/ECTransaction.cc 2024-03-27T21:32:59.222 INFO:teuthology.orchestra.run.smithi063.stdout: 286450 4 -rw-r--r-- 1 ubuntu ubuntu 2343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/recovery_types.h 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 286431 4 -rw-r--r-- 1 ubuntu ubuntu 3480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osd/TierAgentState.h 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285208 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285209 4 -rw-r--r-- 1 ubuntu ubuntu 484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper/CMakeLists.txt 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285210 4 -rw-r--r-- 1 ubuntu ubuntu 1347 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper/MultiAioCompletionImpl.cc 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285211 8 -rw-r--r-- 1 ubuntu ubuntu 4333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper/MultiAioCompletionImpl.h 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285213 12 -rw-r--r-- 1 ubuntu ubuntu 9688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper/RadosStriperImpl.h 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285214 20 -rw-r--r-- 1 ubuntu ubuntu 20082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper/libradosstriper.cc 2024-03-27T21:32:59.223 INFO:teuthology.orchestra.run.smithi063.stdout: 285212 60 -rw-r--r-- 1 ubuntu ubuntu 58551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libradosstriper/RadosStriperImpl.cc 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 283696 48 -rwxr-xr-x 1 ubuntu ubuntu 46913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph.in 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 285078 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/jaegertracing 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 285080 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/jaegertracing/opentelemetry-cpp 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 285079 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/jaegertracing/config.yml 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 284837 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 284845 4 -rw-r--r-- 1 ubuntu ubuntu 446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/utils.h 2024-03-27T21:32:59.224 INFO:teuthology.orchestra.run.smithi063.stdout: 284841 8 -rw-r--r-- 1 ubuntu ubuntu 6880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/dbg.cc 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 284838 4 -rw-r--r-- 1 ubuntu ubuntu 394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/CMakeLists.txt 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 284842 4 -rw-r--r-- 1 ubuntu ubuntu 614 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/dbg.h 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 284843 12 -rw-r--r-- 1 ubuntu ubuntu 10063 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/options.cc 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 284840 4 -rw-r--r-- 1 ubuntu ubuntu 1642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/ceph_dokan.h 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 284839 36 -rw-r--r-- 1 ubuntu ubuntu 33700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/ceph_dokan.cc 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 284844 4 -rw-r--r-- 1 ubuntu ubuntu 758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/dokan/utils.cc 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 283386 4 -rw-r--r-- 1 ubuntu ubuntu 394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-coverage.in 2024-03-27T21:32:59.225 INFO:teuthology.orchestra.run.smithi063.stdout: 283383 4 -rw-r--r-- 1 ubuntu ubuntu 2846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/btrfs_ioc_test.c 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285117 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285124 4 -rw-r--r-- 1 ubuntu ubuntu 3161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/FutureImpl.h 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285122 4 -rw-r--r-- 1 ubuntu ubuntu 1106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Future.h 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285135 8 -rw-r--r-- 1 ubuntu ubuntu 5545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Journaler.h 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285123 4 -rw-r--r-- 1 ubuntu ubuntu 4087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/FutureImpl.cc 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285134 16 -rw-r--r-- 1 ubuntu ubuntu 13888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Journaler.cc 2024-03-27T21:32:59.226 INFO:teuthology.orchestra.run.smithi063.stdout: 285118 4 -rw-r--r-- 1 ubuntu ubuntu 296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/CMakeLists.txt 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285127 4 -rw-r--r-- 1 ubuntu ubuntu 758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalMetadataListener.h 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285141 4 -rw-r--r-- 1 ubuntu ubuntu 408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/ReplayHandler.h 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285130 16 -rw-r--r-- 1 ubuntu ubuntu 14655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalRecorder.cc 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285121 4 -rw-r--r-- 1 ubuntu ubuntu 1026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Future.cc 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285125 36 -rw-r--r-- 1 ubuntu ubuntu 35478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalMetadata.cc 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285136 12 -rw-r--r-- 1 ubuntu ubuntu 10124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/ObjectPlayer.cc 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285119 8 -rw-r--r-- 1 ubuntu ubuntu 4346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Entry.cc 2024-03-27T21:32:59.227 INFO:teuthology.orchestra.run.smithi063.stdout: 285128 32 -rw-r--r-- 1 ubuntu ubuntu 28705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalPlayer.cc 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285142 4 -rw-r--r-- 1 ubuntu ubuntu 637 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Settings.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285126 12 -rw-r--r-- 1 ubuntu ubuntu 11486 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalMetadata.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285143 4 -rw-r--r-- 1 ubuntu ubuntu 720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Types.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285131 4 -rw-r--r-- 1 ubuntu ubuntu 3690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalRecorder.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285139 8 -rw-r--r-- 1 ubuntu ubuntu 4394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/ObjectRecorder.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285138 16 -rw-r--r-- 1 ubuntu ubuntu 13578 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/ObjectRecorder.cc 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285120 4 -rw-r--r-- 1 ubuntu ubuntu 1402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Entry.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285145 4 -rw-r--r-- 1 ubuntu ubuntu 1389 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Utils.h 2024-03-27T21:32:59.228 INFO:teuthology.orchestra.run.smithi063.stdout: 285133 4 -rw-r--r-- 1 ubuntu ubuntu 2407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalTrimmer.h 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 285129 8 -rw-r--r-- 1 ubuntu ubuntu 5090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalPlayer.h 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 285137 4 -rw-r--r-- 1 ubuntu ubuntu 3672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/ObjectPlayer.h 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 285144 4 -rw-r--r-- 1 ubuntu ubuntu 670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/Utils.cc 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 285140 4 -rw-r--r-- 1 ubuntu ubuntu 695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/ReplayEntry.h 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 285132 8 -rw-r--r-- 1 ubuntu ubuntu 7743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/journal/JournalTrimmer.cc 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 286308 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/objsync 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 286309 4 -rwxr-xr-x 1 ubuntu ubuntu 1087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/objsync/boto_del.py 2024-03-27T21:32:59.229 INFO:teuthology.orchestra.run.smithi063.stdout: 284353 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284366 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/lz4 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284369 4 -rw-r--r-- 1 ubuntu ubuntu 1138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/lz4/CompressionPluginLZ4.h 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284367 4 -rw-r--r-- 1 ubuntu ubuntu 464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/lz4/CMakeLists.txt 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284370 8 -rw-r--r-- 1 ubuntu ubuntu 4428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/lz4/LZ4Compressor.cc 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284371 4 -rw-r--r-- 1 ubuntu ubuntu 1328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/lz4/LZ4Compressor.h 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284368 4 -rw-r--r-- 1 ubuntu ubuntu 1006 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/lz4/CompressionPluginLZ4.cc 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284358 8 -rw-r--r-- 1 ubuntu ubuntu 6806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/QatAccel.cc 2024-03-27T21:32:59.230 INFO:teuthology.orchestra.run.smithi063.stdout: 284354 4 -rw-r--r-- 1 ubuntu ubuntu 1043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/CMakeLists.txt 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284355 4 -rw-r--r-- 1 ubuntu ubuntu 1091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/CompressionPlugin.h 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284359 4 -rw-r--r-- 1 ubuntu ubuntu 1455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/QatAccel.h 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284356 4 -rw-r--r-- 1 ubuntu ubuntu 3020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/Compressor.cc 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284357 4 -rw-r--r-- 1 ubuntu ubuntu 3008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/Compressor.h 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284377 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zlib 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284378 8 -rw-r--r-- 1 ubuntu ubuntu 5100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zlib/CMakeLists.txt 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284382 4 -rw-r--r-- 1 ubuntu ubuntu 1552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zlib/ZlibCompressor.h 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284380 4 -rw-r--r-- 1 ubuntu ubuntu 1726 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zlib/CompressionPluginZlib.h 2024-03-27T21:32:59.231 INFO:teuthology.orchestra.run.smithi063.stdout: 284379 4 -rw-r--r-- 1 ubuntu ubuntu 1102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zlib/CompressionPluginZlib.cc 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284381 8 -rw-r--r-- 1 ubuntu ubuntu 8008 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zlib/ZlibCompressor.cc 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284383 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zstd 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284384 4 -rw-r--r-- 1 ubuntu ubuntu 519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zstd/CMakeLists.txt 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284385 4 -rw-r--r-- 1 ubuntu ubuntu 1020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zstd/CompressionPluginZstd.cc 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284387 4 -rw-r--r-- 1 ubuntu ubuntu 3132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zstd/ZstdCompressor.h 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284386 4 -rw-r--r-- 1 ubuntu ubuntu 1181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/zstd/CompressionPluginZstd.h 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284372 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/snappy 2024-03-27T21:32:59.232 INFO:teuthology.orchestra.run.smithi063.stdout: 284373 4 -rw-r--r-- 1 ubuntu ubuntu 381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/snappy/CMakeLists.txt 2024-03-27T21:32:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 284375 4 -rw-r--r-- 1 ubuntu ubuntu 1173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/snappy/CompressionPluginSnappy.h 2024-03-27T21:32:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 284376 4 -rw-r--r-- 1 ubuntu ubuntu 2878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/snappy/SnappyCompressor.h 2024-03-27T21:32:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 284374 4 -rw-r--r-- 1 ubuntu ubuntu 1106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/snappy/CompressionPluginSnappy.cc 2024-03-27T21:32:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 284360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/brotli 2024-03-27T21:32:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 284362 4 -rw-r--r-- 1 ubuntu ubuntu 982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/brotli/BrotliCompressor.h 2024-03-27T21:32:59.233 INFO:teuthology.orchestra.run.smithi063.stdout: 284363 4 -rw-r--r-- 1 ubuntu ubuntu 1150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/brotli/CMakeLists.txt 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 284365 4 -rw-r--r-- 1 ubuntu ubuntu 916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/brotli/CompressionPluginBrotli.h 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 284364 4 -rw-r--r-- 1 ubuntu ubuntu 454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/brotli/CompressionPluginBrotli.cc 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 284361 4 -rw-r--r-- 1 ubuntu ubuntu 3661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/compressor/brotli/BrotliCompressor.cc 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 283700 4 -rw-r--r-- 1 ubuntu ubuntu 1832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_mgr.cc 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 285185 4 -rw-r--r-- 1 ubuntu ubuntu 1799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/librados-config.cc 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 283304 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 283307 4 -rw-r--r-- 1 ubuntu ubuntu 1390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthClient.h 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 283327 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx 2024-03-27T21:32:59.234 INFO:teuthology.orchestra.run.smithi063.stdout: 283332 16 -rw-r--r-- 1 ubuntu ubuntu 13315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxKeyServer.cc 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283331 4 -rw-r--r-- 1 ubuntu ubuntu 2017 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxClientHandler.h 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283328 4 -rw-r--r-- 1 ubuntu ubuntu 1371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxAuthorizeHandler.cc 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283334 20 -rw-r--r-- 1 ubuntu ubuntu 17861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxProtocol.cc 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283339 4 -rw-r--r-- 1 ubuntu ubuntu 1128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxSessionHandler.h 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283335 20 -rw-r--r-- 1 ubuntu ubuntu 17713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxProtocol.h 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283330 12 -rw-r--r-- 1 ubuntu ubuntu 9770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxClientHandler.cc 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283338 8 -rw-r--r-- 1 ubuntu ubuntu 5829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxSessionHandler.cc 2024-03-27T21:32:59.235 INFO:teuthology.orchestra.run.smithi063.stdout: 283336 16 -rw-r--r-- 1 ubuntu ubuntu 13167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxServiceHandler.cc 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283333 12 -rw-r--r-- 1 ubuntu ubuntu 10203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxKeyServer.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283337 4 -rw-r--r-- 1 ubuntu ubuntu 1544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxServiceHandler.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283329 4 -rw-r--r-- 1 ubuntu ubuntu 1114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/cephx/CephxAuthorizeHandler.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283321 8 -rw-r--r-- 1 ubuntu ubuntu 6151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/Crypto.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283306 4 -rw-r--r-- 1 ubuntu ubuntu 1331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthAuthorizeHandler.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283313 4 -rw-r--r-- 1 ubuntu ubuntu 2310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthRegistry.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283319 4 -rw-r--r-- 1 ubuntu ubuntu 649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/CMakeLists.txt 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283324 4 -rw-r--r-- 1 ubuntu ubuntu 3520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/KeyRing.h 2024-03-27T21:32:59.236 INFO:teuthology.orchestra.run.smithi063.stdout: 283317 4 -rw-r--r-- 1 ubuntu ubuntu 1463 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthSessionHandler.cc 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283305 12 -rw-r--r-- 1 ubuntu ubuntu 9777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/Auth.h 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283326 4 -rw-r--r-- 1 ubuntu ubuntu 1376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/RotatingKeyRing.h 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283308 4 -rw-r--r-- 1 ubuntu ubuntu 1005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthClientHandler.cc 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283350 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283353 4 -rw-r--r-- 1 ubuntu ubuntu 1751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none/AuthNoneClientHandler.h 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283352 4 -rw-r--r-- 1 ubuntu ubuntu 1123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none/AuthNoneAuthorizeHandler.h 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283351 4 -rw-r--r-- 1 ubuntu ubuntu 1502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none/AuthNoneAuthorizeHandler.cc 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283356 4 -rw-r--r-- 1 ubuntu ubuntu 529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none/AuthNoneSessionHandler.h 2024-03-27T21:32:59.237 INFO:teuthology.orchestra.run.smithi063.stdout: 283355 4 -rw-r--r-- 1 ubuntu ubuntu 1268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none/AuthNoneServiceHandler.h 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283354 4 -rw-r--r-- 1 ubuntu ubuntu 1142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/none/AuthNoneProtocol.h 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283347 8 -rw-r--r-- 1 ubuntu ubuntu 7650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbServiceHandler.cpp 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283341 4 -rw-r--r-- 1 ubuntu ubuntu 1345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbAuthorizeHandler.cpp 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283348 4 -rw-r--r-- 1 ubuntu ubuntu 1758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbServiceHandler.hpp 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283343 12 -rw-r--r-- 1 ubuntu ubuntu 8553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbClientHandler.cpp 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283349 4 -rw-r--r-- 1 ubuntu ubuntu 867 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbSessionHandler.hpp 2024-03-27T21:32:59.238 INFO:teuthology.orchestra.run.smithi063.stdout: 283344 4 -rw-r--r-- 1 ubuntu ubuntu 2259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbClientHandler.hpp 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283342 4 -rw-r--r-- 1 ubuntu ubuntu 1104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbAuthorizeHandler.hpp 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283346 4 -rw-r--r-- 1 ubuntu ubuntu 3909 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbProtocol.hpp 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283345 4 -rw-r--r-- 1 ubuntu ubuntu 2782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/krb/KrbProtocol.cpp 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283312 12 -rw-r--r-- 1 ubuntu ubuntu 9647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthRegistry.cc 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283310 4 -rw-r--r-- 1 ubuntu ubuntu 2140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthMethodList.cc 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283311 4 -rw-r--r-- 1 ubuntu ubuntu 955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthMethodList.h 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283320 20 -rw-r--r-- 1 ubuntu ubuntu 17227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/Crypto.cc 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283316 4 -rw-r--r-- 1 ubuntu ubuntu 2573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthServiceHandler.h 2024-03-27T21:32:59.239 INFO:teuthology.orchestra.run.smithi063.stdout: 283357 4 -rw-r--r-- 1 ubuntu ubuntu 1916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/scheme.txt 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283318 4 -rw-r--r-- 1 ubuntu ubuntu 1290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthSessionHandler.h 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283323 8 -rw-r--r-- 1 ubuntu ubuntu 6441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/KeyRing.cc 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283325 4 -rw-r--r-- 1 ubuntu ubuntu 1678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/RotatingKeyRing.cc 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283314 4 -rw-r--r-- 1 ubuntu ubuntu 1509 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthServer.h 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283309 4 -rw-r--r-- 1 ubuntu ubuntu 1947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthClientHandler.h 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283315 4 -rw-r--r-- 1 ubuntu ubuntu 2304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/AuthServiceHandler.cc 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 283322 4 -rw-r--r-- 1 ubuntu ubuntu 1471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/auth/DummyAuth.h 2024-03-27T21:32:59.240 INFO:teuthology.orchestra.run.smithi063.stdout: 284895 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/etc-rbdmap 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 283704 4 -rw-r--r-- 1 ubuntu ubuntu 2891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_syn.cc 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 284388 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cpp_redis 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 284916 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/fmt 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 283384 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/c-ares 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 285081 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 285083 4 -rw-r--r-- 1 ubuntu ubuntu 2055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/CMakeLists.txt 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 285084 4 -rw-r--r-- 1 ubuntu ubuntu 1564 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/README 2024-03-27T21:32:59.241 INFO:teuthology.orchestra.run.smithi063.stdout: 285108 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285109 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285110 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285111 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph/fs 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285114 4 -rw-r--r-- 1 ubuntu ubuntu 2896 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph/fs/CephMountCreateTest.java 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285113 4 -rw-r--r-- 1 ubuntu ubuntu 1670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph/fs/CephDoubleMountTest.java 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285115 28 -rw-r--r-- 1 ubuntu ubuntu 26218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph/fs/CephMountTest.java 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285116 8 -rw-r--r-- 1 ubuntu ubuntu 4869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph/fs/CephUnmountedTest.java 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285112 4 -rw-r--r-- 1 ubuntu ubuntu 1601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/test/com/ceph/fs/CephAllTests.java 2024-03-27T21:32:59.242 INFO:teuthology.orchestra.run.smithi063.stdout: 285085 4 -rw-r--r-- 1 ubuntu ubuntu 2543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/build.xml 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285102 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/native 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285103 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/native/CMakeLists.txt 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285105 4 -rw-r--r-- 1 ubuntu ubuntu 2195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/native/JniConstants.h 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285106 4 -rw-r--r-- 1 ubuntu ubuntu 1617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/native/ScopedLocalRef.h 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285107 80 -rw-r--r-- 1 ubuntu ubuntu 79866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/native/libcephfs_jni.cc 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285104 4 -rw-r--r-- 1 ubuntu ubuntu 1491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/native/JniConstants.cpp 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285086 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java 2024-03-27T21:32:59.243 INFO:teuthology.orchestra.run.smithi063.stdout: 285087 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285088 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285089 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/crush 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285090 4 -rw-r--r-- 1 ubuntu ubuntu 1449 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/crush/Bucket.java 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285091 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285096 4 -rw-r--r-- 1 ubuntu ubuntu 3139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephNativeLoader.java 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285097 4 -rw-r--r-- 1 ubuntu ubuntu 1538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephNotDirectoryException.java 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285093 4 -rw-r--r-- 1 ubuntu ubuntu 1561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephFileAlreadyExistsException.java 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285092 4 -rw-r--r-- 1 ubuntu ubuntu 1535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephAlreadyMountedException.java 2024-03-27T21:32:59.244 INFO:teuthology.orchestra.run.smithi063.stdout: 285094 4 -rw-r--r-- 1 ubuntu ubuntu 1868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephFileExtent.java 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285098 4 -rw-r--r-- 1 ubuntu ubuntu 1511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephNotMountedException.java 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285095 32 -rw-r--r-- 1 ubuntu ubuntu 29477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephMount.java 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285099 4 -rw-r--r-- 1 ubuntu ubuntu 1492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephPoolException.java 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285101 4 -rw-r--r-- 1 ubuntu ubuntu 1321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephStatVFS.java 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285100 4 -rw-r--r-- 1 ubuntu ubuntu 1665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/java/com/ceph/fs/CephStat.java 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285082 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/java/.gitignore 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 285184 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/libkmip 2024-03-27T21:32:59.245 INFO:teuthology.orchestra.run.smithi063.stdout: 286511 4 -rwxr-xr-x 1 ubuntu ubuntu 626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/push_to_qemu.pl 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 283997 4 -rw-r--r-- 1 ubuntu ubuntu 1662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls_crypto.cc 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 285077 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/isa-l 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 283382 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blkin 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 286506 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/powerdns 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 286507 4 -rw-r--r-- 1 ubuntu ubuntu 1671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/powerdns/README.md 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 286509 4 -rw-r--r-- 1 ubuntu ubuntu 329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/powerdns/rgw-pdns.conf.in 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 286508 12 -rwxr-xr-x 1 ubuntu ubuntu 8790 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/powerdns/pdns-backend-rgw.py 2024-03-27T21:32:59.246 INFO:teuthology.orchestra.run.smithi063.stdout: 285739 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285872 100 -rw-r--r-- 1 ubuntu ubuntu 98916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/journal.cc 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285839 16 -rw-r--r-- 1 ubuntu ubuntu 13410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SnapServer.cc 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285783 8 -rw-r--r-- 1 ubuntu ubuntu 5249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSContext.h 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285822 8 -rw-r--r-- 1 ubuntu ubuntu 7103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/RecoveryQueue.cc 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285794 24 -rw-r--r-- 1 ubuntu ubuntu 23308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSRank.h 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285806 16 -rw-r--r-- 1 ubuntu ubuntu 14144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MetricsHandler.cc 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285751 160 -rw-r--r-- 1 ubuntu ubuntu 160609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CInode.cc 2024-03-27T21:32:59.247 INFO:teuthology.orchestra.run.smithi063.stdout: 285812 36 -rw-r--r-- 1 ubuntu ubuntu 33090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/OpenFileTable.cc 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285746 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/BoostUrlImpl.cc 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285834 20 -rw-r--r-- 1 ubuntu ubuntu 18817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SimpleLock.h 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285780 4 -rw-r--r-- 1 ubuntu ubuntu 3323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSCacheObject.cc 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285847 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285857 8 -rw-r--r-- 1 ubuntu ubuntu 4541 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EPeerUpdate.h 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285861 4 -rw-r--r-- 1 ubuntu ubuntu 2289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ESession.h 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285854 24 -rw-r--r-- 1 ubuntu ubuntu 20710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EMetaBlob.h 2024-03-27T21:32:59.248 INFO:teuthology.orchestra.run.smithi063.stdout: 285859 4 -rw-r--r-- 1 ubuntu ubuntu 1216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EResetJournal.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285864 4 -rw-r--r-- 1 ubuntu ubuntu 1422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ETableClient.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285866 4 -rw-r--r-- 1 ubuntu ubuntu 1462 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EUpdate.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285852 4 -rw-r--r-- 1 ubuntu ubuntu 1651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EImportStart.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285863 4 -rw-r--r-- 1 ubuntu ubuntu 1484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ESubtreeMap.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285862 4 -rw-r--r-- 1 ubuntu ubuntu 1857 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ESessions.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285853 4 -rw-r--r-- 1 ubuntu ubuntu 1187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ELid.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285856 4 -rw-r--r-- 1 ubuntu ubuntu 1685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EOpen.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285849 4 -rw-r--r-- 1 ubuntu ubuntu 1532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EExport.h 2024-03-27T21:32:59.249 INFO:teuthology.orchestra.run.smithi063.stdout: 285851 4 -rw-r--r-- 1 ubuntu ubuntu 1404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EImportFinish.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285855 4 -rw-r--r-- 1 ubuntu ubuntu 946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ENoOp.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285858 4 -rw-r--r-- 1 ubuntu ubuntu 1330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EPurged.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285848 4 -rw-r--r-- 1 ubuntu ubuntu 1183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ECommitted.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285850 4 -rw-r--r-- 1 ubuntu ubuntu 2279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/EFragment.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285860 4 -rw-r--r-- 1 ubuntu ubuntu 1149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ESegment.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285865 4 -rw-r--r-- 1 ubuntu ubuntu 1851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/events/ETableServer.h 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285804 24 -rw-r--r-- 1 ubuntu ubuntu 22427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MetricAggregator.cc 2024-03-27T21:32:59.250 INFO:teuthology.orchestra.run.smithi063.stdout: 285828 4 -rw-r--r-- 1 ubuntu ubuntu 884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SegmentBoundary.h 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285873 12 -rw-r--r-- 1 ubuntu ubuntu 10165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/locks.c 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285747 20 -rw-r--r-- 1 ubuntu ubuntu 16782 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CDentry.cc 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285789 4 -rw-r--r-- 1 ubuntu ubuntu 779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSMetaRequest.h 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285829 388 -rw-r--r-- 1 ubuntu ubuntu 394942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Server.cc 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285753 4 -rw-r--r-- 1 ubuntu ubuntu 1108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CMakeLists.txt 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285870 8 -rw-r--r-- 1 ubuntu ubuntu 4234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/inode_backtrace.cc 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285776 52 -rw-r--r-- 1 ubuntu ubuntu 51659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDLog.cc 2024-03-27T21:32:59.251 INFO:teuthology.orchestra.run.smithi063.stdout: 285846 4 -rw-r--r-- 1 ubuntu ubuntu 3808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/cephfs_features.h 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285766 4 -rw-r--r-- 1 ubuntu ubuntu 1514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/LocalLockC.h 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285831 40 -rw-r--r-- 1 ubuntu ubuntu 38918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SessionMap.cc 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285817 8 -rw-r--r-- 1 ubuntu ubuntu 6906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/QuiesceAgent.h 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285841 24 -rw-r--r-- 1 ubuntu ubuntu 22745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/StrayManager.cc 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285798 8 -rw-r--r-- 1 ubuntu ubuntu 7505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSTableClient.cc 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285778 16 -rw-r--r-- 1 ubuntu ubuntu 14912 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSAuthCaps.cc 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285754 12 -rw-r--r-- 1 ubuntu ubuntu 8285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Capability.cc 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285788 28 -rw-r--r-- 1 ubuntu ubuntu 26924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSMap.h 2024-03-27T21:32:59.252 INFO:teuthology.orchestra.run.smithi063.stdout: 285763 4 -rw-r--r-- 1 ubuntu ubuntu 2878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/InoTable.h 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285807 4 -rw-r--r-- 1 ubuntu ubuntu 3640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MetricsHandler.h 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285742 4 -rw-r--r-- 1 ubuntu ubuntu 861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/BatchOp.cc 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285835 12 -rw-r--r-- 1 ubuntu ubuntu 8528 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SnapClient.cc 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285802 8 -rw-r--r-- 1 ubuntu ubuntu 4294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Mantle.cc 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285762 8 -rw-r--r-- 1 ubuntu ubuntu 6224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/InoTable.cc 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285797 4 -rw-r--r-- 1 ubuntu ubuntu 2483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSTable.h 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285837 16 -rw-r--r-- 1 ubuntu ubuntu 13967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SnapRealm.cc 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285745 4 -rw-r--r-- 1 ubuntu ubuntu 3476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Beacon.h 2024-03-27T21:32:59.253 INFO:teuthology.orchestra.run.smithi063.stdout: 285795 24 -rw-r--r-- 1 ubuntu ubuntu 21513 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSRankQuiesce.cc 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285811 20 -rw-r--r-- 1 ubuntu ubuntu 16868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Mutation.h 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285787 40 -rw-r--r-- 1 ubuntu ubuntu 39928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSMap.cc 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285749 104 -rw-r--r-- 1 ubuntu ubuntu 106118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CDir.cc 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285800 12 -rw-r--r-- 1 ubuntu ubuntu 10955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSTableServer.cc 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285779 8 -rw-r--r-- 1 ubuntu ubuntu 8039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSAuthCaps.h 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285809 16 -rw-r--r-- 1 ubuntu ubuntu 14285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Migrator.h 2024-03-27T21:32:59.254 INFO:teuthology.orchestra.run.smithi063.stdout: 285843 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/balancers 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285844 4 -rw-r--r-- 1 ubuntu ubuntu 1304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/balancers/greedyspill.lua 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285824 8 -rw-r--r-- 1 ubuntu ubuntu 6343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/ScatterLock.h 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285767 188 -rw-r--r-- 1 ubuntu ubuntu 190119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Locker.cc 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285741 4 -rw-r--r-- 1 ubuntu ubuntu 1904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Anchor.h 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285838 8 -rw-r--r-- 1 ubuntu ubuntu 4281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SnapRealm.h 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285814 28 -rw-r--r-- 1 ubuntu ubuntu 25969 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/PurgeQueue.cc 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285874 4 -rw-r--r-- 1 ubuntu ubuntu 2801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/locks.h 2024-03-27T21:32:59.255 INFO:teuthology.orchestra.run.smithi063.stdout: 285878 8 -rw-r--r-- 1 ubuntu ubuntu 5846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/snap.cc 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285867 24 -rw-r--r-- 1 ubuntu ubuntu 22235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/flock.cc 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285790 12 -rw-r--r-- 1 ubuntu ubuntu 11492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSPerfMetricTypes.h 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285768 12 -rw-r--r-- 1 ubuntu ubuntu 11222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Locker.h 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285877 32 -rw-r--r-- 1 ubuntu ubuntu 29420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/mdstypes.h 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285808 112 -rw-r--r-- 1 ubuntu ubuntu 111030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Migrator.cc 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285823 4 -rw-r--r-- 1 ubuntu ubuntu 1380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/RecoveryQueue.h 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285833 8 -rw-r--r-- 1 ubuntu ubuntu 4121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SimpleLock.cc 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285769 8 -rw-r--r-- 1 ubuntu ubuntu 5947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/LogEvent.cc 2024-03-27T21:32:59.256 INFO:teuthology.orchestra.run.smithi063.stdout: 285775 56 -rw-r--r-- 1 ubuntu ubuntu 54978 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDCache.h 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285796 8 -rw-r--r-- 1 ubuntu ubuntu 5060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSTable.cc 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285773 8 -rw-r--r-- 1 ubuntu ubuntu 4646 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDBalancer.h 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285793 128 -rw-r--r-- 1 ubuntu ubuntu 128576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSRank.cc 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285781 12 -rw-r--r-- 1 ubuntu ubuntu 10557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSCacheObject.h 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285772 48 -rw-r--r-- 1 ubuntu ubuntu 47003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDBalancer.cc 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285875 4 -rw-r--r-- 1 ubuntu ubuntu 2215 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/mds_table_types.h 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285821 12 -rw-r--r-- 1 ubuntu ubuntu 8920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/QuiesceDbManager.h 2024-03-27T21:32:59.257 INFO:teuthology.orchestra.run.smithi063.stdout: 285819 8 -rw-r--r-- 1 ubuntu ubuntu 5346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/QuiesceDbEncoding.h 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285818 28 -rw-r--r-- 1 ubuntu ubuntu 26373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/QuiesceDb.h 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285827 8 -rw-r--r-- 1 ubuntu ubuntu 8046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/ScrubStack.h 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285748 12 -rw-r--r-- 1 ubuntu ubuntu 11689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CDentry.h 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285760 4 -rw-r--r-- 1 ubuntu ubuntu 2102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/FSMapUser.cc 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285761 4 -rw-r--r-- 1 ubuntu ubuntu 1727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/FSMapUser.h 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285785 40 -rw-r--r-- 1 ubuntu ubuntu 39652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSDaemon.cc 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285840 4 -rw-r--r-- 1 ubuntu ubuntu 4006 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SnapServer.h 2024-03-27T21:32:59.258 INFO:teuthology.orchestra.run.smithi063.stdout: 285825 4 -rw-r--r-- 1 ubuntu ubuntu 2457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/ScrubHeader.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285743 4 -rw-r--r-- 1 ubuntu ubuntu 895 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/BatchOp.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285771 4 -rw-r--r-- 1 ubuntu ubuntu 3242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/LogSegment.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285784 4 -rw-r--r-- 1 ubuntu ubuntu 924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSContinuation.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285757 8 -rw-r--r-- 1 ubuntu ubuntu 4946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/DamageTable.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285830 24 -rw-r--r-- 1 ubuntu ubuntu 24248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Server.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285803 4 -rw-r--r-- 1 ubuntu ubuntu 926 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Mantle.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285813 8 -rw-r--r-- 1 ubuntu ubuntu 4245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/OpenFileTable.h 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285816 12 -rw-r--r-- 1 ubuntu ubuntu 8535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/QuiesceAgent.cc 2024-03-27T21:32:59.259 INFO:teuthology.orchestra.run.smithi063.stdout: 285777 8 -rw-r--r-- 1 ubuntu ubuntu 7718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDLog.h 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285750 28 -rw-r--r-- 1 ubuntu ubuntu 25872 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CDir.h 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285744 20 -rw-r--r-- 1 ubuntu ubuntu 17497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Beacon.cc 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285805 4 -rw-r--r-- 1 ubuntu ubuntu 2612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MetricAggregator.h 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285792 4 -rw-r--r-- 1 ubuntu ubuntu 1669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSPinger.h 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285764 4 -rw-r--r-- 1 ubuntu ubuntu 3216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/JournalPointer.cc 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285774 424 -rw-r--r-- 1 ubuntu ubuntu 433263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDCache.cc 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285832 24 -rw-r--r-- 1 ubuntu ubuntu 23677 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SessionMap.h 2024-03-27T21:32:59.260 INFO:teuthology.orchestra.run.smithi063.stdout: 285836 4 -rw-r--r-- 1 ubuntu ubuntu 3507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/SnapClient.h 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285868 12 -rw-r--r-- 1 ubuntu ubuntu 10330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/flock.h 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285845 4 -rw-r--r-- 1 ubuntu ubuntu 1702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/cephfs_features.cc 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285759 20 -rw-r--r-- 1 ubuntu ubuntu 18374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/FSMap.h 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285756 8 -rw-r--r-- 1 ubuntu ubuntu 7557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/DamageTable.cc 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285801 4 -rw-r--r-- 1 ubuntu ubuntu 3850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSTableServer.h 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285782 4 -rw-r--r-- 1 ubuntu ubuntu 3707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSContext.cc 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285765 4 -rw-r--r-- 1 ubuntu ubuntu 2067 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/JournalPointer.h 2024-03-27T21:32:59.261 INFO:teuthology.orchestra.run.smithi063.stdout: 285815 8 -rw-r--r-- 1 ubuntu ubuntu 6390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/PurgeQueue.h 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285740 4 -rw-r--r-- 1 ubuntu ubuntu 1464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Anchor.cc 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285826 36 -rw-r--r-- 1 ubuntu ubuntu 33537 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/ScrubStack.cc 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285879 4 -rw-r--r-- 1 ubuntu ubuntu 3321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/snap.h 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285755 12 -rw-r--r-- 1 ubuntu ubuntu 11877 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Capability.h 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285876 24 -rw-r--r-- 1 ubuntu ubuntu 23797 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/mdstypes.cc 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285770 4 -rw-r--r-- 1 ubuntu ubuntu 3479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/LogEvent.h 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285820 40 -rw-r--r-- 1 ubuntu ubuntu 38833 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/QuiesceDbManager.cc 2024-03-27T21:32:59.262 INFO:teuthology.orchestra.run.smithi063.stdout: 285799 4 -rw-r--r-- 1 ubuntu ubuntu 2713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSTableClient.h 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285758 36 -rw-r--r-- 1 ubuntu ubuntu 36123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/FSMap.cc 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285791 4 -rw-r--r-- 1 ubuntu ubuntu 3352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSPinger.cc 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285786 8 -rw-r--r-- 1 ubuntu ubuntu 4247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/MDSDaemon.h 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285871 4 -rw-r--r-- 1 ubuntu ubuntu 3291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/inode_backtrace.h 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285842 8 -rw-r--r-- 1 ubuntu ubuntu 6539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/StrayManager.h 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285752 44 -rw-r--r-- 1 ubuntu ubuntu 44366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/CInode.h 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285869 4 -rw-r--r-- 1 ubuntu ubuntu 995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/fscrypt.h 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 285810 16 -rw-r--r-- 1 ubuntu ubuntu 15450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mds/Mutation.cc 2024-03-27T21:32:59.263 INFO:teuthology.orchestra.run.smithi063.stdout: 283822 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283836 12 -rw-r--r-- 1 ubuntu ubuntu 9576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Inode.h 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283823 4 -rw-r--r-- 1 ubuntu ubuntu 240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/CMakeLists.txt 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283828 4 -rw-r--r-- 1 ubuntu ubuntu 3545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Delegation.cc 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283838 4 -rw-r--r-- 1 ubuntu ubuntu 2337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/MetaRequest.cc 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283853 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/hypertable 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283854 16 -rw-r--r-- 1 ubuntu ubuntu 14707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/hypertable/CephBroker.cc 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283855 4 -rw-r--r-- 1 ubuntu ubuntu 3854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/hypertable/CephBroker.h 2024-03-27T21:32:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 283840 4 -rw-r--r-- 1 ubuntu ubuntu 1613 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/MetaSession.cc 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283825 68 -rw-r--r-- 1 ubuntu ubuntu 69571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Client.h 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283827 4 -rw-r--r-- 1 ubuntu ubuntu 1649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/ClientSnapRealm.h 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283839 8 -rw-r--r-- 1 ubuntu ubuntu 7195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/MetaRequest.h 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283843 8 -rw-r--r-- 1 ubuntu ubuntu 7286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/RWRef.h 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283852 4 -rw-r--r-- 1 ubuntu ubuntu 701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/fuse_ll.h 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283858 4 -rw-r--r-- 1 ubuntu ubuntu 1001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/posix_acl.h 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283846 4 -rw-r--r-- 1 ubuntu ubuntu 1702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Trace.cc 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283830 4 -rw-r--r-- 1 ubuntu ubuntu 879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Dentry.cc 2024-03-27T21:32:59.265 INFO:teuthology.orchestra.run.smithi063.stdout: 283835 24 -rw-r--r-- 1 ubuntu ubuntu 22309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Inode.cc 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283832 4 -rw-r--r-- 1 ubuntu ubuntu 416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Dir.h 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283831 4 -rw-r--r-- 1 ubuntu ubuntu 2735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Dentry.h 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283834 4 -rw-r--r-- 1 ubuntu ubuntu 1539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Fh.h 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283829 4 -rw-r--r-- 1 ubuntu ubuntu 1493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Delegation.h 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283842 4 -rw-r--r-- 1 ubuntu ubuntu 2406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/ObjecterWriteback.h 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283845 8 -rw-r--r-- 1 ubuntu ubuntu 7239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/SyntheticClient.h 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283826 4 -rw-r--r-- 1 ubuntu ubuntu 1923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/ClientSnapRealm.cc 2024-03-27T21:32:59.266 INFO:teuthology.orchestra.run.smithi063.stdout: 283833 4 -rw-r--r-- 1 ubuntu ubuntu 678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Fh.cc 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283856 4 -rw-r--r-- 1 ubuntu ubuntu 1482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/ioctl.h 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283844 96 -rw-r--r-- 1 ubuntu ubuntu 95004 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/SyntheticClient.cc 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283849 8 -rw-r--r-- 1 ubuntu ubuntu 4594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/barrier.cc 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283859 4 -rw-r--r-- 1 ubuntu ubuntu 3691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/test_ioctls.c 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283824 488 -rw-r--r-- 1 ubuntu ubuntu 496935 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Client.cc 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283837 4 -rw-r--r-- 1 ubuntu ubuntu 341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/InodeRef.h 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283850 4 -rw-r--r-- 1 ubuntu ubuntu 2273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/barrier.h 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283857 8 -rw-r--r-- 1 ubuntu ubuntu 6553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/posix_acl.cc 2024-03-27T21:32:59.267 INFO:teuthology.orchestra.run.smithi063.stdout: 283841 4 -rw-r--r-- 1 ubuntu ubuntu 2069 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/MetaSession.h 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 283847 4 -rw-r--r-- 1 ubuntu ubuntu 1348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/Trace.h 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 283848 4 -rw-r--r-- 1 ubuntu ubuntu 2311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/UserPerm.h 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 283851 52 -rw-r--r-- 1 ubuntu ubuntu 50224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/client/fuse_ll.cc 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 286183 4 -rwxr-xr-x 1 ubuntu ubuntu 3340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mount.fuse.ceph 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 289602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rocksdb 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 283707 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 283798 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests 2024-03-27T21:32:59.268 INFO:teuthology.orchestra.run.smithi063.stdout: 283805 112 -rw-r--r-- 1 ubuntu ubuntu 113714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_cephadm.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283809 24 -rw-r--r-- 1 ubuntu ubuntu 23162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_deploy.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283807 12 -rw-r--r-- 1 ubuntu ubuntu 9921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_custom_container.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283816 32 -rw-r--r-- 1 ubuntu ubuntu 29904 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_util_funcs.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283808 4 -rw-r--r-- 1 ubuntu ubuntu 2539 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_daemon_form.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283811 12 -rw-r--r-- 1 ubuntu ubuntu 9851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_ingress.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283814 8 -rw-r--r-- 1 ubuntu ubuntu 6702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_nfs.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283806 4 -rw-r--r-- 1 ubuntu ubuntu 2000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_container_engine.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283815 8 -rw-r--r-- 1 ubuntu ubuntu 5276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_unit_file.py 2024-03-27T21:32:59.269 INFO:teuthology.orchestra.run.smithi063.stdout: 283813 16 -rw-r--r-- 1 ubuntu ubuntu 13684 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_networks.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283799 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/__init__.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283810 4 -rw-r--r-- 1 ubuntu ubuntu 2354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_enclosure.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283803 12 -rw-r--r-- 1 ubuntu ubuntu 9767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/fixtures.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283800 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/build 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283802 8 -rw-r--r-- 1 ubuntu ubuntu 6146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/build/test_cephadm_build.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283801 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/build/__init__.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283804 32 -rw-r--r-- 1 ubuntu ubuntu 30728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_agent.py 2024-03-27T21:32:59.270 INFO:teuthology.orchestra.run.smithi063.stdout: 283812 4 -rw-r--r-- 1 ubuntu ubuntu 1551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tests/test_logrotate_config.py 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283709 4 -rw-r--r-- 1 ubuntu ubuntu 1001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/CMakeLists.txt 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283819 4 -rwxr-xr-x 1 ubuntu ubuntu 2331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/vstart-smoke.sh 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283817 4 -rw-r--r-- 1 ubuntu ubuntu 2078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/tox.ini 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283710 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283725 16 -rw-r--r-- 1 ubuntu ubuntu 13334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/util.py 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283723 4 -rw-r--r-- 1 ubuntu ubuntu 4095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/host.py 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283715 4 -rw-r--r-- 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/daemon.json 2024-03-27T21:32:59.271 INFO:teuthology.orchestra.run.smithi063.stdout: 283718 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283719 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker/ceph 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283720 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker/ceph/.bashrc 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283722 4 -rw-r--r-- 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker/ceph/locale.conf 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283721 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker/ceph/Dockerfile 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283713 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/__init__.py 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283724 8 -rw-r--r-- 1 ubuntu ubuntu 5262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/osd.py 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283717 4 -rw-r--r-- 1 ubuntu ubuntu 250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker-compose.cgroup1.yml 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283716 4 -rw-r--r-- 1 ubuntu ubuntu 792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/docker-compose-docker.yml 2024-03-27T21:32:59.272 INFO:teuthology.orchestra.run.smithi063.stdout: 283714 16 -rwxr-xr-x 1 ubuntu ubuntu 14100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/box.py 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283712 4 -rw-r--r-- 1 ubuntu ubuntu 3040 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/DockerfilePodman 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283711 4 -rw-r--r-- 1 ubuntu ubuntu 1129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/box/DockerfileDocker 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283784 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283785 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers/keepalived 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283788 12 -rw-r--r-- 1 ubuntu ubuntu 11431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers/keepalived/README.md 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283787 4 -rw-r--r-- 1 ubuntu ubuntu 1079 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers/keepalived/LICENSE 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283786 4 -rw-r--r-- 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers/keepalived/Dockerfile 2024-03-27T21:32:59.273 INFO:teuthology.orchestra.run.smithi063.stdout: 283789 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers/keepalived/skel 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283790 4 -rwxr-xr-x 1 ubuntu ubuntu 557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/containers/keepalived/skel/init.sh 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283726 20 -rwxr-xr-x 1 ubuntu ubuntu 18744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/build.py 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283818 4 -rwxr-xr-x 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/vstart-cleanup.sh 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283729 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283739 8 -rw-r--r-- 1 ubuntu ubuntu 5986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/context_getters.py 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283769 8 -rw-r--r-- 1 ubuntu ubuntu 6773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/ssh.py 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283755 8 -rw-r--r-- 1 ubuntu ubuntu 5744 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/data_utils.py 2024-03-27T21:32:59.274 INFO:teuthology.orchestra.run.smithi063.stdout: 283764 8 -rw-r--r-- 1 ubuntu ubuntu 7335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/locking.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283734 8 -rw-r--r-- 1 ubuntu ubuntu 6770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/container_daemon_form.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283762 8 -rw-r--r-- 1 ubuntu ubuntu 5912 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/firewalld.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283738 4 -rw-r--r-- 1 ubuntu ubuntu 2329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/context.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283766 12 -rw-r--r-- 1 ubuntu ubuntu 9532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/net_utils.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283761 8 -rw-r--r-- 1 ubuntu ubuntu 4914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/file_utils.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283737 24 -rw-r--r-- 1 ubuntu ubuntu 20620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/container_types.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283767 20 -rw-r--r-- 1 ubuntu ubuntu 20185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/packagers.py 2024-03-27T21:32:59.275 INFO:teuthology.orchestra.run.smithi063.stdout: 283736 8 -rw-r--r-- 1 ubuntu ubuntu 6468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/container_engines.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283783 8 -rw-r--r-- 1 ubuntu ubuntu 5426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templating.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283732 12 -rw-r--r-- 1 ubuntu ubuntu 11007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/call_wrappers.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283760 4 -rw-r--r-- 1 ubuntu ubuntu 1607 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/exe_utils.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283758 4 -rw-r--r-- 1 ubuntu ubuntu 1364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/deployment_utils.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283742 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283748 16 -rw-r--r-- 1 ubuntu ubuntu 14354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/monitoring.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283746 12 -rw-r--r-- 1 ubuntu ubuntu 9443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/ingress.py 2024-03-27T21:32:59.276 INFO:teuthology.orchestra.run.smithi063.stdout: 283747 12 -rw-r--r-- 1 ubuntu ubuntu 9206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/iscsi.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283745 8 -rw-r--r-- 1 ubuntu ubuntu 7377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/custom.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283750 8 -rw-r--r-- 1 ubuntu ubuntu 5065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/node_proxy.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283744 16 -rw-r--r-- 1 ubuntu ubuntu 16214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/ceph.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283749 8 -rw-r--r-- 1 ubuntu ubuntu 7640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/nfs.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283751 8 -rw-r--r-- 1 ubuntu ubuntu 6593 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/nvmeof.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283754 4 -rw-r--r-- 1 ubuntu ubuntu 4015 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/tracing.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283743 4 -rw-r--r-- 1 ubuntu ubuntu 603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/__init__.py 2024-03-27T21:32:59.277 INFO:teuthology.orchestra.run.smithi063.stdout: 283752 16 -rw-r--r-- 1 ubuntu ubuntu 15086 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/smb.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283753 8 -rw-r--r-- 1 ubuntu ubuntu 7777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemons/snmp.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283730 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/__init__.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283740 8 -rw-r--r-- 1 ubuntu ubuntu 4259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemon_form.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283765 12 -rw-r--r-- 1 ubuntu ubuntu 8220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/logging.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283772 12 -rw-r--r-- 1 ubuntu ubuntu 8244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/systemd_unit.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283741 8 -rw-r--r-- 1 ubuntu ubuntu 7777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/daemon_identity.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283768 12 -rw-r--r-- 1 ubuntu ubuntu 8543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/runscripts.py 2024-03-27T21:32:59.278 INFO:teuthology.orchestra.run.smithi063.stdout: 283735 4 -rw-r--r-- 1 ubuntu ubuntu 551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/container_engine_base.py 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283733 4 -rw-r--r-- 1 ubuntu ubuntu 2289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/constants.py 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283773 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283780 4 -rw-r--r-- 1 ubuntu ubuntu 1267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/init_ctr.service.j2 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283775 4 -rw-r--r-- 1 ubuntu ubuntu 1201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/ceph.service.j2 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283778 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/dropin.service.j2 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283776 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/cephadm.logrotate.config.j2 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283782 4 -rw-r--r-- 1 ubuntu ubuntu 1034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/sidecar.service.j2 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283779 4 -rw-r--r-- 1 ubuntu ubuntu 1488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/init_containers.run.j2 2024-03-27T21:32:59.279 INFO:teuthology.orchestra.run.smithi063.stdout: 283781 4 -rw-r--r-- 1 ubuntu ubuntu 508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/sidecar.run.j2 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283774 4 -rw-r--r-- 1 ubuntu ubuntu 307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/agent.service.j2 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283777 4 -rw-r--r-- 1 ubuntu ubuntu 280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/templates/cluster.logrotate.config.j2 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283771 4 -rw-r--r-- 1 ubuntu ubuntu 2536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/systemd.py 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283756 4 -rw-r--r-- 1 ubuntu ubuntu 1440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/decorators.py 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283763 36 -rw-r--r-- 1 ubuntu ubuntu 34087 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/host_facts.py 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283759 4 -rw-r--r-- 1 ubuntu ubuntu 270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/exceptions.py 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283770 8 -rw-r--r-- 1 ubuntu ubuntu 4288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/sysctl.py 2024-03-27T21:32:59.280 INFO:teuthology.orchestra.run.smithi063.stdout: 283757 4 -rw-r--r-- 1 ubuntu ubuntu 388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/deploy.py 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283731 4 -rw-r--r-- 1 ubuntu ubuntu 1050 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadmlib/agent.py 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283728 212 -rwxr-xr-x 1 ubuntu ubuntu 214311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/cephadm.py 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283791 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283795 4 -rw-r--r-- 1 ubuntu ubuntu 293 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples/nfs.json 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283797 8 -rw-r--r-- 1 ubuntu ubuntu 6330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples/rgw_ssl.json 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283792 4 -rw-r--r-- 1 ubuntu ubuntu 747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples/alertmanager.json 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283796 4 -rw-r--r-- 1 ubuntu ubuntu 340 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples/prometheus.json 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283794 8 -rw-r--r-- 1 ubuntu ubuntu 4811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples/grafana.json 2024-03-27T21:32:59.281 INFO:teuthology.orchestra.run.smithi063.stdout: 283793 4 -rw-r--r-- 1 ubuntu ubuntu 1011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/samples/custom_container.json 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 283708 4 -rw-r--r-- 1 ubuntu ubuntu 63 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/.gitignore 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 283820 4 -rw-r--r-- 1 ubuntu ubuntu 783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/zipapp-reqs.txt 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 283727 4 -rwxr-xr-x 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cephadm/build.sh 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 286297 4 -rw-r--r-- 1 ubuntu ubuntu 400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mypy-constrains.txt 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 283287 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/.gitignore 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 283387 8 -rwxr-xr-x 1 ubuntu ubuntu 4192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-crash.in 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 289040 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay 2024-03-27T21:32:59.282 INFO:teuthology.orchestra.run.smithi063.stdout: 289059 4 -rw-r--r-- 1 ubuntu ubuntu 2670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/rbd_loc.cc 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289060 4 -rw-r--r-- 1 ubuntu ubuntu 2490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/rbd_loc.hpp 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289046 4 -rw-r--r-- 1 ubuntu ubuntu 1059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/CMakeLists.txt 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289056 12 -rw-r--r-- 1 ubuntu ubuntu 8880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/ios.hpp 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289042 12 -rw-r--r-- 1 ubuntu ubuntu 10290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/ActionTypes.h 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289049 4 -rw-r--r-- 1 ubuntu ubuntu 1220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/PendingIO.cc 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289058 8 -rw-r--r-- 1 ubuntu ubuntu 4707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/rbd-replay.cc 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289050 4 -rw-r--r-- 1 ubuntu ubuntu 1474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/PendingIO.hpp 2024-03-27T21:32:59.283 INFO:teuthology.orchestra.run.smithi063.stdout: 289045 4 -rw-r--r-- 1 ubuntu ubuntu 773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/BufferReader.h 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289048 4 -rw-r--r-- 1 ubuntu ubuntu 1287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/ImageNameMap.hpp 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289057 20 -rw-r--r-- 1 ubuntu ubuntu 20311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/rbd-replay-prep.cc 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289053 12 -rw-r--r-- 1 ubuntu ubuntu 8538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/actions.cc 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289055 8 -rw-r--r-- 1 ubuntu ubuntu 7319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/ios.cc 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289051 12 -rw-r--r-- 1 ubuntu ubuntu 11257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/Replayer.cc 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289061 4 -rw-r--r-- 1 ubuntu ubuntu 847 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/rbd_replay_debug.hpp 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289041 12 -rw-r--r-- 1 ubuntu ubuntu 11577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/ActionTypes.cc 2024-03-27T21:32:59.284 INFO:teuthology.orchestra.run.smithi063.stdout: 289043 4 -rw-r--r-- 1 ubuntu ubuntu 2248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/BoundedBuffer.hpp 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 289052 4 -rw-r--r-- 1 ubuntu ubuntu 3876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/Replayer.hpp 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 289044 4 -rw-r--r-- 1 ubuntu ubuntu 1026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/BufferReader.cc 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 289054 12 -rw-r--r-- 1 ubuntu ubuntu 8631 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/actions.hpp 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 289047 4 -rw-r--r-- 1 ubuntu ubuntu 1538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/rbd_replay/ImageNameMap.cc 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 289652 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/telemetry 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 289653 28 -rw-r--r-- 1 ubuntu ubuntu 27327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/telemetry/telemetry.patches 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 285731 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log 2024-03-27T21:32:59.285 INFO:teuthology.orchestra.run.smithi063.stdout: 285733 16 -rw-r--r-- 1 ubuntu ubuntu 14755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log/Log.cc 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 285735 8 -rw-r--r-- 1 ubuntu ubuntu 5692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log/LogClock.h 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 285732 4 -rw-r--r-- 1 ubuntu ubuntu 2598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log/Entry.h 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 285737 12 -rw-r--r-- 1 ubuntu ubuntu 10860 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log/test.cc 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 285734 4 -rw-r--r-- 1 ubuntu ubuntu 3335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log/Log.h 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 285736 4 -rw-r--r-- 1 ubuntu ubuntu 3065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/log/SubsystemMap.h 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 286295 4 -rwxr-xr-x 1 ubuntu ubuntu 1274 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mstop.sh 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 286481 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 286486 16 -rw-r--r-- 1 ubuntu ubuntu 16039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Journaler.h 2024-03-27T21:32:59.286 INFO:teuthology.orchestra.run.smithi063.stdout: 286487 80 -rw-r--r-- 1 ubuntu ubuntu 79721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/ObjectCacher.cc 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286494 4 -rw-r--r-- 1 ubuntu ubuntu 2106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/WritebackHandler.h 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286483 16 -rw-r--r-- 1 ubuntu ubuntu 13736 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Filer.cc 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286493 4 -rw-r--r-- 1 ubuntu ubuntu 1427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/StriperTypes.h 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286485 44 -rw-r--r-- 1 ubuntu ubuntu 43617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Journaler.cc 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286482 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/CMakeLists.txt 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286484 8 -rw-r--r-- 1 ubuntu ubuntu 7905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Filer.h 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286491 20 -rw-r--r-- 1 ubuntu ubuntu 18104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Striper.cc 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286488 24 -rw-r--r-- 1 ubuntu ubuntu 22408 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/ObjectCacher.h 2024-03-27T21:32:59.287 INFO:teuthology.orchestra.run.smithi063.stdout: 286489 152 -rw-r--r-- 1 ubuntu ubuntu 152845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Objecter.cc 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286492 8 -rw-r--r-- 1 ubuntu ubuntu 4429 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Striper.h 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286495 8 -rw-r--r-- 1 ubuntu ubuntu 4682 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/error_code.cc 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286496 4 -rw-r--r-- 1 ubuntu ubuntu 1381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/error_code.h 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286490 132 -rw-r--r-- 1 ubuntu ubuntu 135161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/osdc/Objecter.h 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 285168 32 -rw-r--r-- 1 ubuntu ubuntu 32172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/krbd.cc 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286300 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/neorados 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286301 4 -rw-r--r-- 1 ubuntu ubuntu 1482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/neorados/CMakeLists.txt 2024-03-27T21:32:59.288 INFO:teuthology.orchestra.run.smithi063.stdout: 286303 4 -rw-r--r-- 1 ubuntu ubuntu 3412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/neorados/RADOSImpl.cc 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 286302 56 -rw-r--r-- 1 ubuntu ubuntu 55927 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/neorados/RADOS.cc 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 286304 4 -rw-r--r-- 1 ubuntu ubuntu 3200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/neorados/RADOSImpl.h 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284846 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284848 12 -rw-r--r-- 1 ubuntu ubuntu 10541 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/ErasureCode.cc 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284852 4 -rw-r--r-- 1 ubuntu ubuntu 2197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/ErasureCodePlugin.h 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284847 4 -rw-r--r-- 1 ubuntu ubuntu 1212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/CMakeLists.txt 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284850 20 -rw-r--r-- 1 ubuntu ubuntu 18572 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/ErasureCodeInterface.h 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284853 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/clay 2024-03-27T21:32:59.289 INFO:teuthology.orchestra.run.smithi063.stdout: 284854 4 -rw-r--r-- 1 ubuntu ubuntu 354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/clay/CMakeLists.txt 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284858 4 -rw-r--r-- 1 ubuntu ubuntu 920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/clay/ErasureCodePluginClay.h 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284856 8 -rw-r--r-- 1 ubuntu ubuntu 4308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/clay/ErasureCodeClay.h 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284857 4 -rw-r--r-- 1 ubuntu ubuntu 1414 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/clay/ErasureCodePluginClay.cc 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284855 28 -rw-r--r-- 1 ubuntu ubuntu 26786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/clay/ErasureCodeClay.cc 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284880 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/lrc 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284882 28 -rw-r--r-- 1 ubuntu ubuntu 25527 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/lrc/ErasureCodeLrc.cc 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284881 4 -rw-r--r-- 1 ubuntu ubuntu 388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/lrc/CMakeLists.txt 2024-03-27T21:32:59.290 INFO:teuthology.orchestra.run.smithi063.stdout: 284885 4 -rw-r--r-- 1 ubuntu ubuntu 956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/lrc/ErasureCodePluginLrc.h 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284884 4 -rw-r--r-- 1 ubuntu ubuntu 1487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/lrc/ErasureCodePluginLrc.cc 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284883 8 -rw-r--r-- 1 ubuntu ubuntu 4503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/lrc/ErasureCodeLrc.h 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284851 8 -rw-r--r-- 1 ubuntu ubuntu 5362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/ErasureCodePlugin.cc 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284849 4 -rw-r--r-- 1 ubuntu ubuntu 3761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/ErasureCode.h 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284870 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284871 4 -rw-r--r-- 1 ubuntu ubuntu 2948 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/CMakeLists.txt 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284875 4 -rw-r--r-- 1 ubuntu ubuntu 971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/ErasureCodePluginJerasure.h 2024-03-27T21:32:59.291 INFO:teuthology.orchestra.run.smithi063.stdout: 284876 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/gf-complete 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284877 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/jerasure 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284879 4 -rw-r--r-- 1 ubuntu ubuntu 705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/jerasure_init.h 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284873 8 -rw-r--r-- 1 ubuntu ubuntu 7165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/ErasureCodeJerasure.h 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284872 16 -rw-r--r-- 1 ubuntu ubuntu 14436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/ErasureCodeJerasure.cc 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284874 4 -rw-r--r-- 1 ubuntu ubuntu 2825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/ErasureCodePluginJerasure.cc 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284878 4 -rw-r--r-- 1 ubuntu ubuntu 984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/jerasure/jerasure_init.cc 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284859 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa 2024-03-27T21:32:59.292 INFO:teuthology.orchestra.run.smithi063.stdout: 284861 16 -rw-r--r-- 1 ubuntu ubuntu 12762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/ErasureCodeIsa.cc 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284868 8 -rw-r--r-- 1 ubuntu ubuntu 8089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/xor_op.cc 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284860 8 -rw-r--r-- 1 ubuntu ubuntu 4602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/CMakeLists.txt 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284867 4 -rw-r--r-- 1 ubuntu ubuntu 2595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/README 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284863 12 -rw-r--r-- 1 ubuntu ubuntu 11175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/ErasureCodeIsaTableCache.cc 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284865 4 -rw-r--r-- 1 ubuntu ubuntu 2657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/ErasureCodePluginIsa.cc 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284864 4 -rw-r--r-- 1 ubuntu ubuntu 4080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/ErasureCodeIsaTableCache.h 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284862 4 -rw-r--r-- 1 ubuntu ubuntu 3894 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/ErasureCodeIsa.h 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284869 8 -rw-r--r-- 1 ubuntu ubuntu 4674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/xor_op.h 2024-03-27T21:32:59.293 INFO:teuthology.orchestra.run.smithi063.stdout: 284866 4 -rw-r--r-- 1 ubuntu ubuntu 1030 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/isa/ErasureCodePluginIsa.h 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284886 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284893 8 -rw-r--r-- 1 ubuntu ubuntu 4490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/ErasureCodeShecTableCache.h 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284892 12 -rw-r--r-- 1 ubuntu ubuntu 10928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/ErasureCodeShecTableCache.cc 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284887 4 -rw-r--r-- 1 ubuntu ubuntu 944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/CMakeLists.txt 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284891 8 -rw-r--r-- 1 ubuntu ubuntu 4272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/ErasureCodeShec.h 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284894 4 -rw-r--r-- 1 ubuntu ubuntu 2145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/determinant.c 2024-03-27T21:32:59.294 INFO:teuthology.orchestra.run.smithi063.stdout: 284890 24 -rw-r--r-- 1 ubuntu ubuntu 20700 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/ErasureCodeShec.cc 2024-03-27T21:32:59.297 INFO:teuthology.orchestra.run.smithi063.stdout: 284888 4 -rw-r--r-- 1 ubuntu ubuntu 2560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/ErasureCodePluginShec.cc 2024-03-27T21:32:59.297 INFO:teuthology.orchestra.run.smithi063.stdout: 284889 4 -rw-r--r-- 1 ubuntu ubuntu 1035 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/erasure-code/shec/ErasureCodePluginShec.h 2024-03-27T21:32:59.297 INFO:teuthology.orchestra.run.smithi063.stdout: 283407 4 -rwxr-xr-x 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-rbdnamer 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291411 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291415 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/bluestore.c 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291433 4 -rw-r--r-- 1 ubuntu ubuntu 451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/pg.tp 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291414 4 -rw-r--r-- 1 ubuntu ubuntu 2257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/README.md 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291418 4 -rw-r--r-- 1 ubuntu ubuntu 574 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/cyg_profile.tp 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291423 100 -rw-r--r-- 1 ubuntu ubuntu 100849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/librados.tp 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291429 4 -rw-r--r-- 1 ubuntu ubuntu 1429 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/oprequest.tp 2024-03-27T21:32:59.298 INFO:teuthology.orchestra.run.smithi063.stdout: 291424 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/librbd.c 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291413 4 -rw-r--r-- 1 ubuntu ubuntu 2297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/CMakeLists.txt 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291421 4 -rw-r--r-- 1 ubuntu ubuntu 1443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/eventtrace.tp 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291419 4 -rw-r--r-- 1 ubuntu ubuntu 754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/cyg_profile_functions.c 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291422 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/librados.c 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291435 4 -rw-r--r-- 1 ubuntu ubuntu 724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/rgw_op.tp 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291431 24 -rw-r--r-- 1 ubuntu ubuntu 20627 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/osd.tp 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291427 16 -rw-r--r-- 1 ubuntu ubuntu 15616 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/objectstore.tp 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291438 8 -rw-r--r-- 1 ubuntu ubuntu 4280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/tracing-common.h 2024-03-27T21:32:59.299 INFO:teuthology.orchestra.run.smithi063.stdout: 291436 4 -rw-r--r-- 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/rgw_rados.c 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291428 4 -rw-r--r-- 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/oprequest.c 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291437 4 -rw-r--r-- 1 ubuntu ubuntu 936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/rgw_rados.tp 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291416 8 -rw-r--r-- 1 ubuntu ubuntu 5804 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/bluestore.tp 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291420 4 -rw-r--r-- 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/eventtrace.c 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291425 72 -rw-r--r-- 1 ubuntu ubuntu 71769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/librbd.tp 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291426 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/objectstore.c 2024-03-27T21:32:59.300 INFO:teuthology.orchestra.run.smithi063.stdout: 291412 4 -rw-r--r-- 1 ubuntu ubuntu 57 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/.gitignore 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 291432 4 -rw-r--r-- 1 ubuntu ubuntu 113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/pg.c 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 291430 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/osd.c 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 291434 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/rgw_op.c 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 291417 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/tracing/cyg_profile.c 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 283364 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 283371 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/kernel 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 283373 8 -rw-r--r-- 1 ubuntu ubuntu 5177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/kernel/KernelDevice.h 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 283374 8 -rw-r--r-- 1 ubuntu ubuntu 5354 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/kernel/io_uring.cc 2024-03-27T21:32:59.301 INFO:teuthology.orchestra.run.smithi063.stdout: 283375 4 -rw-r--r-- 1 ubuntu ubuntu 861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/kernel/io_uring.h 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283372 48 -rw-r--r-- 1 ubuntu ubuntu 46516 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/kernel/KernelDevice.cc 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283376 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/pmem 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283377 12 -rw-r--r-- 1 ubuntu ubuntu 9091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/pmem/PMEMDevice.cc 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283378 4 -rw-r--r-- 1 ubuntu ubuntu 2206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/pmem/PMEMDevice.h 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283379 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/spdk 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283381 4 -rw-r--r-- 1 ubuntu ubuntu 2323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/spdk/NVMEDevice.h 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283380 28 -rw-r--r-- 1 ubuntu ubuntu 28078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/spdk/NVMEDevice.cc 2024-03-27T21:32:59.302 INFO:teuthology.orchestra.run.smithi063.stdout: 283367 4 -rw-r--r-- 1 ubuntu ubuntu 986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/CMakeLists.txt 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 283365 8 -rw-r--r-- 1 ubuntu ubuntu 4837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/BlockDevice.cc 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 283366 12 -rw-r--r-- 1 ubuntu ubuntu 8809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/BlockDevice.h 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 283368 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/aio 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 283370 4 -rw-r--r-- 1 ubuntu ubuntu 3965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/aio/aio.h 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 283369 4 -rw-r--r-- 1 ubuntu ubuntu 3200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/blk/aio/aio.cc 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 289651 8 -rwxr-xr-x 1 ubuntu ubuntu 6991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/stop.sh 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 284905 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 284906 4 -rw-r--r-- 1 ubuntu ubuntu 310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/CMakeLists.txt 2024-03-27T21:32:59.303 INFO:teuthology.orchestra.run.smithi063.stdout: 284908 8 -rw-r--r-- 1 ubuntu ubuntu 7639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/ExtBlkDevPlugin.cc 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284907 8 -rw-r--r-- 1 ubuntu ubuntu 4914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/ExtBlkDevInterface.h 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284909 4 -rw-r--r-- 1 ubuntu ubuntu 1100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/ExtBlkDevPlugin.h 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284910 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/vdo 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284911 4 -rw-r--r-- 1 ubuntu ubuntu 183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/vdo/CMakeLists.txt 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284912 4 -rw-r--r-- 1 ubuntu ubuntu 1559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/vdo/ExtBlkDevPluginVdo.cc 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284915 4 -rw-r--r-- 1 ubuntu ubuntu 1741 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/vdo/ExtBlkDevVdo.h 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284913 4 -rw-r--r-- 1 ubuntu ubuntu 1103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/vdo/ExtBlkDevPluginVdo.h 2024-03-27T21:32:59.304 INFO:teuthology.orchestra.run.smithi063.stdout: 284914 8 -rw-r--r-- 1 ubuntu ubuntu 4693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/extblkdev/vdo/ExtBlkDevVdo.cc 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 286294 4 -rwxr-xr-x 1 ubuntu ubuntu 1208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/mstart.sh 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 286305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/objclass 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 286307 8 -rw-r--r-- 1 ubuntu ubuntu 7686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/objclass/objclass.h 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 286306 4 -rw-r--r-- 1 ubuntu ubuntu 4016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/objclass/class_api.cc 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 283999 12 drwxr-xr-x 6 ubuntu ubuntu 12288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 284230 4 -rw-r--r-- 1 ubuntu ubuntu 2249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/mime.c 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 284306 4 -rw-r--r-- 1 ubuntu ubuntu 3477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/simple_cache.hpp 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 284070 8 -rw-r--r-- 1 ubuntu ubuntu 4269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/TextTable.h 2024-03-27T21:32:59.305 INFO:teuthology.orchestra.run.smithi063.stdout: 284126 8 -rw-r--r-- 1 ubuntu ubuntu 7514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_crypto.cc 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284185 8 -rw-r--r-- 1 ubuntu ubuntu 7649 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/dout.h 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284190 4 -rw-r--r-- 1 ubuntu ubuntu 570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/environment.h 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284150 4 -rw-r--r-- 1 ubuntu ubuntu 2202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/condition_variable_debug.cc 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284327 8 -rw-r--r-- 1 ubuntu ubuntu 6560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/utf8.c 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284187 4 -rw-r--r-- 1 ubuntu ubuntu 3464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/entity_name.cc 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284018 4 -rw-r--r-- 1 ubuntu ubuntu 3877 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Cycles.h 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284266 4 -rw-r--r-- 1 ubuntu ubuntu 602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/page.cc 2024-03-27T21:32:59.306 INFO:teuthology.orchestra.run.smithi063.stdout: 284228 8 -rw-r--r-- 1 ubuntu ubuntu 5167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/map_cacher.hpp 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284025 4 -rw-r--r-- 1 ubuntu ubuntu 2910 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Finisher.cc 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284012 12 -rw-r--r-- 1 ubuntu ubuntu 10243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ConfUtils.cc 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284211 16 -rw-r--r-- 1 ubuntu ubuntu 14363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/hobject.cc 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284115 4 -rw-r--r-- 1 ubuntu ubuntu 2628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/blkdev.h 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284170 4 -rw-r--r-- 1 ubuntu ubuntu 495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_intel_fast.h 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284208 4 -rw-r--r-- 1 ubuntu ubuntu 630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/hex.h 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284046 4 -rw-r--r-- 1 ubuntu ubuntu 2380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/MemoryModel.cc 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284307 4 -rw-r--r-- 1 ubuntu ubuntu 3757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/snap_types.cc 2024-03-27T21:32:59.307 INFO:teuthology.orchestra.run.smithi063.stdout: 284137 4 -rw-r--r-- 1 ubuntu ubuntu 895 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_strings.h 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284324 4 -rw-r--r-- 1 ubuntu ubuntu 825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/types.cc 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284239 8 -rw-r--r-- 1 ubuntu ubuntu 4670 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/obj_bencher.h 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284029 24 -rw-r--r-- 1 ubuntu ubuntu 22098 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Formatter.cc 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284303 12 -rw-r--r-- 1 ubuntu ubuntu 10608 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/shunique_lock.h 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284030 16 -rw-r--r-- 1 ubuntu ubuntu 14439 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Formatter.h 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284235 8 -rw-r--r-- 1 ubuntu ubuntu 4859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/mutex_debug.h 2024-03-27T21:32:59.308 INFO:teuthology.orchestra.run.smithi063.stdout: 284117 20 -rw-r--r-- 1 ubuntu ubuntu 17565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/bloom_filter.hpp 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284352 4 -rw-r--r-- 1 ubuntu ubuntu 2365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/zipkin_trace.h 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284032 4 -rw-r--r-- 1 ubuntu ubuntu 2052 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Graylog.h 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/detail 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284181 4 -rw-r--r-- 1 ubuntu ubuntu 741 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/detail/construct_suspended.h 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284203 8 -rw-r--r-- 1 ubuntu ubuntu 4799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fork_function.h 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284195 8 -rw-r--r-- 1 ubuntu ubuntu 6180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/escape.cc 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284074 16 -rw-r--r-- 1 ubuntu ubuntu 12846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Throttle.h 2024-03-27T21:32:59.309 INFO:teuthology.orchestra.run.smithi063.stdout: 284223 4 -rw-r--r-- 1 ubuntu ubuntu 418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/linux_version.c 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284162 8 -rw-r--r-- 1 ubuntu ubuntu 6550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/containers.h 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284006 4 -rw-r--r-- 1 ubuntu ubuntu 776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/CDC.h 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284151 4 -rw-r--r-- 1 ubuntu ubuntu 2464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/condition_variable_debug.h 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284319 4 -rw-r--r-- 1 ubuntu ubuntu 2094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/subsys_types.h 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284014 4 -rw-r--r-- 1 ubuntu ubuntu 1009 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ContextCompletion.cc 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284013 4 -rw-r--r-- 1 ubuntu ubuntu 2911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ConfUtils.h 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284188 4 -rw-r--r-- 1 ubuntu ubuntu 2624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/entity_name.h 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284167 8 -rw-r--r-- 1 ubuntu ubuntu 5556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_intel_baseline.c 2024-03-27T21:32:59.310 INFO:teuthology.orchestra.run.smithi063.stdout: 284287 4 -rw-r--r-- 1 ubuntu ubuntu 1311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/reverse.c 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284007 8 -rw-r--r-- 1 ubuntu ubuntu 5771 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/CMakeLists.txt 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284202 4 -rw-r--r-- 1 ubuntu ubuntu 2772 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fmt_common.h 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284120 4 -rw-r--r-- 1 ubuntu ubuntu 985 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/buffer_instrumentation.h 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284146 4 -rw-r--r-- 1 ubuntu ubuntu 3850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/common_init.cc 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284291 8 -rw-r--r-- 1 ubuntu ubuntu 5972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/safe_io.c 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284087 8 -rw-r--r-- 1 ubuntu ubuntu 7240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/admin_socket.h 2024-03-27T21:32:59.311 INFO:teuthology.orchestra.run.smithi063.stdout: 284129 4 -rw-r--r-- 1 ubuntu ubuntu 2099 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_fs.cc 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284149 4 -rw-r--r-- 1 ubuntu ubuntu 796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/compiler_extensions.h 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284277 20 -rw-r--r-- 1 ubuntu ubuntu 17586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/pick_address.cc 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284067 12 -rw-r--r-- 1 ubuntu ubuntu 9643 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/SubProcess.cc 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284142 4 -rw-r--r-- 1 ubuntu ubuntu 3517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/cmdparse.h 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284002 12 -rw-r--r-- 1 ubuntu ubuntu 10916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/AsyncReserver.h 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284056 8 -rw-r--r-- 1 ubuntu ubuntu 4692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/PriorityCache.h 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284192 4 -rw-r--r-- 1 ubuntu ubuntu 363 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/errno.h 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284294 12 -rw-r--r-- 1 ubuntu ubuntu 11317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/scrub_types.h 2024-03-27T21:32:59.312 INFO:teuthology.orchestra.run.smithi063.stdout: 284330 4 -rw-r--r-- 1 ubuntu ubuntu 544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/valgrind.h 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284157 8 -rw-r--r-- 1 ubuntu ubuntu 4266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_obs_mgr.h 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284328 4 -rw-r--r-- 1 ubuntu ubuntu 1754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/utf8.h 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284323 4 -rw-r--r-- 1 ubuntu ubuntu 1591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/tracked_int_ptr.hpp 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284112 4 -rw-r--r-- 1 ubuntu ubuntu 913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/bit_str.h 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284095 8 -rw-r--r-- 1 ubuntu ubuntu 7321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/assert.cc 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284028 4 -rw-r--r-- 1 ubuntu ubuntu 519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/FixedCDC.h 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284285 4 -rw-r--r-- 1 ubuntu ubuntu 1473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/random_string.h 2024-03-27T21:32:59.313 INFO:teuthology.orchestra.run.smithi063.stdout: 284331 4 -rw-r--r-- 1 ubuntu ubuntu 1323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/version.cc 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284191 4 -rw-r--r-- 1 ubuntu ubuntu 359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/errno.cc 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284175 32 -rw-r--r-- 1 ubuntu ubuntu 31832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_ppc_constants.h 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284021 4 -rw-r--r-- 1 ubuntu ubuntu 3808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/EventTrace.cc 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284053 4 -rw-r--r-- 1 ubuntu ubuntu 3578 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Preforker.h 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284009 4 -rw-r--r-- 1 ubuntu ubuntu 761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Clock.h 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284082 12 -rw-r--r-- 1 ubuntu ubuntu 10119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/WeightedPriorityQueue.h 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284279 8 -rw-r--r-- 1 ubuntu ubuntu 7342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ppc-asm.h 2024-03-27T21:32:59.314 INFO:teuthology.orchestra.run.smithi063.stdout: 284243 12 -rw-r--r-- 1 ubuntu ubuntu 11502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options.h 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284197 4 -rw-r--r-- 1 ubuntu ubuntu 1702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/event_socket.h 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284086 32 -rw-r--r-- 1 ubuntu ubuntu 30914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/admin_socket.cc 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284231 4 -rw-r--r-- 1 ubuntu ubuntu 1732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/mime.h 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284217 8 -rw-r--r-- 1 ubuntu ubuntu 8002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/intrusive_lru.h 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284302 8 -rw-r--r-- 1 ubuntu ubuntu 4351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/sharedptr_registry.hpp 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284089 4 -rw-r--r-- 1 ubuntu ubuntu 908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/admin_socket_client.h 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284033 4 -rw-r--r-- 1 ubuntu ubuntu 246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/HBHandle.h 2024-03-27T21:32:59.315 INFO:teuthology.orchestra.run.smithi063.stdout: 284222 4 -rw-r--r-- 1 ubuntu ubuntu 714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/likely.h 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284062 8 -rw-r--r-- 1 ubuntu ubuntu 5014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/RefCountedObj.h 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284282 4 -rw-r--r-- 1 ubuntu ubuntu 1561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/pretty_binary.h 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284295 40 -rw-r--r-- 1 ubuntu ubuntu 40788 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/sctp_crc32.c 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284334 4 -rw-r--r-- 1 ubuntu ubuntu 771 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/weighted_shuffle.h 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284064 8 -rw-r--r-- 1 ubuntu ubuntu 4663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/SloppyCRCMap.cc 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284145 12 -rw-r--r-- 1 ubuntu ubuntu 12220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/cohort_lru.h 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284121 16 -rw-r--r-- 1 ubuntu ubuntu 14874 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_argparse.cc 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284050 4 -rw-r--r-- 1 ubuntu ubuntu 1586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/OutputDataSocket.h 2024-03-27T21:32:59.316 INFO:teuthology.orchestra.run.smithi063.stdout: 284045 8 -rw-r--r-- 1 ubuntu ubuntu 6114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/LogEntry.h 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284155 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_fwd.h 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284290 4 -rw-r--r-- 1 ubuntu ubuntu 865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/run_cmd.h 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284286 4 -rw-r--r-- 1 ubuntu ubuntu 1032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ref.h 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284080 16 -rw-r--r-- 1 ubuntu ubuntu 14216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/TrackedOp.cc 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284091 4 -rw-r--r-- 1 ubuntu ubuntu 2217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/allocate_unique.h 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284119 64 -rw-r--r-- 1 ubuntu ubuntu 63893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/buffer.cc 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284152 44 -rw-r--r-- 1 ubuntu ubuntu 44610 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config.cc 2024-03-27T21:32:59.317 INFO:teuthology.orchestra.run.smithi063.stdout: 284160 4 -rw-r--r-- 1 ubuntu ubuntu 2281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_values.cc 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284016 8 -rw-r--r-- 1 ubuntu ubuntu 5470 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Continuation.h 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284308 4 -rw-r--r-- 1 ubuntu ubuntu 3395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/snap_types.h 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284023 8 -rw-r--r-- 1 ubuntu ubuntu 4705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/FastCDC.cc 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284077 4 -rw-r--r-- 1 ubuntu ubuntu 3185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Timer.h 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284221 4 -rw-r--r-- 1 ubuntu ubuntu 949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/item_history.h 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284201 4 -rw-r--r-- 1 ubuntu ubuntu 534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fd.h 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284255 44 -rw-r--r-- 1 ubuntu ubuntu 41792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/mds.yaml.in 2024-03-27T21:32:59.318 INFO:teuthology.orchestra.run.smithi063.stdout: 284245 4 -rw-r--r-- 1 ubuntu ubuntu 3569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/CMakeLists.txt 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284261 120 -rw-r--r-- 1 ubuntu ubuntu 121049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/rgw.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284260 24 -rw-r--r-- 1 ubuntu ubuntu 23168 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/rbd.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284256 12 -rw-r--r-- 1 ubuntu ubuntu 9820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/mgr.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284251 180 -rw-r--r-- 1 ubuntu ubuntu 183230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/global.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284257 40 -rw-r--r-- 1 ubuntu ubuntu 38597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/mon.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284250 4 -rw-r--r-- 1 ubuntu ubuntu 3843 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/crimson.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284254 16 -rw-r--r-- 1 ubuntu ubuntu 15171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/mds-client.yaml.in 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284246 4 -rw-r--r-- 1 ubuntu ubuntu 1792 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/build_options.cc 2024-03-27T21:32:59.319 INFO:teuthology.orchestra.run.smithi063.stdout: 284262 4 -rwxr-xr-x 1 ubuntu ubuntu 1235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/validate-options.py 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284258 52 -rw-r--r-- 1 ubuntu ubuntu 49617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/osd.yaml.in 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284248 4 -rw-r--r-- 1 ubuntu ubuntu 1120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/ceph-exporter.yaml.in 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284252 4 -rw-r--r-- 1 ubuntu ubuntu 2639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/immutable-object-cache.yaml.in 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284247 4 -rw-r--r-- 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/build_options.h 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284263 12 -rwxr-xr-x 1 ubuntu ubuntu 10377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/y2c.py 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284249 4 -rw-r--r-- 1 ubuntu ubuntu 3468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/cephfs-mirror.yaml.in 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284253 4 -rw-r--r-- 1 ubuntu ubuntu 398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/legacy_config_opts.h 2024-03-27T21:32:59.320 INFO:teuthology.orchestra.run.smithi063.stdout: 284259 8 -rw-r--r-- 1 ubuntu ubuntu 5426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options/rbd-mirror.yaml.in 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284186 4 -rw-r--r-- 1 ubuntu ubuntu 652 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/dummy.cc 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284311 24 -rw-r--r-- 1 ubuntu ubuntu 22268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/sstring.hh 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284238 44 -rw-r--r-- 1 ubuntu ubuntu 43800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/obj_bencher.cc 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284216 8 -rw-r--r-- 1 ubuntu ubuntu 7720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/interval_map.h 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284322 8 -rw-r--r-- 1 ubuntu ubuntu 5398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/tracer.h 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284147 4 -rw-r--r-- 1 ubuntu ubuntu 2802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/common_init.h 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284031 8 -rw-r--r-- 1 ubuntu ubuntu 4802 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Graylog.cc 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284242 12 -rw-r--r-- 1 ubuntu ubuntu 8445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/options.cc 2024-03-27T21:32:59.321 INFO:teuthology.orchestra.run.smithi063.stdout: 284051 8 -rw-r--r-- 1 ubuntu ubuntu 6167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/PluginRegistry.cc 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284269 4 -rw-r--r-- 1 ubuntu ubuntu 3119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters_cache.cc 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284004 4 -rw-r--r-- 1 ubuntu ubuntu 1492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/BackTrace.h 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284040 4 -rw-r--r-- 1 ubuntu ubuntu 1881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Journald.h 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284281 4 -rw-r--r-- 1 ubuntu ubuntu 1916 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/pretty_binary.cc 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284312 12 -rw-r--r-- 1 ubuntu ubuntu 10890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/static_ptr.h 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284131 24 -rw-r--r-- 1 ubuntu ubuntu 21286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_json.cc 2024-03-27T21:32:59.322 INFO:teuthology.orchestra.run.smithi063.stdout: 284136 12 -rw-r--r-- 1 ubuntu ubuntu 10931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_strings.cc 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284225 12 -rw-r--r-- 1 ubuntu ubuntu 10866 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/lockdep.cc 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284226 4 -rw-r--r-- 1 ubuntu ubuntu 1442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/lockdep.h 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284315 4 -rw-r--r-- 1 ubuntu ubuntu 923 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/strescape.h 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284213 4 -rw-r--r-- 1 ubuntu ubuntu 1014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/hostname.cc 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284267 20 -rw-r--r-- 1 ubuntu ubuntu 17224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters.cc 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284278 4 -rw-r--r-- 1 ubuntu ubuntu 3198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/pick_address.h 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284154 4 -rw-r--r-- 1 ubuntu ubuntu 1523 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_cacher.h 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284085 4 -rw-r--r-- 1 ubuntu ubuntu 3678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/addr_parsing.c 2024-03-27T21:32:59.323 INFO:teuthology.orchestra.run.smithi063.stdout: 284132 28 -rw-r--r-- 1 ubuntu ubuntu 25446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_json.h 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284272 4 -rw-r--r-- 1 ubuntu ubuntu 1351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters_collection.h 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284264 4 -rw-r--r-- 1 ubuntu ubuntu 335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ostream_temp.cc 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284333 8 -rw-r--r-- 1 ubuntu ubuntu 8120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/versioned_variant.h 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284276 8 -rw-r--r-- 1 ubuntu ubuntu 7206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_histogram.h 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284164 16 -rw-r--r-- 1 ubuntu ubuntu 15943 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c.cc 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284072 4 -rw-r--r-- 1 ubuntu ubuntu 1941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Thread.h 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284273 8 -rw-r--r-- 1 ubuntu ubuntu 6091 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters_key.cc 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284048 4 -rw-r--r-- 1 ubuntu ubuntu 2183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/OpQueue.h 2024-03-27T21:32:59.324 INFO:teuthology.orchestra.run.smithi063.stdout: 284209 4 -rw-r--r-- 1 ubuntu ubuntu 1415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/histogram.cc 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284163 8 -rw-r--r-- 1 ubuntu ubuntu 4309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/convenience.h 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284301 4 -rw-r--r-- 1 ubuntu ubuntu 1060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/shared_mutex_debug.h 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284000 4 -rw-r--r-- 1 ubuntu ubuntu 1041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/AsyncOpTracker.cc 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284199 8 -rw-r--r-- 1 ubuntu ubuntu 5559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fault_injector.h 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284084 20 -rw-r--r-- 1 ubuntu ubuntu 18509 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/WorkQueue.h 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284309 8 -rw-r--r-- 1 ubuntu ubuntu 5205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/solaris_errno.cc 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284130 4 -rw-r--r-- 1 ubuntu ubuntu 2949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_hash.cc 2024-03-27T21:32:59.325 INFO:teuthology.orchestra.run.smithi063.stdout: 284288 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/reverse.h 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284133 8 -rw-r--r-- 1 ubuntu ubuntu 6338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_mutex.h 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284313 4 -rw-r--r-- 1 ubuntu ubuntu 1638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/str_list.cc 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284079 4 -rw-r--r-- 1 ubuntu ubuntu 2258 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/TracepointProvider.h 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284055 16 -rw-r--r-- 1 ubuntu ubuntu 14280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/PriorityCache.cc 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284005 4 -rw-r--r-- 1 ubuntu ubuntu 1010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/CDC.cc 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284039 8 -rw-r--r-- 1 ubuntu ubuntu 8058 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Journald.cc 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284200 4 -rw-r--r-- 1 ubuntu ubuntu 1457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fd.cc 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284010 4 -rw-r--r-- 1 ubuntu ubuntu 3192 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/CommandTable.h 2024-03-27T21:32:59.326 INFO:teuthology.orchestra.run.smithi063.stdout: 284316 8 -rw-r--r-- 1 ubuntu ubuntu 7829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/strtol.cc 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284268 12 -rw-r--r-- 1 ubuntu ubuntu 11376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters.h 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284198 4 -rw-r--r-- 1 ubuntu ubuntu 1494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fair_mutex.h 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284332 4 -rw-r--r-- 1 ubuntu ubuntu 940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/version.h 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284325 4 -rw-r--r-- 1 ubuntu ubuntu 1438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/url_escape.cc 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284296 4 -rw-r--r-- 1 ubuntu ubuntu 236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/sctp_crc32.h 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284143 4 -rw-r--r-- 1 ubuntu ubuntu 2668 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/code_environment.cc 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284169 4 -rw-r--r-- 1 ubuntu ubuntu 1143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_intel_fast.c 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284065 4 -rw-r--r-- 1 ubuntu ubuntu 1964 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/SloppyCRCMap.h 2024-03-27T21:32:59.327 INFO:teuthology.orchestra.run.smithi063.stdout: 284224 4 -rw-r--r-- 1 ubuntu ubuntu 351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/linux_version.h 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284047 4 -rw-r--r-- 1 ubuntu ubuntu 1073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/MemoryModel.h 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284166 4 -rw-r--r-- 1 ubuntu ubuntu 445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_aarch64.h 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284037 4 -rw-r--r-- 1 ubuntu ubuntu 2828 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/HeartbeatMap.h 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284289 4 -rw-r--r-- 1 ubuntu ubuntu 2475 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/run_cmd.cc 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284057 4 -rw-r--r-- 1 ubuntu ubuntu 1362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/QueueRing.h 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284096 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284099 8 -rw-r--r-- 1 ubuntu ubuntu 7225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/blocked_completion.h 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284102 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/detail 2024-03-27T21:32:59.328 INFO:teuthology.orchestra.run.smithi063.stdout: 284103 8 -rw-r--r-- 1 ubuntu ubuntu 5078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/detail/shared_lock.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284104 12 -rw-r--r-- 1 ubuntu ubuntu 9317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/detail/shared_mutex.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284108 8 -rw-r--r-- 1 ubuntu ubuntu 5059 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/waiter.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284098 4 -rw-r--r-- 1 ubuntu ubuntu 1272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/bind_like.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284101 4 -rw-r--r-- 1 ubuntu ubuntu 2920 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/context_pool.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284106 4 -rw-r--r-- 1 ubuntu ubuntu 3105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/librados_completion.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284107 8 -rw-r--r-- 1 ubuntu ubuntu 6016 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/shared_mutex.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284105 4 -rw-r--r-- 1 ubuntu ubuntu 3119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/forward_handler.h 2024-03-27T21:32:59.329 INFO:teuthology.orchestra.run.smithi063.stdout: 284097 4 -rw-r--r-- 1 ubuntu ubuntu 3359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/bind_handler.h 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284100 16 -rw-r--r-- 1 ubuntu ubuntu 12854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/completion.h 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284109 4 -rw-r--r-- 1 ubuntu ubuntu 1767 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/async/yield_context.h 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284275 4 -rw-r--r-- 1 ubuntu ubuntu 3271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_histogram.cc 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284227 4 -rw-r--r-- 1 ubuntu ubuntu 2813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/lru_map.h 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284027 4 -rw-r--r-- 1 ubuntu ubuntu 464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/FixedCDC.cc 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284059 8 -rw-r--r-- 1 ubuntu ubuntu 5508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Readahead.cc 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284184 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/dout.cc 2024-03-27T21:32:59.330 INFO:teuthology.orchestra.run.smithi063.stdout: 284113 20 -rw-r--r-- 1 ubuntu ubuntu 18122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/bit_vector.hpp 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284183 8 -rw-r--r-- 1 ubuntu ubuntu 4743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/dns_resolve.h 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284229 8 -rw-r--r-- 1 ubuntu ubuntu 4469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/mempool.cc 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284073 24 -rw-r--r-- 1 ubuntu ubuntu 21092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Throttle.cc 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284178 4 -rw-r--r-- 1 ubuntu ubuntu 850 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/debug.h 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284159 4 -rw-r--r-- 1 ubuntu ubuntu 671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_tracker.h 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284299 12 -rw-r--r-- 1 ubuntu ubuntu 9272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/shared_cache.hpp 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284214 4 -rw-r--r-- 1 ubuntu ubuntu 601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/hostname.h 2024-03-27T21:32:59.331 INFO:teuthology.orchestra.run.smithi063.stdout: 284335 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284344 4 -rw-r--r-- 1 ubuntu ubuntu 3309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/ifaddrs.cc 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284349 4 -rw-r--r-- 1 ubuntu ubuntu 1598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/syslog.cc 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284340 4 -rw-r--r-- 1 ubuntu ubuntu 890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/dlfcn.cc 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284336 8 -rw-r--r-- 1 ubuntu ubuntu 7959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/SubProcess.cc 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284342 24 -rw-r--r-- 1 ubuntu ubuntu 22524 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/errno.cc 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284351 4 -rw-r--r-- 1 ubuntu ubuntu 444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/wstring.h 2024-03-27T21:32:59.332 INFO:teuthology.orchestra.run.smithi063.stdout: 284350 4 -rw-r--r-- 1 ubuntu ubuntu 656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/wstring.cc 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284346 4 -rw-r--r-- 1 ubuntu ubuntu 890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/registry.h 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284347 8 -rw-r--r-- 1 ubuntu ubuntu 4638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/service.cc 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284343 4 -rw-r--r-- 1 ubuntu ubuntu 574 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/event_logging.mc 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284348 4 -rw-r--r-- 1 ubuntu ubuntu 1240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/service.h 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284345 8 -rw-r--r-- 1 ubuntu ubuntu 4285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/registry.cc 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284338 4 -rw-r--r-- 1 ubuntu ubuntu 327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/code_page.manifest 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284339 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/code_page.rc 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284337 4 -rw-r--r-- 1 ubuntu ubuntu 2263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/blkdev.cc 2024-03-27T21:32:59.333 INFO:teuthology.orchestra.run.smithi063.stdout: 284341 4 -rw-r--r-- 1 ubuntu ubuntu 1588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/win32/dns_resolve.cc 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284054 12 -rw-r--r-- 1 ubuntu ubuntu 9480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/PrioritizedQueue.h 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284215 8 -rw-r--r-- 1 ubuntu ubuntu 7222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/inline_variant.h 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284176 4 -rw-r--r-- 1 ubuntu ubuntu 3457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_ppc_fast_zero_asm.S 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284305 4 -rw-r--r-- 1 ubuntu ubuntu 1410 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/signal.h 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284189 4 -rw-r--r-- 1 ubuntu ubuntu 942 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/environment.cc 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284069 4 -rw-r--r-- 1 ubuntu ubuntu 2242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/TextTable.cc 2024-03-27T21:32:59.334 INFO:teuthology.orchestra.run.smithi063.stdout: 284024 4 -rw-r--r-- 1 ubuntu ubuntu 1803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/FastCDC.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284141 20 -rw-r--r-- 1 ubuntu ubuntu 19223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/cmdparse.cc 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284071 8 -rw-r--r-- 1 ubuntu ubuntu 4861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Thread.cc 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284270 4 -rw-r--r-- 1 ubuntu ubuntu 3121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters_cache.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284118 8 -rw-r--r-- 1 ubuntu ubuntu 5718 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/bounded_key_counter.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284011 4 -rw-r--r-- 1 ubuntu ubuntu 3204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Cond.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284139 20 -rw-r--r-- 1 ubuntu ubuntu 19697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_time.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284068 4 -rw-r--r-- 1 ubuntu ubuntu 2902 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/SubProcess.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284094 4 -rw-r--r-- 1 ubuntu ubuntu 432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/armor.h 2024-03-27T21:32:59.335 INFO:teuthology.orchestra.run.smithi063.stdout: 284314 8 -rw-r--r-- 1 ubuntu ubuntu 4811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/str_map.cc 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284092 4 -rw-r--r-- 1 ubuntu ubuntu 202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/arch.h 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284207 4 -rw-r--r-- 1 ubuntu ubuntu 965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/hex.cc 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284220 4 -rw-r--r-- 1 ubuntu ubuntu 1803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/iso_8601.h 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284078 4 -rw-r--r-- 1 ubuntu ubuntu 1148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/TracepointProvider.cc 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284042 12 -rw-r--r-- 1 ubuntu ubuntu 9242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/LogClient.cc 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284123 4 -rw-r--r-- 1 ubuntu ubuntu 2655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_atomic.h 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284041 4 -rw-r--r-- 1 ubuntu ubuntu 3133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/LRUSet.h 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284298 4 -rw-r--r-- 1 ubuntu ubuntu 312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/secret.h 2024-03-27T21:32:59.336 INFO:teuthology.orchestra.run.smithi063.stdout: 284158 12 -rw-r--r-- 1 ubuntu ubuntu 10199 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_proxy.h 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284135 4 -rw-r--r-- 1 ubuntu ubuntu 2117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_releases.h 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284083 12 -rw-r--r-- 1 ubuntu ubuntu 10365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/WorkQueue.cc 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284043 8 -rw-r--r-- 1 ubuntu ubuntu 6440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/LogClient.h 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284168 4 -rw-r--r-- 1 ubuntu ubuntu 299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_intel_baseline.h 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284271 4 -rw-r--r-- 1 ubuntu ubuntu 1808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters_collection.cc 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284283 4 -rw-r--r-- 1 ubuntu ubuntu 717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ptr_wrapper.h 2024-03-27T21:32:59.337 INFO:teuthology.orchestra.run.smithi063.stdout: 284138 12 -rw-r--r-- 1 ubuntu ubuntu 9023 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_time.cc 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284127 8 -rw-r--r-- 1 ubuntu ubuntu 5791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_crypto.h 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284134 4 -rw-r--r-- 1 ubuntu ubuntu 1577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_releases.cc 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284326 4 -rw-r--r-- 1 ubuntu ubuntu 240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/url_escape.h 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284193 8 -rw-r--r-- 1 ubuntu ubuntu 5577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/error_code.cc 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284019 4 -rw-r--r-- 1 ubuntu ubuntu 1755 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/DecayCounter.cc 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284297 4 -rw-r--r-- 1 ubuntu ubuntu 2024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/secret.c 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284114 28 -rw-r--r-- 1 ubuntu ubuntu 27143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/blkdev.cc 2024-03-27T21:32:59.338 INFO:teuthology.orchestra.run.smithi063.stdout: 284233 4 -rw-r--r-- 1 ubuntu ubuntu 576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/module.h 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284212 16 -rw-r--r-- 1 ubuntu ubuntu 15191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/hobject.h 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284008 8 -rw-r--r-- 1 ubuntu ubuntu 6958 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Checksummer.h 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284066 8 -rw-r--r-- 1 ubuntu ubuntu 4934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/StackStringStream.h 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284034 4 -rw-r--r-- 1 ubuntu ubuntu 3603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/HTMLFormatter.cc 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284122 4 -rw-r--r-- 1 ubuntu ubuntu 3045 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_argparse.h 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284174 16 -rw-r--r-- 1 ubuntu ubuntu 14816 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_ppc_asm.S 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284128 4 -rw-r--r-- 1 ubuntu ubuntu 336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_frag.cc 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284204 12 -rw-r--r-- 1 ubuntu ubuntu 10162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/freebsd_errno.cc 2024-03-27T21:32:59.339 INFO:teuthology.orchestra.run.smithi063.stdout: 284196 4 -rw-r--r-- 1 ubuntu ubuntu 2043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/escape.h 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284292 4 -rw-r--r-- 1 ubuntu ubuntu 2482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/safe_io.h 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284049 12 -rw-r--r-- 1 ubuntu ubuntu 10488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/OutputDataSocket.cc 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284236 8 -rw-r--r-- 1 ubuntu ubuntu 5230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/numa.cc 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284161 4 -rw-r--r-- 1 ubuntu ubuntu 3254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_values.h 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284003 4 -rw-r--r-- 1 ubuntu ubuntu 2248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/BackTrace.cc 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284088 8 -rw-r--r-- 1 ubuntu ubuntu 4598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/admin_socket_client.cc 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284318 4 -rw-r--r-- 1 ubuntu ubuntu 3084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/subsys.h 2024-03-27T21:32:59.340 INFO:teuthology.orchestra.run.smithi063.stdout: 284060 8 -rw-r--r-- 1 ubuntu ubuntu 5113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Readahead.h 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284206 4 -rw-r--r-- 1 ubuntu ubuntu 1474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/function_signature.h 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284177 8 -rw-r--r-- 1 ubuntu ubuntu 5457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/darwin_errno.cc 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284110 12 -rw-r--r-- 1 ubuntu ubuntu 8854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/autovector.h 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284022 4 -rw-r--r-- 1 ubuntu ubuntu 2594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/EventTrace.h 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284093 4 -rw-r--r-- 1 ubuntu ubuntu 2454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/armor.c 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284044 12 -rw-r--r-- 1 ubuntu ubuntu 8443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/LogEntry.cc 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284241 4 -rw-r--r-- 1 ubuntu ubuntu 633 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/openssl_opts_handler.h 2024-03-27T21:32:59.341 INFO:teuthology.orchestra.run.smithi063.stdout: 284284 4 -rw-r--r-- 1 ubuntu ubuntu 3907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/random_string.cc 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284035 4 -rw-r--r-- 1 ubuntu ubuntu 1201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/HTMLFormatter.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284156 4 -rw-r--r-- 1 ubuntu ubuntu 1819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config_obs.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284063 4 -rw-r--r-- 1 ubuntu ubuntu 864 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Semaphore.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284061 4 -rw-r--r-- 1 ubuntu ubuntu 1025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/RefCountedObj.cc 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284317 4 -rw-r--r-- 1 ubuntu ubuntu 3318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/strtol.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284280 4 -rw-r--r-- 1 ubuntu ubuntu 2567 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ppc-opcode.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284320 4 -rw-r--r-- 1 ubuntu ubuntu 1314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/sync_filesystem.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284173 4 -rw-r--r-- 1 ubuntu ubuntu 577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_ppc.h 2024-03-27T21:32:59.342 INFO:teuthology.orchestra.run.smithi063.stdout: 284172 4 -rw-r--r-- 1 ubuntu ubuntu 3676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_ppc.c 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284218 8 -rw-r--r-- 1 ubuntu ubuntu 4515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ipaddr.cc 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284111 4 -rw-r--r-- 1 ubuntu ubuntu 1710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/bit_str.cc 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284234 4 -rw-r--r-- 1 ubuntu ubuntu 1508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/mutex_debug.cc 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284026 8 -rw-r--r-- 1 ubuntu ubuntu 6739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Finisher.h 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284219 8 -rw-r--r-- 1 ubuntu ubuntu 4735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/iso_8601.cc 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284265 4 -rw-r--r-- 1 ubuntu ubuntu 1379 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ostream_temp.h 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284020 4 -rw-r--r-- 1 ubuntu ubuntu 2902 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/DecayCounter.h 2024-03-27T21:32:59.343 INFO:teuthology.orchestra.run.smithi063.stdout: 284232 4 -rw-r--r-- 1 ubuntu ubuntu 2084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/module.c 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284140 12 -rw-r--r-- 1 ubuntu ubuntu 9144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_timer.h 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284125 12 -rw-r--r-- 1 ubuntu ubuntu 10853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_context.h 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284293 8 -rw-r--r-- 1 ubuntu ubuntu 7180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/scrub_types.cc 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284124 32 -rw-r--r-- 1 ubuntu ubuntu 30193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ceph_context.cc 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284001 4 -rw-r--r-- 1 ubuntu ubuntu 1018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/AsyncOpTracker.h 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284210 4 -rw-r--r-- 1 ubuntu ubuntu 2973 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/histogram.h 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284076 8 -rw-r--r-- 1 ubuntu ubuntu 6609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Timer.cc 2024-03-27T21:32:59.344 INFO:teuthology.orchestra.run.smithi063.stdout: 284240 8 -rw-r--r-- 1 ubuntu ubuntu 4164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/openssl_opts_handler.cc 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284148 16 -rw-r--r-- 1 ubuntu ubuntu 12911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/compat.cc 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284153 16 -rw-r--r-- 1 ubuntu ubuntu 13127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/config.h 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284116 4 -rw-r--r-- 1 ubuntu ubuntu 3722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/bloom_filter.cc 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284274 8 -rw-r--r-- 1 ubuntu ubuntu 4245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/perf_counters_key.h 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284090 8 -rw-r--r-- 1 ubuntu ubuntu 5361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/aix_errno.cc 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284165 12 -rw-r--r-- 1 ubuntu ubuntu 8681 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_aarch64.c 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284017 8 -rw-r--r-- 1 ubuntu ubuntu 7888 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Cycles.cc 2024-03-27T21:32:59.345 INFO:teuthology.orchestra.run.smithi063.stdout: 284015 4 -rw-r--r-- 1 ubuntu ubuntu 957 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ContextCompletion.h 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284194 8 -rw-r--r-- 1 ubuntu ubuntu 4341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/error_code.h 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284237 4 -rw-r--r-- 1 ubuntu ubuntu 634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/numa.h 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284300 4 -rw-r--r-- 1 ubuntu ubuntu 3780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/shared_mutex_debug.cc 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284329 12 -rw-r--r-- 1 ubuntu ubuntu 11412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/util.cc 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284321 4 -rw-r--r-- 1 ubuntu ubuntu 3747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/tracer.cc 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284058 8 -rw-r--r-- 1 ubuntu ubuntu 6180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/RWLock.h 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284310 4 -rw-r--r-- 1 ubuntu ubuntu 2899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/split.h 2024-03-27T21:32:59.346 INFO:teuthology.orchestra.run.smithi063.stdout: 284205 8 -rw-r--r-- 1 ubuntu ubuntu 4209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/fs_types.cc 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284304 4 -rw-r--r-- 1 ubuntu ubuntu 2257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/signal.cc 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284036 8 -rw-r--r-- 1 ubuntu ubuntu 5379 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/HeartbeatMap.cc 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284171 28 -rw-r--r-- 1 ubuntu ubuntu 25455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/crc32c_intel_fast_zero_asm.s 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284075 4 -rw-r--r-- 1 ubuntu ubuntu 606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/ThrottleInterface.h 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284081 16 -rw-r--r-- 1 ubuntu ubuntu 13095 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/TrackedOp.h 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284144 4 -rw-r--r-- 1 ubuntu ubuntu 1173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/code_environment.h 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284179 8 -rw-r--r-- 1 ubuntu ubuntu 7899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/deleter.h 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284052 4 -rw-r--r-- 1 ubuntu ubuntu 1844 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/PluginRegistry.h 2024-03-27T21:32:59.347 INFO:teuthology.orchestra.run.smithi063.stdout: 284182 12 -rw-r--r-- 1 ubuntu ubuntu 9264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/dns_resolve.cc 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 284038 4 -rw-r--r-- 1 ubuntu ubuntu 4046 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/common/Initialize.h 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283860 4 drwxr-xr-x 24 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283925 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283928 4 -rw-r--r-- 1 ubuntu ubuntu 2404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp/cls_otp_client.h 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283929 4 -rw-r--r-- 1 ubuntu ubuntu 3707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp/cls_otp_ops.h 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283926 16 -rw-r--r-- 1 ubuntu ubuntu 13535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp/cls_otp.cc 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283930 4 -rw-r--r-- 1 ubuntu ubuntu 1811 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp/cls_otp_types.cc 2024-03-27T21:32:59.348 INFO:teuthology.orchestra.run.smithi063.stdout: 283927 8 -rw-r--r-- 1 ubuntu ubuntu 5178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp/cls_otp_client.cc 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283931 4 -rw-r--r-- 1 ubuntu ubuntu 3717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/otp/cls_otp_types.h 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283972 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/test_remote_reads 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283973 4 -rw-r--r-- 1 ubuntu ubuntu 2571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/test_remote_reads/cls_test_remote_reads.cc 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283876 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cephfs 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283879 8 -rw-r--r-- 1 ubuntu ubuntu 5704 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cephfs/cls_cephfs_client.cc 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283878 4 -rw-r--r-- 1 ubuntu ubuntu 3249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cephfs/cls_cephfs.h 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283877 8 -rw-r--r-- 1 ubuntu ubuntu 5239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cephfs/cls_cephfs.cc 2024-03-27T21:32:59.349 INFO:teuthology.orchestra.run.smithi063.stdout: 283880 4 -rw-r--r-- 1 ubuntu ubuntu 907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cephfs/cls_cephfs_client.h 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283868 12 -rw-r--r-- 1 ubuntu ubuntu 10713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/CMakeLists.txt 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283948 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/refcount 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283951 4 -rw-r--r-- 1 ubuntu ubuntu 2298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/refcount/cls_refcount_client.h 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283950 4 -rw-r--r-- 1 ubuntu ubuntu 1498 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/refcount/cls_refcount_client.cc 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283952 4 -rw-r--r-- 1 ubuntu ubuntu 2675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/refcount/cls_refcount_ops.cc 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283949 8 -rw-r--r-- 1 ubuntu ubuntu 4924 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/refcount/cls_refcount.cc 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283953 4 -rw-r--r-- 1 ubuntu ubuntu 3762 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/refcount/cls_refcount_ops.h 2024-03-27T21:32:59.350 INFO:teuthology.orchestra.run.smithi063.stdout: 283900 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283907 8 -rw-r--r-- 1 ubuntu ubuntu 5432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock_types.h 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283905 8 -rw-r--r-- 1 ubuntu ubuntu 6144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock_ops.h 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283904 8 -rw-r--r-- 1 ubuntu ubuntu 5901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock_ops.cc 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283906 4 -rw-r--r-- 1 ubuntu ubuntu 2554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock_types.cc 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283903 8 -rw-r--r-- 1 ubuntu ubuntu 5196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock_client.h 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283902 12 -rw-r--r-- 1 ubuntu ubuntu 8471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock_client.cc 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283901 16 -rw-r--r-- 1 ubuntu ubuntu 16306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lock/cls_lock.cc 2024-03-27T21:32:59.351 INFO:teuthology.orchestra.run.smithi063.stdout: 283921 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/numops 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283922 4 -rw-r--r-- 1 ubuntu ubuntu 3970 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/numops/cls_numops.cc 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283924 4 -rw-r--r-- 1 ubuntu ubuntu 1447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/numops/cls_numops_client.h 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283923 4 -rw-r--r-- 1 ubuntu ubuntu 1970 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/numops/cls_numops_client.cc 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283970 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/sdk 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283971 4 -rw-r--r-- 1 ubuntu ubuntu 2984 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/sdk/cls_sdk.cc 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283892 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/hello 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283893 12 -rw-r--r-- 1 ubuntu ubuntu 11371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/hello/cls_hello.cc 2024-03-27T21:32:59.352 INFO:teuthology.orchestra.run.smithi063.stdout: 283954 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283955 144 -rw-r--r-- 1 ubuntu ubuntu 144322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw.cc 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283957 28 -rw-r--r-- 1 ubuntu ubuntu 27311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_client.h 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283959 16 -rw-r--r-- 1 ubuntu ubuntu 15556 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_ops.cc 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283961 28 -rw-r--r-- 1 ubuntu ubuntu 25931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_types.cc 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283958 4 -rw-r--r-- 1 ubuntu ubuntu 2787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_const.h 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283960 44 -rw-r--r-- 1 ubuntu ubuntu 43504 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_ops.h 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283962 40 -rw-r--r-- 1 ubuntu ubuntu 37386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_types.h 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283956 36 -rw-r--r-- 1 ubuntu ubuntu 35165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw/cls_rgw_client.cc 2024-03-27T21:32:59.353 INFO:teuthology.orchestra.run.smithi063.stdout: 283861 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283864 8 -rw-r--r-- 1 ubuntu ubuntu 5596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue/cls_2pc_queue_client.h 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283865 4 -rw-r--r-- 1 ubuntu ubuntu 594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue/cls_2pc_queue_const.h 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283863 8 -rw-r--r-- 1 ubuntu ubuntu 7367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue/cls_2pc_queue_client.cc 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283866 8 -rw-r--r-- 1 ubuntu ubuntu 5648 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue/cls_2pc_queue_ops.h 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283867 4 -rw-r--r-- 1 ubuntu ubuntu 3368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue/cls_2pc_queue_types.h 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283862 24 -rw-r--r-- 1 ubuntu ubuntu 24471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/2pc_queue/cls_2pc_queue.cc 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283914 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283918 4 -rw-r--r-- 1 ubuntu ubuntu 333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua/cls_lua_client.h 2024-03-27T21:32:59.354 INFO:teuthology.orchestra.run.smithi063.stdout: 283917 4 -rw-r--r-- 1 ubuntu ubuntu 953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua/cls_lua_client.cc 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283915 28 -rw-r--r-- 1 ubuntu ubuntu 25597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua/cls_lua.cc 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283920 4 -rw-r--r-- 1 ubuntu ubuntu 3757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua/lua_bufferlist.cc 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283916 4 -rw-r--r-- 1 ubuntu ubuntu 300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua/cls_lua.h 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283919 4 -rw-r--r-- 1 ubuntu ubuntu 582 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/lua/cls_lua_ops.h 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283974 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283979 4 -rw-r--r-- 1 ubuntu ubuntu 543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex/cls_timeindex_types.cc 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283977 4 -rw-r--r-- 1 ubuntu ubuntu 2571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex/cls_timeindex_client.h 2024-03-27T21:32:59.355 INFO:teuthology.orchestra.run.smithi063.stdout: 283978 4 -rw-r--r-- 1 ubuntu ubuntu 4093 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex/cls_timeindex_ops.h 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283975 8 -rw-r--r-- 1 ubuntu ubuntu 6232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex/cls_timeindex.cc 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283976 4 -rw-r--r-- 1 ubuntu ubuntu 2730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex/cls_timeindex_client.cc 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283980 4 -rw-r--r-- 1 ubuntu ubuntu 1176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/timeindex/cls_timeindex_types.h 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283981 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283985 4 -rw-r--r-- 1 ubuntu ubuntu 3204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user_ops.cc 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283984 4 -rw-r--r-- 1 ubuntu ubuntu 1284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user_client.h 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283987 4 -rw-r--r-- 1 ubuntu ubuntu 2995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user_types.cc 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283988 8 -rw-r--r-- 1 ubuntu ubuntu 6382 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user_types.h 2024-03-27T21:32:59.356 INFO:teuthology.orchestra.run.smithi063.stdout: 283986 8 -rw-r--r-- 1 ubuntu ubuntu 6495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user_ops.h 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283983 8 -rw-r--r-- 1 ubuntu ubuntu 4490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user_client.cc 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283982 16 -rw-r--r-- 1 ubuntu ubuntu 13953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/user/cls_user.cc 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283963 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283965 4 -rw-r--r-- 1 ubuntu ubuntu 2817 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc/cls_rgw_gc_client.cc 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283964 20 -rw-r--r-- 1 ubuntu ubuntu 19778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc/cls_rgw_gc.cc 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283968 4 -rw-r--r-- 1 ubuntu ubuntu 1975 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc/cls_rgw_gc_ops.h 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283967 4 -rw-r--r-- 1 ubuntu ubuntu 432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc/cls_rgw_gc_const.h 2024-03-27T21:32:59.357 INFO:teuthology.orchestra.run.smithi063.stdout: 283969 4 -rw-r--r-- 1 ubuntu ubuntu 1819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc/cls_rgw_gc_types.h 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283966 4 -rw-r--r-- 1 ubuntu ubuntu 1093 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rgw_gc/cls_rgw_gc_client.h 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283932 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283933 4 -rw-r--r-- 1 ubuntu ubuntu 3702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue.cc 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283937 8 -rw-r--r-- 1 ubuntu ubuntu 6154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_ops.h 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283935 4 -rw-r--r-- 1 ubuntu ubuntu 1089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_client.h 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283940 8 -rw-r--r-- 1 ubuntu ubuntu 4366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_types.h 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283934 4 -rw-r--r-- 1 ubuntu ubuntu 2962 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_client.cc 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283936 4 -rw-r--r-- 1 ubuntu ubuntu 319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_const.h 2024-03-27T21:32:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: 283938 20 -rw-r--r-- 1 ubuntu ubuntu 19710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_src.cc 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283939 4 -rw-r--r-- 1 ubuntu ubuntu 832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/queue/cls_queue_src.h 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283894 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/journal 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283898 8 -rw-r--r-- 1 ubuntu ubuntu 4976 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/journal/cls_journal_types.cc 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283897 8 -rw-r--r-- 1 ubuntu ubuntu 4807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/journal/cls_journal_client.h 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283896 16 -rw-r--r-- 1 ubuntu ubuntu 14026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/journal/cls_journal_client.cc 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283899 8 -rw-r--r-- 1 ubuntu ubuntu 4645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/journal/cls_journal_types.h 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283895 36 -rw-r--r-- 1 ubuntu ubuntu 35914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/journal/cls_journal.cc 2024-03-27T21:32:59.359 INFO:teuthology.orchestra.run.smithi063.stdout: 283888 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/fifo 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283891 20 -rw-r--r-- 1 ubuntu ubuntu 16656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/fifo/cls_fifo_types.h 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283889 24 -rw-r--r-- 1 ubuntu ubuntu 24562 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/fifo/cls_fifo.cc 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283890 12 -rw-r--r-- 1 ubuntu ubuntu 9127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/fifo/cls_fifo_ops.h 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283941 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283943 8 -rw-r--r-- 1 ubuntu ubuntu 7846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd/cls_rbd.h 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283944 80 -rw-r--r-- 1 ubuntu ubuntu 78107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd/cls_rbd_client.cc 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283942 232 -rw-r--r-- 1 ubuntu ubuntu 234089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd/cls_rbd.cc 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283945 40 -rw-r--r-- 1 ubuntu ubuntu 37002 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd/cls_rbd_client.h 2024-03-27T21:32:59.360 INFO:teuthology.orchestra.run.smithi063.stdout: 283946 40 -rw-r--r-- 1 ubuntu ubuntu 40161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd/cls_rbd_types.cc 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283947 32 -rw-r--r-- 1 ubuntu ubuntu 31366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/rbd/cls_rbd_types.h 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283869 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283870 8 -rw-r--r-- 1 ubuntu ubuntu 5029 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas/cls_cas.cc 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283872 4 -rw-r--r-- 1 ubuntu ubuntu 981 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas/cls_cas_client.h 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283873 4 -rw-r--r-- 1 ubuntu ubuntu 2878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas/cls_cas_internal.cc 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283871 4 -rw-r--r-- 1 ubuntu ubuntu 1419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas/cls_cas_client.cc 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283875 4 -rw-r--r-- 1 ubuntu ubuntu 2451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas/cls_cas_ops.h 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283874 12 -rw-r--r-- 1 ubuntu ubuntu 10261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cas/cls_cas_internal.h 2024-03-27T21:32:59.361 INFO:teuthology.orchestra.run.smithi063.stdout: 283881 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283882 4 -rw-r--r-- 1 ubuntu ubuntu 274 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap/CMakeLists.txt 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283887 4 -rw-r--r-- 1 ubuntu ubuntu 1265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap/types.h 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283884 4 -rw-r--r-- 1 ubuntu ubuntu 2780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap/client.h 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283883 4 -rw-r--r-- 1 ubuntu ubuntu 1889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap/client.cc 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283886 12 -rw-r--r-- 1 ubuntu ubuntu 8775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap/server.cc 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283885 4 -rw-r--r-- 1 ubuntu ubuntu 2204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/cmpomap/ops.h 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283908 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/log 2024-03-27T21:32:59.362 INFO:teuthology.orchestra.run.smithi063.stdout: 283911 4 -rw-r--r-- 1 ubuntu ubuntu 1710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/log/cls_log_client.h 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283913 4 -rw-r--r-- 1 ubuntu ubuntu 2980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/log/cls_log_types.h 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283910 4 -rw-r--r-- 1 ubuntu ubuntu 4094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/log/cls_log_client.cc 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283912 8 -rw-r--r-- 1 ubuntu ubuntu 6204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/log/cls_log_ops.h 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283909 8 -rw-r--r-- 1 ubuntu ubuntu 7318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/log/cls_log.cc 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283989 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283994 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version/cls_version_types.cc 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283993 4 -rw-r--r-- 1 ubuntu ubuntu 3570 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version/cls_version_ops.h 2024-03-27T21:32:59.363 INFO:teuthology.orchestra.run.smithi063.stdout: 283990 8 -rw-r--r-- 1 ubuntu ubuntu 5503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version/cls_version.cc 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283992 4 -rw-r--r-- 1 ubuntu ubuntu 1075 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version/cls_version_client.h 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283991 4 -rw-r--r-- 1 ubuntu ubuntu 2202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version/cls_version_client.cc 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283995 4 -rw-r--r-- 1 ubuntu ubuntu 2353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/cls/version/cls_version_types.h 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283697 8 -rw-r--r-- 1 ubuntu ubuntu 6846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph_common.sh 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283389 4 -rw-r--r-- 1 ubuntu ubuntu 2096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/ceph-debugpack.in 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283358 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/bash_completion 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283361 4 -rw-r--r-- 1 ubuntu ubuntu 1190 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/bash_completion/rados 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283359 4 -rw-r--r-- 1 ubuntu ubuntu 244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/bash_completion/CMakeLists.txt 2024-03-27T21:32:59.364 INFO:teuthology.orchestra.run.smithi063.stdout: 283362 4 -rw-r--r-- 1 ubuntu ubuntu 1825 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/bash_completion/radosgw-admin 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 283360 4 -rw-r--r-- 1 ubuntu ubuntu 1488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/bash_completion/ceph 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 283363 4 -rw-r--r-- 1 ubuntu ubuntu 2754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/bash_completion/rbd 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 283303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/arrow 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 285880 12 drwxr-xr-x 2 ubuntu ubuntu 12288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 286018 4 -rw-r--r-- 1 ubuntu ubuntu 2197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGPushReply.h 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 286046 4 -rw-r--r-- 1 ubuntu ubuntu 1034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MServiceMap.h 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 285936 4 -rw-r--r-- 1 ubuntu ubuntu 2285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSFragmentNotify.h 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 285934 4 -rw-r--r-- 1 ubuntu ubuntu 1601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSFindIno.h 2024-03-27T21:32:59.365 INFO:teuthology.orchestra.run.smithi063.stdout: 285987 4 -rw-r--r-- 1 ubuntu ubuntu 1362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonUsedPendingKeys.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 286051 4 -rw-r--r-- 1 ubuntu ubuntu 2728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MWatchNotify.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 285975 4 -rw-r--r-- 1 ubuntu ubuntu 1357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonHealthChecks.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 285897 4 -rw-r--r-- 1 ubuntu ubuntu 2106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientSnap.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 285926 4 -rw-r--r-- 1 ubuntu ubuntu 1806 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MHeartbeat.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 285960 4 -rw-r--r-- 1 ubuntu ubuntu 1470 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrMap.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 286028 4 -rw-r--r-- 1 ubuntu ubuntu 3400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGUpdateLogMissing.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 286016 4 -rw-r--r-- 1 ubuntu ubuntu 2426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGPull.h 2024-03-27T21:32:59.366 INFO:teuthology.orchestra.run.smithi063.stdout: 285894 16 -rw-r--r-- 1 ubuntu ubuntu 12868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientRequest.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285910 4 -rw-r--r-- 1 ubuntu ubuntu 1686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirCancel.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285973 4 -rw-r--r-- 1 ubuntu ubuntu 1309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGlobalID.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 286020 4 -rw-r--r-- 1 ubuntu ubuntu 1761 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGQuery2.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285996 4 -rw-r--r-- 1 ubuntu ubuntu 3391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDFailure.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285881 4 -rw-r--r-- 1 ubuntu ubuntu 1750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MAuth.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285931 4 -rw-r--r-- 1 ubuntu ubuntu 1489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MLogAck.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 286052 4 -rw-r--r-- 1 ubuntu ubuntu 1661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/PaxosServiceMessage.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285955 4 -rw-r--r-- 1 ubuntu ubuntu 1227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrClose.h 2024-03-27T21:32:59.367 INFO:teuthology.orchestra.run.smithi063.stdout: 285988 4 -rw-r--r-- 1 ubuntu ubuntu 1364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDAlive.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285980 4 -rw-r--r-- 1 ubuntu ubuntu 3080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonPing.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285957 4 -rw-r--r-- 1 ubuntu ubuntu 1102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrCommandReply.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285972 4 -rw-r--r-- 1 ubuntu ubuntu 1633 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGetVersionReply.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285998 4 -rw-r--r-- 1 ubuntu ubuntu 3127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDForceRecovery.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285927 4 -rw-r--r-- 1 ubuntu ubuntu 1787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MInodeFileCaps.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285979 8 -rw-r--r-- 1 ubuntu ubuntu 4178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonPaxos.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285917 4 -rw-r--r-- 1 ubuntu ubuntu 1876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirPrepAck.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 285937 4 -rw-r--r-- 1 ubuntu ubuntu 1778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSFragmentNotifyAck.h 2024-03-27T21:32:59.368 INFO:teuthology.orchestra.run.smithi063.stdout: 286029 4 -rw-r--r-- 1 ubuntu ubuntu 3067 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGUpdateLogMissingReply.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 286009 4 -rw-r--r-- 1 ubuntu ubuntu 1980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGInfo.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 285921 4 -rw-r--r-- 1 ubuntu ubuntu 976 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MGatherCaps.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 285947 4 -rw-r--r-- 1 ubuntu ubuntu 1455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSQuiesceDbListing.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 286001 4 -rw-r--r-- 1 ubuntu ubuntu 1600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDMarkMeDead.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 285923 4 -rw-r--r-- 1 ubuntu ubuntu 1219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MGetConfig.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 285935 4 -rw-r--r-- 1 ubuntu ubuntu 1633 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSFindInoReply.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 285985 4 -rw-r--r-- 1 ubuntu ubuntu 1450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonSubscribeAck.h 2024-03-27T21:32:59.369 INFO:teuthology.orchestra.run.smithi063.stdout: 285942 4 -rw-r--r-- 1 ubuntu ubuntu 1723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSOpenIno.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 285893 12 -rw-r--r-- 1 ubuntu ubuntu 11222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientReply.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 285896 4 -rw-r--r-- 1 ubuntu ubuntu 3720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientSession.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 285898 4 -rw-r--r-- 1 ubuntu ubuntu 1335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MCommand.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 286038 4 -rw-r--r-- 1 ubuntu ubuntu 2746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MPGStats.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 285999 4 -rw-r--r-- 1 ubuntu ubuntu 1419 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDFull.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 286042 4 -rw-r--r-- 1 ubuntu ubuntu 2209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MPoolOpReply.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 285884 4 -rw-r--r-- 1 ubuntu ubuntu 3254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MCacheExpire.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 285900 4 -rw-r--r-- 1 ubuntu ubuntu 1167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MConfig.h 2024-03-27T21:32:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: 286021 4 -rw-r--r-- 1 ubuntu ubuntu 1812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGReadyToMerge.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 286040 4 -rw-r--r-- 1 ubuntu ubuntu 791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MPing.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 285892 8 -rw-r--r-- 1 ubuntu ubuntu 4489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientReconnect.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 285909 4 -rw-r--r-- 1 ubuntu ubuntu 1603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirAck.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 285904 4 -rw-r--r-- 1 ubuntu ubuntu 2849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MDiscover.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 285976 4 -rw-r--r-- 1 ubuntu ubuntu 2725 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonJoin.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 285969 4 -rw-r--r-- 1 ubuntu ubuntu 1102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGetPurgedSnaps.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 285913 4 -rw-r--r-- 1 ubuntu ubuntu 1821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirFinish.h 2024-03-27T21:32:59.371 INFO:teuthology.orchestra.run.smithi063.stdout: 286014 4 -rw-r--r-- 1 ubuntu ubuntu 2294 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGNotify.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 285948 8 -rw-r--r-- 1 ubuntu ubuntu 4552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSResolve.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 285888 4 -rw-r--r-- 1 ubuntu ubuntu 1446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientMetrics.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 286033 4 -rw-r--r-- 1 ubuntu ubuntu 4049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDRepOpReply.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 285956 4 -rw-r--r-- 1 ubuntu ubuntu 988 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrCommand.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 286049 4 -rw-r--r-- 1 ubuntu ubuntu 2211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MTimeCheck.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 286031 8 -rw-r--r-- 1 ubuntu ubuntu 4653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPing.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 285952 4 -rw-r--r-- 1 ubuntu ubuntu 1724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSSnapUpdate.h 2024-03-27T21:32:59.372 INFO:teuthology.orchestra.run.smithi063.stdout: 285903 4 -rw-r--r-- 1 ubuntu ubuntu 2972 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MDirUpdate.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 286011 4 -rw-r--r-- 1 ubuntu ubuntu 1589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGLease.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 285939 4 -rw-r--r-- 1 ubuntu ubuntu 2557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSMap.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 286027 4 -rw-r--r-- 1 ubuntu ubuntu 2112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGTrim.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 285906 4 -rw-r--r-- 1 ubuntu ubuntu 1783 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportCaps.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 285905 8 -rw-r--r-- 1 ubuntu ubuntu 6051 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MDiscoverReply.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 286008 4 -rw-r--r-- 1 ubuntu ubuntu 981 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGCreated.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 286037 4 -rw-r--r-- 1 ubuntu ubuntu 3181 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDScrubReserve.h 2024-03-27T21:32:59.373 INFO:teuthology.orchestra.run.smithi063.stdout: 285889 4 -rw-r--r-- 1 ubuntu ubuntu 1350 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientQuota.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 285891 4 -rw-r--r-- 1 ubuntu ubuntu 2071 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientReclaimReply.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 285953 4 -rw-r--r-- 1 ubuntu ubuntu 1933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSTableRequest.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 286047 4 -rw-r--r-- 1 ubuntu ubuntu 1937 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MStatfs.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 285890 4 -rw-r--r-- 1 ubuntu ubuntu 1934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientReclaim.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 286000 8 -rw-r--r-- 1 ubuntu ubuntu 5746 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDMap.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 286036 4 -rw-r--r-- 1 ubuntu ubuntu 1559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDScrub2.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 285929 4 -rw-r--r-- 1 ubuntu ubuntu 3334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MLock.h 2024-03-27T21:32:59.374 INFO:teuthology.orchestra.run.smithi063.stdout: 285967 4 -rw-r--r-- 1 ubuntu ubuntu 977 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGetMap.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 285925 4 -rw-r--r-- 1 ubuntu ubuntu 1956 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MGetPoolStatsReply.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 285924 4 -rw-r--r-- 1 ubuntu ubuntu 1479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MGetPoolStats.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 285970 4 -rw-r--r-- 1 ubuntu ubuntu 1310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGetPurgedSnapsReply.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 285974 4 -rw-r--r-- 1 ubuntu ubuntu 1532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonHealth.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 285982 4 -rw-r--r-- 1 ubuntu ubuntu 1557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonQuorumService.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 286026 4 -rw-r--r-- 1 ubuntu ubuntu 1737 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGTemp.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 286002 4 -rw-r--r-- 1 ubuntu ubuntu 2937 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDMarkMeDown.h 2024-03-27T21:32:59.375 INFO:teuthology.orchestra.run.smithi063.stdout: 285928 4 -rw-r--r-- 1 ubuntu ubuntu 1233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MKVData.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285963 4 -rw-r--r-- 1 ubuntu ubuntu 2142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrUpdate.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285958 4 -rw-r--r-- 1 ubuntu ubuntu 2512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrConfigure.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285914 4 -rw-r--r-- 1 ubuntu ubuntu 2724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirNotify.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285989 4 -rw-r--r-- 1 ubuntu ubuntu 2295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDBackoff.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285901 4 -rw-r--r-- 1 ubuntu ubuntu 2173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MDentryLink.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285997 4 -rw-r--r-- 1 ubuntu ubuntu 548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDFastDispatchOp.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285944 8 -rw-r--r-- 1 ubuntu ubuntu 8015 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSPeerRequest.h 2024-03-27T21:32:59.376 INFO:teuthology.orchestra.run.smithi063.stdout: 285920 8 -rw-r--r-- 1 ubuntu ubuntu 5094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MForward.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 285965 4 -rw-r--r-- 1 ubuntu ubuntu 2425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonCommandAck.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 285887 4 -rw-r--r-- 1 ubuntu ubuntu 2656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientLease.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 286004 12 -rw-r--r-- 1 ubuntu ubuntu 10058 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDOpReply.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 285918 4 -rw-r--r-- 1 ubuntu ubuntu 1440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MFSMap.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 285941 4 -rw-r--r-- 1 ubuntu ubuntu 361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSOp.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 286019 4 -rw-r--r-- 1 ubuntu ubuntu 2012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGQuery.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 285912 4 -rw-r--r-- 1 ubuntu ubuntu 1996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirDiscoverAck.h 2024-03-27T21:32:59.377 INFO:teuthology.orchestra.run.smithi063.stdout: 286032 8 -rw-r--r-- 1 ubuntu ubuntu 5187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDRepOp.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 286006 4 -rw-r--r-- 1 ubuntu ubuntu 2051 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGBackfillRemove.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 285984 4 -rw-r--r-- 1 ubuntu ubuntu 2812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonSubscribe.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 285883 8 -rw-r--r-- 1 ubuntu ubuntu 5103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MBackfillReserve.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 286015 4 -rw-r--r-- 1 ubuntu ubuntu 1949 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGNotify2.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 285886 12 -rw-r--r-- 1 ubuntu ubuntu 10587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientCaps.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 285922 4 -rw-r--r-- 1 ubuntu ubuntu 981 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MGenericMessage.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 286030 4 -rw-r--r-- 1 ubuntu ubuntu 1080 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPeeringOp.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 285995 4 -rw-r--r-- 1 ubuntu ubuntu 2042 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDECSubOpWriteReply.h 2024-03-27T21:32:59.378 INFO:teuthology.orchestra.run.smithi063.stdout: 286050 4 -rw-r--r-- 1 ubuntu ubuntu 2212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MTimeCheck2.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 285986 4 -rw-r--r-- 1 ubuntu ubuntu 3336 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonSync.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 285964 4 -rw-r--r-- 1 ubuntu ubuntu 2669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonCommand.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 285992 4 -rw-r--r-- 1 ubuntu ubuntu 2005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDECSubOpRead.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 286048 4 -rw-r--r-- 1 ubuntu ubuntu 1312 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MStatfsReply.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 285915 4 -rw-r--r-- 1 ubuntu ubuntu 1891 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirNotifyAck.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 286017 4 -rw-r--r-- 1 ubuntu ubuntu 2503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGPush.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 285902 4 -rw-r--r-- 1 ubuntu ubuntu 1914 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MDentryUnlink.h 2024-03-27T21:32:59.379 INFO:teuthology.orchestra.run.smithi063.stdout: 286023 4 -rw-r--r-- 1 ubuntu ubuntu 1719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGRecoveryDeleteReply.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 286035 4 -rw-r--r-- 1 ubuntu ubuntu 2196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDRepScrubMap.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 285950 4 -rw-r--r-- 1 ubuntu ubuntu 3987 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSScrub.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 285968 4 -rw-r--r-- 1 ubuntu ubuntu 2345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGetOSDMap.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 285932 12 -rw-r--r-- 1 ubuntu ubuntu 10183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSBeacon.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 285938 4 -rw-r--r-- 1 ubuntu ubuntu 1800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSLoadTargets.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 285940 4 -rw-r--r-- 1 ubuntu ubuntu 1533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSMetrics.h 2024-03-27T21:32:59.380 INFO:teuthology.orchestra.run.smithi063.stdout: 286003 20 -rw-r--r-- 1 ubuntu ubuntu 17329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDOp.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285951 4 -rw-r--r-- 1 ubuntu ubuntu 2592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSScrubStats.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285919 4 -rw-r--r-- 1 ubuntu ubuntu 1611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MFSMapUser.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285882 4 -rw-r--r-- 1 ubuntu ubuntu 1869 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MAuthReply.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285895 4 -rw-r--r-- 1 ubuntu ubuntu 2152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientRequestForward.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285983 4 -rw-r--r-- 1 ubuntu ubuntu 2395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonScrub.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285994 4 -rw-r--r-- 1 ubuntu ubuntu 2247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDECSubOpWrite.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285959 4 -rw-r--r-- 1 ubuntu ubuntu 1576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrDigest.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 285949 4 -rw-r--r-- 1 ubuntu ubuntu 1777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSResolveAck.h 2024-03-27T21:32:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 286010 4 -rw-r--r-- 1 ubuntu ubuntu 2246 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGInfo2.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 285978 4 -rw-r--r-- 1 ubuntu ubuntu 2827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonMgrReport.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 286044 4 -rw-r--r-- 1 ubuntu ubuntu 1595 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MRemoveSnaps.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 285933 16 -rw-r--r-- 1 ubuntu ubuntu 13395 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSCacheRejoin.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 285962 8 -rw-r--r-- 1 ubuntu ubuntu 6534 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrReport.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 285885 4 -rw-r--r-- 1 ubuntu ubuntu 1913 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MClientCapRelease.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 286039 4 -rw-r--r-- 1 ubuntu ubuntu 1277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MPGStatsAck.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 285981 8 -rw-r--r-- 1 ubuntu ubuntu 4154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonProbe.h 2024-03-27T21:32:59.382 INFO:teuthology.orchestra.run.smithi063.stdout: 285899 4 -rw-r--r-- 1 ubuntu ubuntu 1448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MCommandReply.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 285961 4 -rw-r--r-- 1 ubuntu ubuntu 2620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrOpen.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 286012 4 -rw-r--r-- 1 ubuntu ubuntu 1659 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGLeaseAck.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 285971 4 -rw-r--r-- 1 ubuntu ubuntu 1500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonGetVersion.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 285977 4 -rw-r--r-- 1 ubuntu ubuntu 1585 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonMap.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 286013 4 -rw-r--r-- 1 ubuntu ubuntu 3482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGLog.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 286024 4 -rw-r--r-- 1 ubuntu ubuntu 1780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGRemove.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 285916 4 -rw-r--r-- 1 ubuntu ubuntu 2464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirPrep.h 2024-03-27T21:32:59.383 INFO:teuthology.orchestra.run.smithi063.stdout: 285911 4 -rw-r--r-- 1 ubuntu ubuntu 2123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDirDiscover.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 286041 4 -rw-r--r-- 1 ubuntu ubuntu 2484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MPoolOp.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 286045 4 -rw-r--r-- 1 ubuntu ubuntu 2273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MRoute.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 286007 4 -rw-r--r-- 1 ubuntu ubuntu 1418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGCreate2.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 286022 4 -rw-r--r-- 1 ubuntu ubuntu 2226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGRecoveryDelete.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 285966 4 -rw-r--r-- 1 ubuntu ubuntu 4026 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMonElection.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 286025 4 -rw-r--r-- 1 ubuntu ubuntu 2953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGScan.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 286005 4 -rw-r--r-- 1 ubuntu ubuntu 2955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDPGBackfill.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 285943 4 -rw-r--r-- 1 ubuntu ubuntu 1886 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSOpenInoReply.h 2024-03-27T21:32:59.384 INFO:teuthology.orchestra.run.smithi063.stdout: 285908 4 -rw-r--r-- 1 ubuntu ubuntu 1733 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportDir.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285991 4 -rw-r--r-- 1 ubuntu ubuntu 2929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDBoot.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285990 4 -rw-r--r-- 1 ubuntu ubuntu 1954 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDBeacon.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285954 8 -rw-r--r-- 1 ubuntu ubuntu 6034 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMgrBeacon.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 286043 4 -rw-r--r-- 1 ubuntu ubuntu 3228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MRecoveryReserve.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285993 4 -rw-r--r-- 1 ubuntu ubuntu 2036 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDECSubOpReadReply.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285907 4 -rw-r--r-- 1 ubuntu ubuntu 1619 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MExportCapsAck.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285945 4 -rw-r--r-- 1 ubuntu ubuntu 1228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSPing.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 285946 4 -rw-r--r-- 1 ubuntu ubuntu 1391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MMDSQuiesceDbAck.h 2024-03-27T21:32:59.385 INFO:teuthology.orchestra.run.smithi063.stdout: 286034 4 -rw-r--r-- 1 ubuntu ubuntu 3918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MOSDRepScrub.h 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 285930 4 -rw-r--r-- 1 ubuntu ubuntu 1575 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/src/messages/MLog.h 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291446 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291452 4 -rw-r--r-- 1 ubuntu ubuntu 732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-fuse@.service.in 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291448 4 -rw-r--r-- 1 ubuntu ubuntu 1361 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/CMakeLists.txt 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291464 4 -rw-r--r-- 1 ubuntu ubuntu 890 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-radosgw@.service.in 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291466 4 -rw-r--r-- 1 ubuntu ubuntu 808 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-rbd-mirror@.service.in 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291454 4 -rw-r--r-- 1 ubuntu ubuntu 779 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-immutable-object-cache@.service.in 2024-03-27T21:32:59.386 INFO:teuthology.orchestra.run.smithi063.stdout: 291451 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-fuse.target 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291467 4 -rw-r--r-- 1 ubuntu ubuntu 302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-volume@.service 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291447 4 -rw-r--r-- 1 ubuntu ubuntu 222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/50-ceph.preset 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291463 4 -rw-r--r-- 1 ubuntu ubuntu 242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-radosgw.target 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291458 4 -rw-r--r-- 1 ubuntu ubuntu 1048 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-mgr@.service.in 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291457 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-mgr.target 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291449 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-crash.service.in 2024-03-27T21:32:59.387 INFO:teuthology.orchestra.run.smithi063.stdout: 291450 4 -rw-r--r-- 1 ubuntu ubuntu 707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-exporter.service.in 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291471 4 -rw-r--r-- 1 ubuntu ubuntu 770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/cephfs-mirror@.service.in 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291462 4 -rw-r--r-- 1 ubuntu ubuntu 1121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-osd@.service.in 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291470 4 -rw-r--r-- 1 ubuntu ubuntu 169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/cephfs-mirror.target 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291469 4 -rw-r--r-- 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph.tmpfiles.d 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291465 4 -rw-r--r-- 1 ubuntu ubuntu 189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-rbd-mirror.target 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291468 4 -rw-r--r-- 1 ubuntu ubuntu 129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph.target 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291459 4 -rw-r--r-- 1 ubuntu ubuntu 200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-mon.target 2024-03-27T21:32:59.388 INFO:teuthology.orchestra.run.smithi063.stdout: 291472 4 -rw-r--r-- 1 ubuntu ubuntu 418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/rbdmap.service.in 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 291460 4 -rw-r--r-- 1 ubuntu ubuntu 1305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-mon@.service.in 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 291455 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-mds.target 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 291461 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-osd.target 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 291456 4 -rw-r--r-- 1 ubuntu ubuntu 912 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-mds@.service.in 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 291453 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/systemd/ceph-immutable-object-cache.target 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 277217 4 -rw-r--r-- 1 ubuntu ubuntu 4032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/CodingStyle 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 277223 8 -rw-r--r-- 1 ubuntu ubuntu 5566 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/README.windows.rst 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 278321 8 -rw-r--r-- 1 ubuntu ubuntu 5082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mingw_conf.sh 2024-03-27T21:32:59.389 INFO:teuthology.orchestra.run.smithi063.stdout: 277222 4 -rw-r--r-- 1 ubuntu ubuntu 777 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/README.solaris 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278322 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278324 4 -rw-r--r-- 1 ubuntu ubuntu 2161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring/README.md 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278326 4 -rwxr-xr-x 1 ubuntu ubuntu 2560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring/mirror-ceph.sh 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278325 4 -rw-r--r-- 1 ubuntu ubuntu 488 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring/apache2.vhost.conf 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278327 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring/rsyncd.conf 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278323 4 -rw-r--r-- 1 ubuntu ubuntu 581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring/MIRRORS 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278328 4 -rwxr-xr-x 1 ubuntu ubuntu 1327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/mirroring/test-mirrors.sh 2024-03-27T21:32:59.390 INFO:teuthology.orchestra.run.smithi063.stdout: 278308 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/keys 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 278310 12 -rw-r--r-- 1 ubuntu ubuntu 8868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/keys/old_release.1.asc 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 278309 4 -rw-r--r-- 1 ubuntu ubuntu 2438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/keys/autobuild.asc 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 278311 4 -rw-r--r-- 1 ubuntu ubuntu 1752 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/keys/old_release.2.possibly.compromised.asc 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 278312 4 -rw-r--r-- 1 ubuntu ubuntu 1645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/keys/release.asc 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 277219 8 -rw-r--r-- 1 ubuntu ubuntu 5356 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/README.FreeBSD 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 278431 4 drwxr-xr-x 37 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 278916 4 drwxr-xr-x 30 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 279196 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental 2024-03-27T21:32:59.391 INFO:teuthology.orchestra.run.smithi063.stdout: 279198 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279199 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/% 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279200 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/.qa -> ../.qa/ 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279201 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/clusters 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279202 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279203 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/clusters/7-multimds.yaml 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279204 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/tasks 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279205 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.392 INFO:teuthology.orchestra.run.smithi063.stdout: 279206 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 279197 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/experimental/.qa -> ../.qa/ 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280543 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280546 4 -rw-r--r-- 1 ubuntu ubuntu 594 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/ceph.yaml 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280544 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/% 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280551 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/tests 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280552 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/tests/.qa -> ../.qa/ 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280553 4 -rw-r--r-- 1 ubuntu ubuntu 404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/tests/mon_pool_ops.yaml 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280545 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/.qa -> ../.qa/ 2024-03-27T21:32:59.393 INFO:teuthology.orchestra.run.smithi063.stdout: 280547 4 -rw-r--r-- 1 ubuntu ubuntu 278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/cluster.yaml 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 280550 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/supported-random-distro$ -> ../rados/basic/supported-random-distro$/ 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 280549 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 280548 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/netsplit/msgr.yaml -> ../../msgr/async.yaml 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 279207 4 drwxr-xr-x 26 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 279989 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 279990 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/% 2024-03-27T21:32:59.394 INFO:teuthology.orchestra.run.smithi063.stdout: 279991 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/.qa -> ../.qa/ 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 279994 4 -rw-r--r-- 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/debug.yaml 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 279995 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 280010 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/overrides 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 280011 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 280012 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/overrides/ignorelist_health.yaml -> ./.qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 279996 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/% 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 280001 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/clients 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 280002 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/clients/.qa -> ../.qa/ 2024-03-27T21:32:59.395 INFO:teuthology.orchestra.run.smithi063.stdout: 280003 4 -rw-r--r-- 1 ubuntu ubuntu 669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/clients/mirror.yaml 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 279997 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 280007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/mount 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 280008 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 280009 4 -rw-r--r-- 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/mount/fuse.yaml 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 279998 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/cephfs-mirror 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 279999 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/cephfs-mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 280000 4 -rw-r--r-- 1 ubuntu ubuntu 186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/cephfs-mirror/one-per-cluster.yaml 2024-03-27T21:32:59.396 INFO:teuthology.orchestra.run.smithi063.stdout: 280013 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/tasks 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 280014 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 280015 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/tasks/mirror.yaml 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 280004 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/cluster 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 280005 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 280006 4 -rw-r--r-- 1 ubuntu ubuntu 239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/mirror/cluster/1-node.yaml 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 279992 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 279993 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/valgrind/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 279208 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/.qa -> ../.qa/ 2024-03-27T21:32:59.397 INFO:teuthology.orchestra.run.smithi063.stdout: 279615 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279630 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279631 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides/+ 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279632 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279635 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides/no_client_pidfile.yaml -> .qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279636 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279633 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279634 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.398 INFO:teuthology.orchestra.run.smithi063.stdout: 279616 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/% 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279627 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/objectstore 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279628 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279629 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279617 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/.qa -> ../.qa/ 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279622 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/mount 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279625 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279626 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.399 INFO:teuthology.orchestra.run.smithi063.stdout: 279619 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/clusters 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279620 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279621 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/clusters/1-mds-1-client-coloc.yaml -> .qa/cephfs/clusters/1-mds-1-client-coloc.yaml 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279618 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/tasks 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279638 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279639 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/tasks/cephfs-shell.yaml 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279623 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/shell/distro -> .qa/distros/supported 2024-03-27T21:32:59.400 INFO:teuthology.orchestra.run.smithi063.stdout: 279340 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279361 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/subvol_versions 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279363 4 lrwxrwxrwx 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/subvol_versions/create_subvol_version_v1.yaml -> .qa/cephfs/overrides/subvol_versions/create_subvol_version_v1.yaml 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279362 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/subvol_versions/.qa -> ../.qa 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279364 4 lrwxrwxrwx 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/subvol_versions/create_subvol_version_v2.yaml -> .qa/cephfs/overrides/subvol_versions/create_subvol_version_v2.yaml 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279354 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279355 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides/+ 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279356 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.401 INFO:teuthology.orchestra.run.smithi063.stdout: 279359 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides/no_client_pidfile.yaml -> .qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279360 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279357 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279358 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279341 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/% 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279350 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/objectstore 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279353 0 lrwxrwxrwx 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/objectstore/bluestore-ec-root.yaml -> .qa/cephfs/objectstore-ec/bluestore-ec-root.yaml 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279351 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.402 INFO:teuthology.orchestra.run.smithi063.stdout: 279352 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279342 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/.qa -> ../.qa/ 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279347 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279349 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279344 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/clusters 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279345 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279346 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/clusters/1a3s-mds-4c-client.yaml -> .qa/cephfs/clusters/1a3s-mds-4c-client.yaml 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279343 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279365 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks 2024-03-27T21:32:59.403 INFO:teuthology.orchestra.run.smithi063.stdout: 279386 4 -rw-r--r-- 1 ubuntu ubuntu 104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/metrics.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279384 4 -rw-r--r-- 1 ubuntu ubuntu 945 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/mds-full.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279366 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279381 4 -rw-r--r-- 1 ubuntu ubuntu 84 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/fragment.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279369 4 -rw-r--r-- 1 ubuntu ubuntu 442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/alternate-pool.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279385 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/mds_creation_retry.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279392 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/recovery-fs.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279400 4 -rw-r--r-- 1 ubuntu ubuntu 344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/truncate_delay.yaml 2024-03-27T21:32:59.404 INFO:teuthology.orchestra.run.smithi063.stdout: 279371 4 -rw-r--r-- 1 ubuntu ubuntu 239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/auto-repair.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279388 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/openfiletable.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279405 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/xfstests-dev.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279393 4 -rw-r--r-- 1 ubuntu ubuntu 432 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/scrub.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279374 4 -rw-r--r-- 1 ubuntu ubuntu 552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/client-limits.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279368 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/admin.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279396 4 -rw-r--r-- 1 ubuntu ubuntu 647 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/snap_schedule_snapdir.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279387 4 -rw-r--r-- 1 ubuntu ubuntu 151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/multimds_misc.yaml 2024-03-27T21:32:59.405 INFO:teuthology.orchestra.run.smithi063.stdout: 279377 4 -rw-r--r-- 1 ubuntu ubuntu 728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/damage.yaml 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279373 4 -rw-r--r-- 1 ubuntu ubuntu 154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/cap-flush.yaml 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279391 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/quota.yaml 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279383 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/mds-flush.yaml 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279376 4 -rw-r--r-- 1 ubuntu ubuntu 552 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/client-recovery.yaml 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279370 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/asok_dump_tree.yaml 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279401 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/workunit 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279402 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/workunit/.qa -> ../.qa/ 2024-03-27T21:32:59.406 INFO:teuthology.orchestra.run.smithi063.stdout: 279404 4 -rw-r--r-- 1 ubuntu ubuntu 62 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/workunit/quota.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279403 4 -rw-r--r-- 1 ubuntu ubuntu 72 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/workunit/dir-max-entries.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279390 4 -rw-r--r-- 1 ubuntu ubuntu 168 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/quiesce.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279378 4 -rw-r--r-- 1 ubuntu ubuntu 468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/data-scan.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279397 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/snapshots.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279395 4 -rw-r--r-- 1 ubuntu ubuntu 492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/snap-schedule.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279389 4 -rw-r--r-- 1 ubuntu ubuntu 84 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/pool-perm.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279372 4 -rw-r--r-- 1 ubuntu ubuntu 84 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/backtrace.yaml 2024-03-27T21:32:59.407 INFO:teuthology.orchestra.run.smithi063.stdout: 279398 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/strays.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279367 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/acls.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279382 4 -rw-r--r-- 1 ubuntu ubuntu 331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/journal-repair.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279394 4 -rw-r--r-- 1 ubuntu ubuntu 197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/sessionmap.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279379 4 -rw-r--r-- 1 ubuntu ubuntu 168 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/exports.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279399 4 -rw-r--r-- 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/test_journal_migration.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279375 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/client-readahead.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279380 4 -rw-r--r-- 1 ubuntu ubuntu 320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/tasks/forward-scrub.yaml 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279348 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/functional/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.408 INFO:teuthology.orchestra.run.smithi063.stdout: 279524 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279541 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/overrides 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279542 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/overrides/+ 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279543 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279546 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279544 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279545 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279525 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/% 2024-03-27T21:32:59.409 INFO:teuthology.orchestra.run.smithi063.stdout: 279526 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/.qa -> ../.qa/ 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279532 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279536 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/mount 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279537 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279539 4 -rw-r--r-- 1 ubuntu ubuntu 102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/mount/kclient.yaml.disabled 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279538 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279540 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279528 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/clusters 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279529 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.410 INFO:teuthology.orchestra.run.smithi063.stdout: 279531 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/clusters/1-mds-3-client.yaml -> .qa/cephfs/clusters/1-mds-3-client.yaml 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279530 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/clusters/1-mds-2-client.yaml -> .qa/cephfs/clusters/1-mds-2-client.yaml 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279533 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/distros 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279534 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/distros/.qa -> ../.qa/ 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279535 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/distros/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279527 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279547 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/tasks 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279549 4 -rw-r--r-- 1 ubuntu ubuntu 322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml 2024-03-27T21:32:59.411 INFO:teuthology.orchestra.run.smithi063.stdout: 279548 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279552 4 -rw-r--r-- 1 ubuntu ubuntu 1094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/tasks/mdtest.yaml 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279551 4 -rw-r--r-- 1 ubuntu ubuntu 993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/tasks/ior-shared-file.yaml 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279550 4 -rw-r--r-- 1 ubuntu ubuntu 460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279784 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279797 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279798 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides/+ 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279799 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.412 INFO:teuthology.orchestra.run.smithi063.stdout: 279803 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279801 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279800 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides/frag.yaml -> .qa/cephfs/overrides/frag.yaml 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279802 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279785 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/% 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279786 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/.qa -> ../.qa/ 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279791 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279810 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/traceless 2024-03-27T21:32:59.413 INFO:teuthology.orchestra.run.smithi063.stdout: 279811 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/traceless/.qa -> ../.qa/ 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279812 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/traceless/50pc.yaml 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279793 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/mount 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279794 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279795 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279796 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279788 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/clusters 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279789 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279790 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml -> .qa/cephfs/clusters/fixed-2-ucephfs.yaml 2024-03-27T21:32:59.414 INFO:teuthology.orchestra.run.smithi063.stdout: 279787 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279804 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/tasks 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279806 0 lrwxrwxrwx 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279805 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279809 0 lrwxrwxrwx 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279807 0 lrwxrwxrwx 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279808 0 lrwxrwxrwx 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279792 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/traceless/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.415 INFO:teuthology.orchestra.run.smithi063.stdout: 279640 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279651 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/overrides 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279652 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/overrides/+ 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279653 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279656 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279654 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279655 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279641 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/% 2024-03-27T21:32:59.416 INFO:teuthology.orchestra.run.smithi063.stdout: 279642 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/.qa -> ../.qa/ 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279647 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279649 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279650 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279644 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/clusters 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279645 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279646 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/clusters/1a3s-mds-1c-client.yaml -> .qa/cephfs/clusters/1a3s-mds-1c-client.yaml 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279643 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.417 INFO:teuthology.orchestra.run.smithi063.stdout: 279657 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/tasks 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 279658 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 279659 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/tasks/workunit 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 279660 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/tasks/workunit/.qa -> ../.qa/ 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 279661 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/tasks/workunit/snaps.yaml 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 279648 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/snaps/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 280016 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 280043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides 2024-03-27T21:32:59.418 INFO:teuthology.orchestra.run.smithi063.stdout: 280044 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/+ 2024-03-27T21:32:59.419 INFO:teuthology.orchestra.run.smithi063.stdout: 280045 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.419 INFO:teuthology.orchestra.run.smithi063.stdout: 280050 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/session_timeout.yaml -> .qa/cephfs/overrides/session_timeout.yaml 2024-03-27T21:32:59.419 INFO:teuthology.orchestra.run.smithi063.stdout: 280049 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.419 INFO:teuthology.orchestra.run.smithi063.stdout: 280046 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.419 INFO:teuthology.orchestra.run.smithi063.stdout: 280048 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/mon-debug.yaml 2024-03-27T21:32:59.419 INFO:teuthology.orchestra.run.smithi063.stdout: 280047 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280017 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/% 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280018 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/.qa -> ../.qa/ 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280023 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280033 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280034 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280035 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280036 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/kclient 2024-03-27T21:32:59.420 INFO:teuthology.orchestra.run.smithi063.stdout: 280037 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/kclient/+ 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280039 4 lrwxrwxrwx 1 ubuntu ubuntu 64 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/kclient/k-testing.yaml -> .qa/cephfs/mount/kclient/overrides/distro/testing/k-testing.yaml 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280038 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/kclient/.qa -> ../.qa/ 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280041 0 lrwxrwxrwx 1 ubuntu ubuntu 57 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/kclient/ms-die-on-skipped.yaml -> .qa/cephfs/mount/kclient/overrides/ms-die-on-skipped.yaml 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280040 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/mount/kclient/mount.yaml -> .qa/cephfs/mount/kclient/mount.yaml 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280051 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/ranks 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280052 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/ranks/.qa -> ../.qa/ 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280053 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/ranks/1.yaml 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280055 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/ranks/5.yaml 2024-03-27T21:32:59.421 INFO:teuthology.orchestra.run.smithi063.stdout: 280054 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/ranks/3.yaml 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280042 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280020 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/clusters 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280022 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/clusters/1a5s-mds-1c-client.yaml -> .qa/cephfs/clusters/1a5s-mds-1c-client.yaml 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280021 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280019 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280060 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/validater 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280061 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/validater/.qa -> ../.qa/ 2024-03-27T21:32:59.422 INFO:teuthology.orchestra.run.smithi063.stdout: 280062 4 -rw-r--r-- 1 ubuntu ubuntu 65 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/validater/lockdep.yaml 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280063 4 -rw-r--r-- 1 ubuntu ubuntu 739 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/validater/valgrind.yaml 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280056 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/tasks 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280057 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280059 0 lrwxrwxrwx 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/tasks/fsstress.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280058 0 lrwxrwxrwx 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/tasks/dbench.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280024 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280026 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/.qa -> ../.qa/ 2024-03-27T21:32:59.423 INFO:teuthology.orchestra.run.smithi063.stdout: 280028 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/ubuntu 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 280029 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/ubuntu/+ 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 280030 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/ubuntu/.qa -> ../.qa/ 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 280032 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/ubuntu/ubuntu_latest.yaml -> .qa/distros/all/ubuntu_latest.yaml 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 280031 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/ubuntu/overrides.yaml 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 280027 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/centos_latest.yaml -> .qa/distros/all/centos_latest.yaml 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 280025 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/verify/distro/$ 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 279813 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 279815 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client 2024-03-27T21:32:59.424 INFO:teuthology.orchestra.run.smithi063.stdout: 279816 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/.qa -> ../.qa/ 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279846 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279855 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279860 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/multimds 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279861 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/multimds/.qa -> ../.qa/ 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279863 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/multimds/yes.yaml 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279862 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/multimds/no.yaml 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279856 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/% 2024-03-27T21:32:59.425 INFO:teuthology.orchestra.run.smithi063.stdout: 279857 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279858 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279859 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279864 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/overrides/pg-warn.yaml 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279847 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/% 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279848 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/.qa -> ../.qa/ 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279854 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/conf -> .qa/cephfs/conf/ 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279849 0 lrwxrwxrwx 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/bluestore-bitmap.yaml -> ../../../../../cephfs/objectstore-ec/bluestore-bitmap.yaml 2024-03-27T21:32:59.426 INFO:teuthology.orchestra.run.smithi063.stdout: 279851 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/clusters 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279852 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279853 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/clusters/1-mds-2-client-micro.yaml -> .qa/cephfs/clusters/1-mds-2-client-micro.yaml 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279850 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/centos_8.stream.yaml -> .qa/distros/all/centos_8.stream.yaml 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279865 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279866 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/% 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279872 4 -rw-r--r-- 1 ubuntu ubuntu 405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/4-compat_client.yaml 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279867 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.427 INFO:teuthology.orchestra.run.smithi063.stdout: 279870 4 -rw-r--r-- 1 ubuntu ubuntu 1244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/2-upgrade.yaml 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279868 4 -rw-r--r-- 1 ubuntu ubuntu 841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/0-octopus.yaml 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279873 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/5-client-sanity.yaml 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279871 4 -rw-r--r-- 1 ubuntu ubuntu 283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/3-client-upgrade.yaml 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279869 4 -rw-r--r-- 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/upgraded_client/tasks/1-client.yaml 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279817 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279826 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279831 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/multimds 2024-03-27T21:32:59.428 INFO:teuthology.orchestra.run.smithi063.stdout: 279832 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/multimds/.qa -> ../.qa/ 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279834 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/multimds/yes.yaml 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279833 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/multimds/no.yaml 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279827 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/% 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279828 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279829 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279830 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279835 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/overrides/pg-warn.yaml 2024-03-27T21:32:59.429 INFO:teuthology.orchestra.run.smithi063.stdout: 279818 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/% 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279819 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/.qa -> ../.qa/ 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279825 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/conf -> .qa/cephfs/conf/ 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279820 0 lrwxrwxrwx 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/bluestore-bitmap.yaml -> ../../../../../cephfs/objectstore-ec/bluestore-bitmap.yaml 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279822 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/clusters 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279823 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279824 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/clusters/1-mds-2-client-micro.yaml -> .qa/cephfs/clusters/1-mds-2-client-micro.yaml 2024-03-27T21:32:59.430 INFO:teuthology.orchestra.run.smithi063.stdout: 279821 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/centos_8.stream.yaml -> .qa/distros/all/centos_8.stream.yaml 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279836 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279837 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/% 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279838 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279841 4 -rw-r--r-- 1 ubuntu ubuntu 1244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/2-upgrade.yaml 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279842 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/3-compat_client 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279843 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/3-compat_client/.qa -> ../.qa/ 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279845 4 -rw-r--r-- 1 ubuntu ubuntu 255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/3-compat_client/quincy.yaml 2024-03-27T21:32:59.431 INFO:teuthology.orchestra.run.smithi063.stdout: 279844 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/3-compat_client/no.yaml 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279839 4 -rw-r--r-- 1 ubuntu ubuntu 841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/0-octopus.yaml 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279840 4 -rw-r--r-- 1 ubuntu ubuntu 149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/featureful_client/old_client/tasks/1-client.yaml 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279814 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279948 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279952 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/branch 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279954 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/branch/pacific.yaml 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279953 4 -rw-r--r-- 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/branch/nautilus.yaml 2024-03-27T21:32:59.432 INFO:teuthology.orchestra.run.smithi063.stdout: 279961 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/overrides 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279962 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/overrides/% 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279963 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279964 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279965 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279966 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/overrides/pg-warn.yaml 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279949 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/% 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279950 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/.qa -> ../.qa/ 2024-03-27T21:32:59.433 INFO:teuthology.orchestra.run.smithi063.stdout: 279960 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/conf -> .qa/cephfs/conf/ 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279951 0 lrwxrwxrwx 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/bluestore-bitmap.yaml -> ../../../../cephfs/objectstore-ec/bluestore-bitmap.yaml 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279956 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/clusters 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279957 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/clusters/% 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279959 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/clusters/1-mds-1-client-micro.yaml -> .qa/cephfs/clusters/1-mds-1-client-micro.yaml 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279958 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/clusters/.qa -> ../.qa 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279955 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/centos_8.stream.yaml -> .qa/distros/all/centos_8.stream.yaml 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279967 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks 2024-03-27T21:32:59.434 INFO:teuthology.orchestra.run.smithi063.stdout: 279977 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279982 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279988 4 lrwxrwxrwx 1 ubuntu ubuntu 63 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/kernel_untar_build.yaml -> .qa/suites/fs/workload/tasks/5-workunit/kernel_untar_build.yaml 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279983 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/.qa -> ../.qa/ 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279987 0 lrwxrwxrwx 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/iozone.yaml -> .qa/suites/fs/workload/tasks/5-workunit/suites/iozone.yaml 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279984 4 lrwxrwxrwx 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/blogbench.yaml -> .qa/suites/fs/workload/tasks/5-workunit/suites/blogbench.yaml 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279986 4 lrwxrwxrwx 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/fsstress.yaml -> .qa/suites/fs/workload/tasks/5-workunit/suites/fsstress.yaml 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279985 0 lrwxrwxrwx 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/stress_tests/dbench.yaml -> .qa/suites/fs/workload/tasks/5-workunit/suites/dbench.yaml 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279978 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/.qa -> ../.qa/ 2024-03-27T21:32:59.435 INFO:teuthology.orchestra.run.smithi063.stdout: 279979 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/new_ops 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279980 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/new_ops/% 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279981 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/3-workload/new_ops/newops.yaml 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279968 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/% 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279969 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279971 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/1-mount 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279972 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/1-mount/.qa -> ../.qa/ 2024-03-27T21:32:59.436 INFO:teuthology.orchestra.run.smithi063.stdout: 279973 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/1-mount/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279970 4 -rw-r--r-- 1 ubuntu ubuntu 1489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/0-install.yaml 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279974 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/2-clients 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279976 4 -rw-r--r-- 1 ubuntu ubuntu 359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/2-clients/kclient.yaml 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279975 4 -rw-r--r-- 1 ubuntu ubuntu 769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/upgraded_client/tasks/2-clients/fuse-upgrade.yaml 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279929 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279937 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/overrides 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279938 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/overrides/% 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279939 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.437 INFO:teuthology.orchestra.run.smithi063.stdout: 279940 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279941 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279942 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/overrides/pg-warn.yaml 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279930 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/% 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279931 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/.qa -> ../.qa/ 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279935 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/conf -> .qa/cephfs/conf/ 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279932 4 -rw-r--r-- 1 ubuntu ubuntu 158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/README 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279933 0 lrwxrwxrwx 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/bluestore-bitmap.yaml -> .qa/cephfs/objectstore-ec/bluestore-bitmap.yaml 2024-03-27T21:32:59.438 INFO:teuthology.orchestra.run.smithi063.stdout: 279934 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/centos_8.stream.yaml -> .qa/distros/all/centos_8.stream.yaml 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279936 4 -rw-r--r-- 1 ubuntu ubuntu 154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/no-mds-cluster.yaml 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279943 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/tasks 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279944 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/tasks/% 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279945 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279947 4 -rw-r--r-- 1 ubuntu ubuntu 1068 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/tasks/1-upgrade.yaml 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279946 4 -rw-r--r-- 1 ubuntu ubuntu 841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/nofs/tasks/0-pacific.yaml 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279874 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides 2024-03-27T21:32:59.439 INFO:teuthology.orchestra.run.smithi063.stdout: 279887 4 -rw-r--r-- 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/ignorelist_upgrade.yaml 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279884 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/% 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279885 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279890 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/syntax.yaml 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279886 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279888 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279889 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/overrides/pg-warn.yaml 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279875 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/% 2024-03-27T21:32:59.440 INFO:teuthology.orchestra.run.smithi063.stdout: 279876 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/.qa -> ../.qa/ 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279879 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/conf -> .qa/cephfs/conf/ 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279877 0 lrwxrwxrwx 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/bluestore-bitmap.yaml -> .qa/cephfs/objectstore-ec/bluestore-bitmap.yaml 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279878 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/centos_9.stream.yaml -> .qa/distros/podman/centos_9.stream.yaml 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279880 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/fail_fs 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279882 4 -rw-r--r-- 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/fail_fs/yes.yaml 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279881 4 -rw-r--r-- 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/fail_fs/no.yaml 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279891 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/roles.yaml 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279892 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks 2024-03-27T21:32:59.441 INFO:teuthology.orchestra.run.smithi063.stdout: 279893 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/% 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279894 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279903 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279904 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/% 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279907 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/1-ranks 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279908 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/1-ranks/.qa -> ../.qa/ 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279909 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/1-ranks/1.yaml 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279910 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/1-ranks/2.yaml 2024-03-27T21:32:59.442 INFO:teuthology.orchestra.run.smithi063.stdout: 279905 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/.qa -> ../.qa/ 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279906 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/0-create.yaml 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279911 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/2-allow_standby_replay 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279912 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/2-allow_standby_replay/.qa -> ../.qa/ 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279914 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/2-allow_standby_replay/yes.yaml 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279913 4 -rw-r--r-- 1 ubuntu ubuntu 90 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/2-allow_standby_replay/no.yaml 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279915 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/3-inline 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279916 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/3-inline/.qa -> ../.qa/ 2024-03-27T21:32:59.443 INFO:teuthology.orchestra.run.smithi063.stdout: 279918 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/3-inline/yes.yaml 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279917 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/3-inline/no.yaml 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279919 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/1-volume/4-verify.yaml 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279924 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/4-config-upgrade 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279925 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/4-config-upgrade/+ 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279926 4 -rw-r--r-- 1 ubuntu ubuntu 609 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/4-config-upgrade/fail_fs.yaml 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279920 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/2-client 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279922 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/2-client/kclient.yaml 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279921 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/2-client/fuse.yaml 2024-03-27T21:32:59.444 INFO:teuthology.orchestra.run.smithi063.stdout: 279928 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/6-verify.yaml 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279927 4 -rw-r--r-- 1 ubuntu ubuntu 1268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/5-upgrade-with-workload.yaml 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279923 4 -rw-r--r-- 1 ubuntu ubuntu 1038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279895 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279896 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/.qa -> ../.qa/ 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279897 4 -rw-r--r-- 1 ubuntu ubuntu 837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/quincy.yaml 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279898 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/reef 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279902 4 -rw-r--r-- 1 ubuntu ubuntu 787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/reef/v18.2.1.yaml 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279900 4 -rw-r--r-- 1 ubuntu ubuntu 786 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/reef/reef.yaml 2024-03-27T21:32:59.445 INFO:teuthology.orchestra.run.smithi063.stdout: 279901 4 -rw-r--r-- 1 ubuntu ubuntu 787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/reef/v18.2.0.yaml 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279899 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/0-from/reef/$ 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279592 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/overrides 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279606 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/overrides/+ 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279607 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279610 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279608 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.446 INFO:teuthology.orchestra.run.smithi063.stdout: 279609 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279593 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/% 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279594 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/.qa -> ../.qa/ 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279599 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/mount 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279602 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279603 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279604 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.447 INFO:teuthology.orchestra.run.smithi063.stdout: 279596 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/clusters 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279597 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279598 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/clusters/fixed-2-ucephfs.yaml -> .qa/cephfs/clusters/fixed-2-ucephfs.yaml 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279595 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279611 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/tasks 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279612 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279614 4 -rw-r--r-- 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279613 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/tasks/cfuse_workunit_misc.yaml 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279600 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/permission/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: 279464 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279485 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/overrides 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279486 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/overrides/+ 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279487 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279489 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279488 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/overrides/ignorelist_health.yaml -> ./.qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279465 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/% 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279471 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/clients 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279472 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/clients/+ 2024-03-27T21:32:59.449 INFO:teuthology.orchestra.run.smithi063.stdout: 279473 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/clients/.qa -> ../.qa/ 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279474 4 -rw-r--r-- 1 ubuntu ubuntu 669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/clients/mirror.yaml 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279482 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/objectstore 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279483 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279484 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279466 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279479 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/mount 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279480 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.450 INFO:teuthology.orchestra.run.smithi063.stdout: 279481 4 -rw-r--r-- 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/mount/fuse.yaml 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279468 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cephfs-mirror 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279469 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cephfs-mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279470 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cephfs-mirror/one-per-cluster.yaml 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279467 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279490 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/supported-random-distros$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279491 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/tasks 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279492 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279493 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/tasks/mirror.yaml 2024-03-27T21:32:59.451 INFO:teuthology.orchestra.run.smithi063.stdout: 279475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cluster 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279476 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cluster/+ 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279477 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279478 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror/cluster/1-node.yaml 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279761 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279775 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/overrides 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279776 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/overrides/+ 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279777 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.452 INFO:teuthology.orchestra.run.smithi063.stdout: 279779 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279778 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279762 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/% 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279772 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/objectstore 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279773 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279774 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279763 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/.qa -> ../.qa/ 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279769 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/mount 2024-03-27T21:32:59.453 INFO:teuthology.orchestra.run.smithi063.stdout: 279770 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279771 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279764 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279780 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/supported-random-distros$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279781 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/tasks 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279782 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279783 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/tasks/fstop.yaml 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279765 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/cluster 2024-03-27T21:32:59.454 INFO:teuthology.orchestra.run.smithi063.stdout: 279766 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/cluster/+ 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279767 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279768 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/top/cluster/1-node.yaml 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279314 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279330 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279331 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides/+ 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279332 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279335 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides/no_client_pidfile.yaml -> .qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279336 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.455 INFO:teuthology.orchestra.run.smithi063.stdout: 279333 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279334 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279315 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/% 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279326 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/objectstore 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279327 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279328 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279316 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/.qa -> ../.qa/ 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279321 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.456 INFO:teuthology.orchestra.run.smithi063.stdout: 279323 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/mount 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279324 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279325 4 -rw-r--r-- 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/mount/fuse.yaml 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279318 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/clusters 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279319 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279320 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/clusters/1-node-1-mds-1-osd.yaml -> .qa/cephfs/clusters/1-node-1-mds-1-osd.yaml 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279317 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279337 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/tasks 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279338 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.457 INFO:teuthology.orchestra.run.smithi063.stdout: 279339 4 -rw-r--r-- 1 ubuntu ubuntu 666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/tasks/mgr-osd-full.yaml 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279329 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/overrides.yaml 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279322 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/full/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279662 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279663 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279706 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279721 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279732 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/prefetch_entire_dirfrags -> .qa/cephfs/overrides/prefetch_entire_dirfrags 2024-03-27T21:32:59.458 INFO:teuthology.orchestra.run.smithi063.stdout: 279722 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/% 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279723 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279734 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/session_timeout.yaml -> .qa/cephfs/overrides/session_timeout.yaml 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279735 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279724 4 -rw-r--r-- 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/client-shutdown.yaml 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279726 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279725 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/frag.yaml -> .qa/cephfs/overrides/frag.yaml 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279727 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.459 INFO:teuthology.orchestra.run.smithi063.stdout: 279733 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/races.yaml 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279728 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/prefetch_dirfrags 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279729 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/prefetch_dirfrags/.qa -> ../.qa/ 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279731 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/prefetch_dirfrags/yes.yaml 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279730 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/overrides/prefetch_dirfrags/no.yaml 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279707 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/% 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279716 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/msgr-failures 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279717 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279719 4 -rw-r--r-- 1 ubuntu ubuntu 502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/msgr-failures/osd-mds-delay.yaml 2024-03-27T21:32:59.460 INFO:teuthology.orchestra.run.smithi063.stdout: 279718 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/msgr-failures/none.yaml 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279708 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279713 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279715 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279736 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/ranks 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279737 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/ranks/.qa -> ../.qa/ 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279738 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/ranks/1.yaml 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279740 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/ranks/5.yaml 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279739 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/ranks/3.yaml 2024-03-27T21:32:59.461 INFO:teuthology.orchestra.run.smithi063.stdout: 279720 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279710 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/clusters 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279712 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/clusters/1a5s-mds-1c-client.yaml -> .qa/cephfs/clusters/1a5s-mds-1c-client.yaml 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279711 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279709 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279741 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279749 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279755 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/suites 2024-03-27T21:32:59.462 INFO:teuthology.orchestra.run.smithi063.stdout: 279756 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/suites/.qa -> ../.qa/ 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279759 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/suites/iozone.yaml 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279760 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/suites/pjd.yaml 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279758 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/suites/fsstress.yaml 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279757 4 -rw-r--r-- 1 ubuntu ubuntu 193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/suites/ffsb.yaml 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279751 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/fs 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279752 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/fs/.qa -> ../.qa/ 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279753 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/fs/snaps.yaml 2024-03-27T21:32:59.463 INFO:teuthology.orchestra.run.smithi063.stdout: 279754 0 lrwxrwxrwx 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/fs/trivial_sync.yaml -> .qa/cephfs/tasks/cfuse_workunit_trivial_sync.yaml 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279750 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/2-workunit/.qa -> ../.qa/ 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279742 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/% 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279743 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279744 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/1-thrash 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279745 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/1-thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279746 4 -rw-r--r-- 1 ubuntu ubuntu 90 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/1-thrash/mds.yaml 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279747 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/1-thrash/mon.yaml 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279748 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/tasks/1-thrash/osd.yaml 2024-03-27T21:32:59.464 INFO:teuthology.orchestra.run.smithi063.stdout: 279714 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/workloads/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279664 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279681 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279682 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/+ 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279683 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279688 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/multifs.yaml 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279689 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/session_timeout.yaml -> .qa/cephfs/overrides/session_timeout.yaml 2024-03-27T21:32:59.465 INFO:teuthology.orchestra.run.smithi063.stdout: 279690 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279684 4 -rw-r--r-- 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/client-shutdown.yaml 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279686 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279685 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/frag.yaml -> .qa/cephfs/overrides/frag.yaml 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279687 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279665 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/% 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279678 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/objectstore 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279679 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.466 INFO:teuthology.orchestra.run.smithi063.stdout: 279680 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279674 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/msgr-failures 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279675 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279677 4 -rw-r--r-- 1 ubuntu ubuntu 502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/msgr-failures/osd-mds-delay.yaml 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279676 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/msgr-failures/none.yaml 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279666 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/.qa -> ../.qa/ 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279671 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279673 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279668 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/clusters 2024-03-27T21:32:59.467 INFO:teuthology.orchestra.run.smithi063.stdout: 279669 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279670 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/clusters/1a3s-mds-2c-client.yaml -> .qa/cephfs/clusters/1a3s-mds-2c-client.yaml 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279667 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279691 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279698 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279699 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/.qa -> ../.qa/ 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279700 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/cfuse_workunit_snaptests.yaml 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279703 0 lrwxrwxrwx 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/cfuse_workunit_trivial_sync.yaml -> .qa/cephfs/tasks/cfuse_workunit_trivial_sync.yaml 2024-03-27T21:32:59.468 INFO:teuthology.orchestra.run.smithi063.stdout: 279701 0 lrwxrwxrwx 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/cfuse_workunit_suites_fsstress.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279705 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/iozone.yaml 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279702 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/cfuse_workunit_suites_pjd.yaml 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279704 4 -rw-r--r-- 1 ubuntu ubuntu 193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/2-workunit/ffsb.yaml 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279692 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/% 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279693 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279694 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/1-thrash 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279695 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/1-thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279696 4 -rw-r--r-- 1 ubuntu ubuntu 90 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/1-thrash/mds.yaml 2024-03-27T21:32:59.469 INFO:teuthology.orchestra.run.smithi063.stdout: 279697 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/tasks/1-thrash/mon.yaml 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279672 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/thrash/multifs/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279406 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279418 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279419 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides/+ 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279420 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279423 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides/no_client_pidfile.yaml -> .qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279424 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.470 INFO:teuthology.orchestra.run.smithi063.stdout: 279421 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279422 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279407 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/% 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279415 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/objectstore 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279416 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279417 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279408 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/.qa -> ../.qa/ 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279413 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.471 INFO:teuthology.orchestra.run.smithi063.stdout: 279410 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/clusters 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279411 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279412 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/clusters/1-mds-1-client-coloc.yaml -> .qa/cephfs/clusters/1-mds-1-client-coloc.yaml 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279409 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279425 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279434 4 -rw-r--r-- 1 ubuntu ubuntu 275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/libcephfs_python.yaml 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279428 4 -rw-r--r-- 1 ubuntu ubuntu 368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/ino_release_cb.yaml 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279426 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279427 4 -rw-r--r-- 1 ubuntu ubuntu 214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/client.yaml 2024-03-27T21:32:59.472 INFO:teuthology.orchestra.run.smithi063.stdout: 279429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/libcephfs 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279430 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/libcephfs/+ 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279431 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/libcephfs/.qa -> ../.qa/ 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279433 4 -rw-r--r-- 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/libcephfs/test.yaml 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279432 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/tasks/libcephfs/frag.yaml -> .qa/cephfs/overrides/frag.yaml 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279414 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/libcephfs/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279435 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279455 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/overrides 2024-03-27T21:32:59.473 INFO:teuthology.orchestra.run.smithi063.stdout: 279456 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/overrides/+ 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279457 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279459 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279458 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/overrides/ignorelist_health.yaml -> ./.qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279436 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/% 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279444 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/clients 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279445 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/clients/+ 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279446 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/clients/.qa -> ../.qa/ 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279447 4 -rw-r--r-- 1 ubuntu ubuntu 1558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/clients/mirror.yaml 2024-03-27T21:32:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 279452 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/objectstore 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279453 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279454 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279437 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/.qa -> ../.qa/ 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279460 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/workloads 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279463 4 -rw-r--r-- 1 ubuntu ubuntu 710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/workloads/cephfs-mirror-ha-workunit.yaml 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279462 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 279439 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cephfs-mirror 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279440 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cephfs-mirror/+ 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279441 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cephfs-mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279443 4 -rw-r--r-- 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cephfs-mirror/2-three-per-cluster.yaml 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279442 4 -rw-r--r-- 1 ubuntu ubuntu 394 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cephfs-mirror/1-volume-create-rm.yaml 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279438 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279448 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cluster 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279449 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cluster/+ 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279450 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.476 INFO:teuthology.orchestra.run.smithi063.stdout: 279451 4 -rw-r--r-- 1 ubuntu ubuntu 290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mirror-ha/cluster/1-node.yaml 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280097 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280100 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/0-centos_9.stream.yaml -> .qa/distros/podman/centos_9.stream.yaml 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280133 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280134 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/+ 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280135 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280142 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/session_timeout.yaml -> .qa/cephfs/overrides/session_timeout.yaml 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280141 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.477 INFO:teuthology.orchestra.run.smithi063.stdout: 280140 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/osd-asserts.yaml -> .qa/cephfs/overrides/osd-asserts.yaml 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280138 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280137 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/frag.yaml -> .qa/cephfs/overrides/frag.yaml 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280139 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280136 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/overrides/cephsqlite-timeout.yaml 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280098 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/% 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280099 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/.qa -> ../.qa/ 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280159 4 -rw-r--r-- 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/standby-replay.yaml 2024-03-27T21:32:59.478 INFO:teuthology.orchestra.run.smithi063.stdout: 280129 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/omap_limit 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280130 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/omap_limit/.qa -> ../.qa/ 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280131 4 -rw-r--r-- 1 ubuntu ubuntu 85 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/omap_limit/10.yaml 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280132 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/omap_limit/10000.yaml 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280111 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280113 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280114 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.479 INFO:teuthology.orchestra.run.smithi063.stdout: 280115 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280116 4 -rw-r--r-- 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/% 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280124 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/wsync 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280125 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/wsync/.qa -> ../.qa/ 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280127 4 -rw-r--r-- 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/wsync/yes.yaml 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280126 4 -rw-r--r-- 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/wsync/no.yaml 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280117 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/.qa -> ../.qa/ 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280119 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/ms_mode 2024-03-27T21:32:59.480 INFO:teuthology.orchestra.run.smithi063.stdout: 280123 4 -rw-r--r-- 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/ms_mode/secure.yaml 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280121 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/ms_mode/crc.yaml 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280120 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/ms_mode/.qa -> ../.qa/ 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280122 4 -rw-r--r-- 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/ms_mode/legacy.yaml 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280118 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/mount/kclient/base -> .qa/cephfs/mount/kclient/ 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280143 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280146 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280152 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/export-check.yaml 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280147 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/% 2024-03-27T21:32:59.481 INFO:teuthology.orchestra.run.smithi063.stdout: 280148 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/balancer 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280151 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/balancer/random.yaml 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280149 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/balancer/automatic.yaml 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280150 4 -rw-r--r-- 1 ubuntu ubuntu 249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/balancer/distributed.yaml.disabled 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/n 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280155 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/n/5.yaml 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280154 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/n/3.yaml 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280156 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/replication 2024-03-27T21:32:59.482 INFO:teuthology.orchestra.run.smithi063.stdout: 280157 4 -rw-r--r-- 1 ubuntu ubuntu 494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/replication/always.yaml 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280158 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/multi/replication/default.yaml 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280144 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/.qa -> ../.qa/ 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280145 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/ranks/1.yaml 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280128 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280108 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/clusters 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280109 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.483 INFO:teuthology.orchestra.run.smithi063.stdout: 280110 0 lrwxrwxrwx 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/clusters/1a11s-mds-1c-client-3node.yaml -> .qa/cephfs/clusters/1a11s-mds-1c-client-3node.yaml 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280101 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280102 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin/+ 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280103 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin/.qa -> ../.qa/ 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280105 4 -rw-r--r-- 1 ubuntu ubuntu 367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin/1-cephadm.yaml 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280106 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin/2-logrotate.yaml -> .qa/cephfs/begin/2-logrotate.yaml 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280107 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin/3-modules.yaml -> .qa/cephfs/begin/3-modules.yaml 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280104 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/begin/0-install.yaml -> .qa/cephfs/begin/0-install.yaml 2024-03-27T21:32:59.484 INFO:teuthology.orchestra.run.smithi063.stdout: 280160 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280163 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280165 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume/.qa -> ../.qa/ 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280166 4 -rw-r--r-- 1 ubuntu ubuntu 216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume/with-namespace-isolated-and-quota.yaml 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280168 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume/with-no-extra-options.yaml 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280164 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume/$ 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280169 4 -rw-r--r-- 1 ubuntu ubuntu 195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume/with-quota.yaml 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280167 4 -rw-r--r-- 1 ubuntu ubuntu 197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/0-subvolume/with-namespace-isolated.yaml 2024-03-27T21:32:59.485 INFO:teuthology.orchestra.run.smithi063.stdout: 280161 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/% 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/4-flush 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280180 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/4-flush/.qa -> ../.qa/ 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280182 4 -rw-r--r-- 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/4-flush/yes.yaml 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280181 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/4-flush/no.yaml 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280162 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280183 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280193 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites 2024-03-27T21:32:59.486 INFO:teuthology.orchestra.run.smithi063.stdout: 280194 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/.qa -> ../.qa/ 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280201 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/iogen.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280200 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/fsync-tester.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280202 4 -rw-r--r-- 1 ubuntu ubuntu 116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/iozone.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280195 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/blogbench.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280203 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/pjd.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280198 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/fsstress.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280196 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/dbench.yaml 2024-03-27T21:32:59.487 INFO:teuthology.orchestra.run.smithi063.stdout: 280197 4 -rw-r--r-- 1 ubuntu ubuntu 293 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/ffsb.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280199 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/suites/fsx.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280191 4 -rw-r--r-- 1 ubuntu ubuntu 154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/kernel_untar_build.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280192 4 -rw-r--r-- 1 ubuntu ubuntu 2055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/postgres.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280186 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/fs 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280190 4 -rw-r--r-- 1 ubuntu ubuntu 118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/fs/test_o_trunc.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280187 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/fs/.qa -> ../.qa/ 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280189 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/fs/norstats.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280188 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/fs/misc.yaml 2024-03-27T21:32:59.488 INFO:teuthology.orchestra.run.smithi063.stdout: 280184 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/.qa -> ../.qa/ 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280185 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/5-workunit/direct_io.yaml 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280170 4 -rw-r--r-- 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/1-check-counter.yaml 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/3-snaps 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280176 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/3-snaps/.qa -> ../.qa/ 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280178 4 -rw-r--r-- 1 ubuntu ubuntu 1311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/3-snaps/yes.yaml 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280177 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/3-snaps/no.yaml 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280171 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/2-scrub 2024-03-27T21:32:59.489 INFO:teuthology.orchestra.run.smithi063.stdout: 280172 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/2-scrub/.qa -> ../.qa/ 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280174 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/2-scrub/yes.yaml 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280173 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/workload/tasks/2-scrub/no.yaml 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280064 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280077 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280078 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides/+ 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280079 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280082 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides/no_client_pidfile.yaml -> .qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.490 INFO:teuthology.orchestra.run.smithi063.stdout: 280083 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280080 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280081 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280065 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/% 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/objectstore 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280075 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280076 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280066 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/.qa -> ../.qa/ 2024-03-27T21:32:59.491 INFO:teuthology.orchestra.run.smithi063.stdout: 280071 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280073 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280068 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/clusters 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280069 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280070 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/clusters/1a3s-mds-4c-client.yaml -> .qa/cephfs/clusters/1a3s-mds-4c-client.yaml 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280067 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280084 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280085 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.492 INFO:teuthology.orchestra.run.smithi063.stdout: 280086 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280087 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/% 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280088 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/.qa -> ../.qa/ 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280090 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280091 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test/.qa -> ../.qa/ 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280093 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test/clone.yaml 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280094 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test/finisher_per_module.yaml 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280095 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test/misc.yaml 2024-03-27T21:32:59.493 INFO:teuthology.orchestra.run.smithi063.stdout: 280092 4 -rw-r--r-- 1 ubuntu ubuntu 279 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test/basic.yaml 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 280096 4 -rw-r--r-- 1 ubuntu ubuntu 195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/test/snapshot.yaml 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 280089 4 -rw-r--r-- 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/tasks/volumes/overrides.yaml 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 280072 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/volumes/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 279494 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 279513 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 279514 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides/+ 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 279515 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.494 INFO:teuthology.orchestra.run.smithi063.stdout: 279519 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279518 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides/osd-asserts.yaml -> .qa/cephfs/overrides/osd-asserts.yaml 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279516 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279517 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279495 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/% 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279496 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/.qa -> ../.qa/ 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279501 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279512 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279498 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/clusters 2024-03-27T21:32:59.495 INFO:teuthology.orchestra.run.smithi063.stdout: 279499 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279500 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/clusters/1a3s-mds-2c-client.yaml -> .qa/cephfs/clusters/1a3s-mds-2c-client.yaml 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279497 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279511 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/kclient-overrides -> .qa/cephfs/mount/kclient/overrides/ 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279520 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/tasks 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279521 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279523 4 -rw-r--r-- 1 ubuntu ubuntu 335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279522 4 -rw-r--r-- 1 ubuntu ubuntu 327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2024-03-27T21:32:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 279502 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279504 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/.qa -> ../.qa/ 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279506 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/ubuntu 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279507 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/ubuntu/+ 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279508 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/ubuntu/.qa -> ../.qa/ 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279510 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/ubuntu/ubuntu_latest.yaml -> .qa/distros/all/ubuntu_latest.yaml 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279509 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/ubuntu/overrides.yaml 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279505 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/centos_latest.yaml -> .qa/distros/all/centos_latest.yaml 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279503 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/mixed-clients/distro/$ 2024-03-27T21:32:59.497 INFO:teuthology.orchestra.run.smithi063.stdout: 279256 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279257 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/.qa -> ../.qa/ 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279258 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279262 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/1-mount.yaml 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279259 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/% 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279260 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/.qa -> ../.qa/ 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279261 4 -rw-r--r-- 1 ubuntu ubuntu 620 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/0-start.yaml 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279263 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/2-workload 2024-03-27T21:32:59.498 INFO:teuthology.orchestra.run.smithi063.stdout: 279264 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/2-workload/.qa -> ../.qa/ 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279265 0 lrwxrwxrwx 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/2-workload/dbench.yaml -> .qa/suites/fs/workload/tasks/5-workunit/suites/dbench.yaml 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279266 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/distro 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279267 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/distro/.qa -> ../.qa/ 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279268 0 lrwxrwxrwx 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/multivolume/distro/single-container-host.yaml -> .qa/distros/single-container-host.yaml 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279269 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279277 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/overrides 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279278 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.499 INFO:teuthology.orchestra.run.smithi063.stdout: 279279 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279270 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/% 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279271 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/.qa -> ../.qa/ 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279272 4 -rw-r--r-- 1 ubuntu ubuntu 586 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/0-start.yaml 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279273 4 -rw-r--r-- 1 ubuntu ubuntu 430 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/1-rename.yaml 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279274 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/distro 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279275 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/distro/.qa -> ../.qa/ 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279276 0 lrwxrwxrwx 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/cephadm/renamevolume/distro/single-container-host.yaml -> .qa/distros/single-container-host.yaml 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279233 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs 2024-03-27T21:32:59.500 INFO:teuthology.orchestra.run.smithi063.stdout: 279234 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/.qa -> ../.qa/ 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279235 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279247 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/overrides 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279248 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/overrides/+ 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279249 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279252 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/overrides/no_client_pidfile.yaml -> .qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279250 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279251 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.501 INFO:teuthology.orchestra.run.smithi063.stdout: 279236 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/% 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/objectstore 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279245 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279246 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279237 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/.qa -> ../.qa/ 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279243 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279240 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/clusters 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279241 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.502 INFO:teuthology.orchestra.run.smithi063.stdout: 279242 4 -rw-r--r-- 1 ubuntu ubuntu 224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/clusters/small-cluster.yaml 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279238 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279239 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/tasks 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279255 4 -rw-r--r-- 1 ubuntu ubuntu 412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/tasks/trim-i24137.yaml 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279254 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/bugs/client_trim_caps/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279209 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279222 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides 2024-03-27T21:32:59.503 INFO:teuthology.orchestra.run.smithi063.stdout: 279223 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides/+ 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279224 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279225 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides/faked-ino.yaml 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279228 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279226 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279227 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279210 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/% 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279211 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/.qa -> ../.qa/ 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279216 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.504 INFO:teuthology.orchestra.run.smithi063.stdout: 279218 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/mount 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279219 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279220 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/mount/fuse.yaml -> .qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279221 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/clusters 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279214 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279215 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml -> .qa/cephfs/clusters/fixed-2-ucephfs.yaml 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279212 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.505 INFO:teuthology.orchestra.run.smithi063.stdout: 279229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/tasks 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279230 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279231 0 lrwxrwxrwx 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml -> .qa/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279232 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279217 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/32bits/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279280 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279296 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/+ 2024-03-27T21:32:59.506 INFO:teuthology.orchestra.run.smithi063.stdout: 279297 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279303 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279298 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279301 4 -rw-r--r-- 1 ubuntu ubuntu 68 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/osd.yaml 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279300 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279302 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/pg-warn.yaml 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279299 4 -rw-r--r-- 1 ubuntu ubuntu 106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/overrides/ignorelist_health_more.yaml 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279281 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/% 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279282 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/.qa -> ../.qa/ 2024-03-27T21:32:59.507 INFO:teuthology.orchestra.run.smithi063.stdout: 279288 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/conf -> .qa/cephfs/conf/ 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279284 0 lrwxrwxrwx 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/bluestore-bitmap.yaml -> .qa/cephfs/objectstore-ec/bluestore-bitmap.yaml 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279294 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/mount -> .qa/cephfs/mount 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279285 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/clusters 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279286 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/clusters/.qa -> ../.qa 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279287 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/clusters/1-mds-1-client.yaml -> .qa/cephfs/clusters/1-mds-1-client.yaml 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279283 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279304 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279305 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/% 2024-03-27T21:32:59.508 INFO:teuthology.orchestra.run.smithi063.stdout: 279306 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279307 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/0-client.yaml 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279308 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/1-tests 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279310 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/1-tests/fscrypt-dbench.yaml 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279313 4 -rw-r--r-- 1 ubuntu ubuntu 134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/1-tests/fscrypt-pjd.yaml 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279312 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/1-tests/fscrypt-iozone.yaml 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279311 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/1-tests/fscrypt-ffsb.yaml 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279309 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/tasks/1-tests/fscrypt-common.yaml 2024-03-27T21:32:59.509 INFO:teuthology.orchestra.run.smithi063.stdout: 279289 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/distro 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279291 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/distro/.qa -> ../.qa/ 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279293 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/distro/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279292 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/distro/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279290 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/fscrypt/distro/$ 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279553 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279564 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279565 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides/+ 2024-03-27T21:32:59.510 INFO:teuthology.orchestra.run.smithi063.stdout: 279566 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279570 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279567 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279569 4 -rw-r--r-- 1 ubuntu ubuntu 62 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides/mon-debug.yaml 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279568 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/overrides/ignorelist_wrongly_marked_down.yaml -> .qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279554 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/% 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279555 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/.qa -> ../.qa/ 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279560 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/conf -> .qa/cephfs/conf 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279562 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/mount -> .qa/cephfs/mount/ 2024-03-27T21:32:59.511 INFO:teuthology.orchestra.run.smithi063.stdout: 279563 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/objectstore-ec -> .qa/cephfs/objectstore-ec 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279557 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/clusters 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279558 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279559 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/clusters/1a3s-mds-2c-client.yaml -> .qa/cephfs/clusters/1a3s-mds-2c-client.yaml 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279556 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/begin -> .qa/cephfs/begin/ 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279571 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/tasks 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279573 4 -rw-r--r-- 1 ubuntu ubuntu 438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/tasks/failover.yaml 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279572 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279574 4 -rw-r--r-- 1 ubuntu ubuntu 113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/tasks/multifs-auth.yaml 2024-03-27T21:32:59.512 INFO:teuthology.orchestra.run.smithi063.stdout: 279561 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/multifs/distro -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279575 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279583 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/overrides 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279584 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/overrides/+ 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279585 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279587 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/overrides/pg_health.yaml -> .qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279586 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/overrides/ignorelist_health.yaml -> .qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279576 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/% 2024-03-27T21:32:59.513 INFO:teuthology.orchestra.run.smithi063.stdout: 279577 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/.qa -> ../.qa/ 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279582 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/conf -> ./.qa/cephfs/conf 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279588 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/supported-random-distros$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279589 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/tasks 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279590 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279591 4 -rw-r--r-- 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/tasks/nfs.yaml 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279578 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/cluster 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279579 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/cluster/+ 2024-03-27T21:32:59.514 INFO:teuthology.orchestra.run.smithi063.stdout: 279580 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 279581 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/fs/nfs/cluster/1-node.yaml 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 280821 4 drwxr-xr-x 26 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 281215 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 281218 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/ceph.yaml -> ../thrash/ceph.yaml 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 281216 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/% 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 281226 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 281225 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/msgr-failures -> ../thrash/msgr-failures 2024-03-27T21:32:59.515 INFO:teuthology.orchestra.run.smithi063.stdout: 281217 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/.qa -> ../.qa/ 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281234 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281229 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281235 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/workloads 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281236 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281237 0 lrwxrwxrwx 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml -> .qa/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281219 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/clusters 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281220 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/clusters/+ 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281221 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.516 INFO:teuthology.orchestra.run.smithi063.stdout: 281223 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281222 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml -> .qa/clusters/fixed-4.yaml 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281227 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281228 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/recovery-overrides -> ../thrash/2-recovery-overrides 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281230 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/thrashers 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281231 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281232 4 -rw-r--r-- 1 ubuntu ubuntu 499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/thrashers/careful.yaml 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281233 4 -rw-r--r-- 1 ubuntu ubuntu 529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml 2024-03-27T21:32:59.517 INFO:teuthology.orchestra.run.smithi063.stdout: 281224 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-shec/mon_election -> .qa/mon_election 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280933 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280943 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/msgr -> .qa/msgr 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280934 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/% 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280949 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280944 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/msgr-failures 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280945 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280946 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/msgr-failures/few.yaml 2024-03-27T21:32:59.518 INFO:teuthology.orchestra.run.smithi063.stdout: 280947 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/msgr-failures/many.yaml 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280935 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/.qa -> ../.qa/ 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280951 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280936 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/clusters 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280937 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280939 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/clusters/3.yaml 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280940 4 -rw-r--r-- 1 ubuntu ubuntu 150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/clusters/6.yaml 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280938 4 -rw-r--r-- 1 ubuntu ubuntu 251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/clusters/21.yaml 2024-03-27T21:32:59.519 INFO:teuthology.orchestra.run.smithi063.stdout: 280941 4 -rw-r--r-- 1 ubuntu ubuntu 167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/clusters/9.yaml 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280950 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280948 4 -rw-r--r-- 1 ubuntu ubuntu 124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/no_pools.yaml 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280952 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/tasks 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280955 4 -rw-r--r-- 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/tasks/mon_clock_with_skews.yaml 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280953 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280956 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/tasks/mon_recovery.yaml 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280954 4 -rw-r--r-- 1 ubuntu ubuntu 242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/tasks/mon_clock_no_skews.yaml 2024-03-27T21:32:59.520 INFO:teuthology.orchestra.run.smithi063.stdout: 280942 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/multimon/mon_election -> .qa/mon_election 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 281007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/rest 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 281008 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/rest/% 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 281009 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/rest/.qa -> ../.qa/ 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 281010 4 -rw-r--r-- 1 ubuntu ubuntu 657 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/rest/mgr-restful.yaml 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 281011 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/rest/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 280874 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 280889 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/random-objectstore$ -> .qa/objectstore_debug 2024-03-27T21:32:59.521 INFO:teuthology.orchestra.run.smithi063.stdout: 280875 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/% 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280876 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/.qa -> ../.qa/ 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280884 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/mgr_ttl_cache 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280885 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/mgr_ttl_cache/.qa -> ../.qa/ 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280887 0 lrwxrwxrwx 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/mgr_ttl_cache/enable.yaml -> .qa/mgr_ttl_cache/enable.yaml 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280886 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/mgr_ttl_cache/disable.yaml -> .qa/mgr_ttl_cache/disable.yaml 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280881 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/debug 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280882 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/debug/.qa -> ../.qa/ 2024-03-27T21:32:59.522 INFO:teuthology.orchestra.run.smithi063.stdout: 280883 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/debug/mgr.yaml -> .qa/debug/mgr.yaml 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280890 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280877 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/clusters 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280878 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/clusters/+ 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280879 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280880 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/clusters/2-node-mgr.yaml -> .qa/clusters/2-node-mgr.yaml 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280891 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280894 4 -rw-r--r-- 1 ubuntu ubuntu 446 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/failover.yaml 2024-03-27T21:32:59.523 INFO:teuthology.orchestra.run.smithi063.stdout: 280899 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/prometheus.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280892 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280898 4 -rw-r--r-- 1 ubuntu ubuntu 785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/progress.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280893 4 -rw-r--r-- 1 ubuntu ubuntu 470 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/crash.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280897 4 -rw-r--r-- 1 ubuntu ubuntu 1596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/per_module_finisher_stats.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280900 4 -rw-r--r-- 1 ubuntu ubuntu 453 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/workunits.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280896 4 -rw-r--r-- 1 ubuntu ubuntu 849 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/module_selftest.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280895 4 -rw-r--r-- 1 ubuntu ubuntu 542 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/tasks/insights.yaml 2024-03-27T21:32:59.524 INFO:teuthology.orchestra.run.smithi063.stdout: 280888 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/mgr/mon_election -> .qa/mon_election 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280957 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280958 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/% 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280959 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280969 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280960 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280963 4 -rw-r--r-- 1 ubuntu ubuntu 138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/fusestore.yaml 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280961 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/.qa -> ../.qa/ 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280965 4 -rw-r--r-- 1 ubuntu ubuntu 292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/objectcacher-stress.yaml 2024-03-27T21:32:59.525 INFO:teuthology.orchestra.run.smithi063.stdout: 280968 4 -rw-r--r-- 1 ubuntu ubuntu 473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/objectstore-memstore.yaml 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280964 4 -rw-r--r-- 1 ubuntu ubuntu 195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/keyvaluedb.yaml 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280966 4 -rw-r--r-- 1 ubuntu ubuntu 493 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/objectstore-bluestore-a.yaml 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280962 4 -rw-r--r-- 1 ubuntu ubuntu 565 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/ceph_objectstore_tool.yaml 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280967 4 -rw-r--r-- 1 ubuntu ubuntu 490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/objectstore/backends/objectstore-bluestore-b.yaml 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280822 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/.qa -> ../.qa/ 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280861 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard 2024-03-27T21:32:59.526 INFO:teuthology.orchestra.run.smithi063.stdout: 280869 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/random-objectstore$ -> .qa/objectstore 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280862 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/% 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280863 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/.qa -> ../.qa/ 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280865 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/debug 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280866 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/debug/.qa -> ../.qa/ 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280867 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/debug/mgr.yaml -> .qa/debug/mgr.yaml 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280864 0 lrwxrwxrwx 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/0-single-container-host.yaml -> .qa/distros/single-container-host.yaml 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280870 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/tasks 2024-03-27T21:32:59.527 INFO:teuthology.orchestra.run.smithi063.stdout: 280871 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 280873 4 -rw-r--r-- 1 ubuntu ubuntu 447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/tasks/e2e.yaml 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 280872 4 -rw-r--r-- 1 ubuntu ubuntu 2406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/tasks/dashboard.yaml 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 280868 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/dashboard/mon_election -> .qa/mon_election 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 281195 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 281201 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/fast -> ../thrash-erasure-code/fast 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 281199 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/ceph.yaml -> ../thrash/ceph.yaml 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 281196 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/% 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 281203 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/msgr-failures -> ../thrash-erasure-code/msgr-failures 2024-03-27T21:32:59.528 INFO:teuthology.orchestra.run.smithi063.stdout: 281197 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/.qa -> ../.qa/ 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281198 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/bluestore-bitmap.yaml -> ../thrash-erasure-code/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281208 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281206 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281209 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/workloads 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281210 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281214 4 -rw-r--r-- 1 ubuntu ubuntu 445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/workloads/ec-snaps-few-objects-overwrites.yaml 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281213 4 -rw-r--r-- 1 ubuntu ubuntu 561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/workloads/ec-small-objects-overwrites.yaml 2024-03-27T21:32:59.529 INFO:teuthology.orchestra.run.smithi063.stdout: 281212 4 -rw-r--r-- 1 ubuntu ubuntu 581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/workloads/ec-small-objects-fast-read-overwrites.yaml 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 281211 4 -rw-r--r-- 1 ubuntu ubuntu 466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/workloads/ec-pool-snaps-few-objects-overwrites.yaml 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 281200 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/clusters -> ../thrash-erasure-code/clusters 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 281204 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/rados.yaml -> ../thrash-erasure-code/rados.yaml 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 281205 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/recovery-overrides -> ../thrash/2-recovery-overrides 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 281207 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/thrashers -> ../thrash-erasure-code/thrashers 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 281202 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-overwrites/mon_election -> .qa/mon_election 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 280901 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash 2024-03-27T21:32:59.530 INFO:teuthology.orchestra.run.smithi063.stdout: 280910 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/msgr -> .qa/msgr 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280904 4 -rw-r--r-- 1 ubuntu ubuntu 727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/ceph.yaml 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280902 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/% 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280915 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280911 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/msgr-failures 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280914 4 -rw-r--r-- 1 ubuntu ubuntu 358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/msgr-failures/mon-delay.yaml 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280912 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280913 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/msgr-failures/few.yaml 2024-03-27T21:32:59.531 INFO:teuthology.orchestra.run.smithi063.stdout: 280903 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/.qa -> ../.qa/ 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280917 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280925 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280926 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280931 4 -rw-r--r-- 1 ubuntu ubuntu 291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/rados_mon_workunits.yaml 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280932 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/snaps-few-objects.yaml 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280927 4 -rw-r--r-- 1 ubuntu ubuntu 2367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/pool-create-delete.yaml 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280930 4 -rw-r--r-- 1 ubuntu ubuntu 624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/rados_mon_osdmap_prune.yaml 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280929 4 -rw-r--r-- 1 ubuntu ubuntu 591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/rados_api_tests.yaml 2024-03-27T21:32:59.532 INFO:teuthology.orchestra.run.smithi063.stdout: 280928 4 -rw-r--r-- 1 ubuntu ubuntu 206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/workloads/rados_5925.yaml 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280905 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/clusters 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280907 4 -rw-r--r-- 1 ubuntu ubuntu 180 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/clusters/3-mons.yaml 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280906 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280908 4 -rw-r--r-- 1 ubuntu ubuntu 222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/clusters/9-mons.yaml 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280916 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280918 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280919 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.533 INFO:teuthology.orchestra.run.smithi063.stdout: 280922 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers/one.yaml 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280920 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers/force-sync-many.yaml 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280923 4 -rw-r--r-- 1 ubuntu ubuntu 271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers/sync-many.yaml 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280921 4 -rw-r--r-- 1 ubuntu ubuntu 353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers/many.yaml 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280924 4 -rw-r--r-- 1 ubuntu ubuntu 249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/thrashers/sync.yaml 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280909 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/monthrash/mon_election -> .qa/mon_election 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280970 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280973 4 -rw-r--r-- 1 ubuntu ubuntu 334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/ceph.yaml 2024-03-27T21:32:59.534 INFO:teuthology.orchestra.run.smithi063.stdout: 280971 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/% 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280975 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280980 4 -rw-r--r-- 1 ubuntu ubuntu 801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore/bluestore-low-osd-mem-target.yaml 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280977 4 -rw-r--r-- 1 ubuntu ubuntu 807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore/bluestore-basic-min-osd-mem-target.yaml 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280976 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280978 4 -rw-r--r-- 1 ubuntu ubuntu 1327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280981 4 -rw-r--r-- 1 ubuntu ubuntu 1327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore/bluestore-stupid.yaml 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280979 4 -rw-r--r-- 1 ubuntu ubuntu 724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/objectstore/bluestore-comp.yaml 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280972 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/.qa -> ../.qa/ 2024-03-27T21:32:59.535 INFO:teuthology.orchestra.run.smithi063.stdout: 280982 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/openstack.yaml 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280991 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280983 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/scheduler 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280984 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/scheduler/.qa -> ../.qa/ 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280986 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/scheduler/dmclock_default_shards.yaml 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280987 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/scheduler/wpq_default_shards.yaml 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280985 4 -rw-r--r-- 1 ubuntu ubuntu 149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/scheduler/dmclock_1Shard_16Threads.yaml 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 280992 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads 2024-03-27T21:32:59.536 INFO:teuthology.orchestra.run.smithi063.stdout: 281000 4 -rw-r--r-- 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/radosbench_4K_seq_read.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 280993 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 281001 4 -rw-r--r-- 1 ubuntu ubuntu 717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/radosbench_4M_rand_read.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 280998 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/fio_4M_rand_write.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 280996 4 -rw-r--r-- 1 ubuntu ubuntu 698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/fio_4M_rand_read.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 281005 4 -rw-r--r-- 1 ubuntu ubuntu 696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/sample_fio.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 281004 4 -rw-r--r-- 1 ubuntu ubuntu 116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/radosbench_omap_write.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 280999 4 -rw-r--r-- 1 ubuntu ubuntu 617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/radosbench_4K_rand_read.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 280994 4 -rw-r--r-- 1 ubuntu ubuntu 695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/fio_4K_rand_read.yaml 2024-03-27T21:32:59.537 INFO:teuthology.orchestra.run.smithi063.stdout: 280997 4 -rw-r--r-- 1 ubuntu ubuntu 696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/fio_4M_rand_rw.yaml 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 281006 4 -rw-r--r-- 1 ubuntu ubuntu 688 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/sample_radosbench.yaml 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 281003 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/radosbench_4M_write.yaml 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 281002 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/radosbench_4M_seq_read.yaml 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 280995 4 -rw-r--r-- 1 ubuntu ubuntu 722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/workloads/fio_4K_rand_rw.yaml 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 280988 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/settings 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 280989 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/settings/.qa -> ../.qa/ 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 280990 4 -rw-r--r-- 1 ubuntu ubuntu 2043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/settings/optimized.yaml 2024-03-27T21:32:59.538 INFO:teuthology.orchestra.run.smithi063.stdout: 280974 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/perf/mon_election -> .qa/mon_election 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281157 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281163 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/ceph.yaml -> ../thrash/ceph.yaml 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281158 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/% 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281160 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/arch 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281162 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/arch/x86_64.yaml 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281161 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/arch/.qa -> ../.qa/ 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281166 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281165 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/msgr-failures -> ../thrash/msgr-failures 2024-03-27T21:32:59.539 INFO:teuthology.orchestra.run.smithi063.stdout: 281159 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/.qa -> ../.qa/ 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281171 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281169 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281172 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/workloads 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281173 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281174 4 lrwxrwxrwx 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/workloads/ec-rados-plugin=jerasure-k=2-m=2-crush.yaml -> .qa/erasure-code/ec-rados-plugin=jerasure-k=2-m=2-crush.yaml 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281175 4 lrwxrwxrwx 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/workloads/ec-rados-plugin=jerasure-k=8-m=6-crush.yaml -> .qa/erasure-code/ec-rados-plugin=jerasure-k=8-m=6-crush.yaml 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281167 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.540 INFO:teuthology.orchestra.run.smithi063.stdout: 281168 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/recovery-overrides -> ../thrash/2-recovery-overrides 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281170 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/thrashers -> ../thrash/thrashers 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281164 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-crush-4-nodes/mon_election -> .qa/mon_election 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281055 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281058 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281069 4 -rw-r--r-- 1 ubuntu ubuntu 530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/lost-unfound-delete.yaml 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281078 4 -rw-r--r-- 1 ubuntu ubuntu 3371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/mon-memory-target-compliance.yaml.disabled 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281080 4 -rw-r--r-- 1 ubuntu ubuntu 601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/osd-recovery-incomplete.yaml 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281094 4 -rw-r--r-- 1 ubuntu ubuntu 906 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-eio.yaml 2024-03-27T21:32:59.541 INFO:teuthology.orchestra.run.smithi063.stdout: 281084 4 -rw-r--r-- 1 ubuntu ubuntu 663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/pg-autoscaler.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281063 4 -rw-r--r-- 1 ubuntu ubuntu 451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/divergent_priors.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281059 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/.qa -> ../.qa/ 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281093 4 -rw-r--r-- 1 ubuntu ubuntu 1019 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-backfill-full.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281082 4 -rw-r--r-- 1 ubuntu ubuntu 515 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/peer.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281089 4 -rw-r--r-- 1 ubuntu ubuntu 1424 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/recovery-preemption.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281073 4 -rw-r--r-- 1 ubuntu ubuntu 675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/max-pg-per-osd.from-replica.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281087 4 -rw-r--r-- 1 ubuntu ubuntu 1039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/random-eio.yaml 2024-03-27T21:32:59.542 INFO:teuthology.orchestra.run.smithi063.stdout: 281062 4 -rw-r--r-- 1 ubuntu ubuntu 532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/deduptool.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281071 4 -rw-r--r-- 1 ubuntu ubuntu 599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/max-pg-per-osd.from-mon.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281083 4 -rw-r--r-- 1 ubuntu ubuntu 750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/pg-autoscaler-progress-off.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281092 4 -rw-r--r-- 1 ubuntu ubuntu 738 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/test-noautoscale-flag.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281065 4 -rw-r--r-- 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/dump-stuck.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281086 4 -rw-r--r-- 1 ubuntu ubuntu 532 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/radostool.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281100 4 -rw-r--r-- 1 ubuntu ubuntu 1965 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281064 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/divergent_priors2.yaml 2024-03-27T21:32:59.543 INFO:teuthology.orchestra.run.smithi063.stdout: 281066 4 -rw-r--r-- 1 ubuntu ubuntu 734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/ec-inconsistent-hinfo.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281060 4 -rw-r--r-- 1 ubuntu ubuntu 693 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/admin-socket.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281077 4 -rw-r--r-- 1 ubuntu ubuntu 416 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/mon-config.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281074 4 -rw-r--r-- 1 ubuntu ubuntu 369 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/mon-auth-caps.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281075 4 -rw-r--r-- 1 ubuntu ubuntu 345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/mon-config-key-caps.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281085 4 -rw-r--r-- 1 ubuntu ubuntu 859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/pg-removal-interruption.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281088 4 -rw-r--r-- 1 ubuntu ubuntu 672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/rebuild-mondb.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281081 4 -rw-r--r-- 1 ubuntu ubuntu 654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/osd-recovery.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281101 4 -rw-r--r-- 1 ubuntu ubuntu 686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/watch-notify-same-primary.yaml 2024-03-27T21:32:59.544 INFO:teuthology.orchestra.run.smithi063.stdout: 281070 4 -rw-r--r-- 1 ubuntu ubuntu 519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/lost-unfound.yaml 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281061 4 -rw-r--r-- 1 ubuntu ubuntu 803 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/backfill-toofull.yaml 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281079 4 -rw-r--r-- 1 ubuntu ubuntu 520 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/osd-backfill.yaml 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281090 4 -rw-r--r-- 1 ubuntu ubuntu 360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/resolve_stuck_peering.yaml 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281095 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-rados 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281096 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-rados/+ 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281097 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-rados/.qa -> ../.qa/ 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281098 4 -rw-r--r-- 1 ubuntu ubuntu 445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-rados/thrash-rados.yaml 2024-03-27T21:32:59.545 INFO:teuthology.orchestra.run.smithi063.stdout: 281099 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/thrash-rados/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281067 4 -rw-r--r-- 1 ubuntu ubuntu 559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/ec-lost-unfound.yaml 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281072 4 -rw-r--r-- 1 ubuntu ubuntu 674 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/max-pg-per-osd.from-primary.yaml 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281091 4 -rw-r--r-- 1 ubuntu ubuntu 508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/test-crash.yaml 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281076 4 -rw-r--r-- 1 ubuntu ubuntu 405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/mon-config-keys.yaml 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281068 4 -rw-r--r-- 1 ubuntu ubuntu 266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/all/erasure-code-nonregression.yaml 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281103 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/msgr -> .qa/msgr 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281056 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/% 2024-03-27T21:32:59.546 INFO:teuthology.orchestra.run.smithi063.stdout: 281109 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281104 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/msgr-failures 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281105 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281106 4 -rw-r--r-- 1 ubuntu ubuntu 198 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/msgr-failures/few.yaml 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281107 4 -rw-r--r-- 1 ubuntu ubuntu 314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/msgr-failures/many.yaml 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281108 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/msgr-failures/none.yaml 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281057 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/.qa -> ../.qa/ 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281111 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281110 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.547 INFO:teuthology.orchestra.run.smithi063.stdout: 281102 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton/mon_election -> .qa/mon_election 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281028 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281031 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281037 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281033 4 -rw-r--r-- 1 ubuntu ubuntu 612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/admin_socket_output.yaml 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281032 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/.qa -> ../.qa/ 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281042 4 -rw-r--r-- 1 ubuntu ubuntu 568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/health-warnings.yaml 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281045 4 -rw-r--r-- 1 ubuntu ubuntu 510 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/librados_hello_world.yaml 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281043 4 -rw-r--r-- 1 ubuntu ubuntu 743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/large-omap-object-warnings.yaml 2024-03-27T21:32:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 281040 4 -rw-r--r-- 1 ubuntu ubuntu 1200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/export-after-evict.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281050 4 -rw-r--r-- 1 ubuntu ubuntu 1276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/recovery-unfound-found.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281035 4 -rw-r--r-- 1 ubuntu ubuntu 1708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281034 4 -rw-r--r-- 1 ubuntu ubuntu 343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/balancer.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281048 4 -rw-r--r-- 1 ubuntu ubuntu 708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/osd_stale_reads.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281039 4 -rw-r--r-- 1 ubuntu ubuntu 469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/crushdiff.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281044 4 -rw-r--r-- 1 ubuntu ubuntu 374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/lazy_omap_stats_output.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281041 4 -rw-r--r-- 1 ubuntu ubuntu 1260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/full-tiering.yaml 2024-03-27T21:32:59.549 INFO:teuthology.orchestra.run.smithi063.stdout: 281047 4 -rw-r--r-- 1 ubuntu ubuntu 1077 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281036 4 -rw-r--r-- 1 ubuntu ubuntu 497 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/ceph-kvstore-tool.yaml 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281046 4 -rw-r--r-- 1 ubuntu ubuntu 447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/msgr.yaml 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281051 4 -rw-r--r-- 1 ubuntu ubuntu 308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/version-number-sanity.yaml 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281038 4 -rw-r--r-- 1 ubuntu ubuntu 420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/ceph-snapmapper.yaml 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281049 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/all/pool-access.yaml 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281029 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/% 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281030 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/.qa -> ../.qa/ 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281054 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.550 INFO:teuthology.orchestra.run.smithi063.stdout: 281053 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281052 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-nomsgr/mon_election -> .qa/mon_election 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281012 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281015 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/all 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281016 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/all/.qa -> ../.qa/ 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281017 4 -rw-r--r-- 1 ubuntu ubuntu 1015 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/all/cephtool.yaml 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281019 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/msgr -> .qa/msgr 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281013 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/% 2024-03-27T21:32:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 281021 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/objectstore 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281025 0 lrwxrwxrwx 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/objectstore/bluestore-comp-snappy.yaml -> .qa/objectstore_debug/bluestore-comp-snappy.yaml 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281022 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281023 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/objectstore/bluestore-bitmap.yaml -> .qa/objectstore_debug/bluestore-bitmap.yaml 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281024 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/objectstore/bluestore-comp-lz4.yaml -> .qa/objectstore_debug/bluestore-comp-lz4.yaml 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281020 0 lrwxrwxrwx 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/msgr-failures -> ../singleton/msgr-failures 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281014 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/.qa -> ../.qa/ 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281027 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281026 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.552 INFO:teuthology.orchestra.run.smithi063.stdout: 281018 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/singleton-bluestore/mon_election -> .qa/mon_election 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281436 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281455 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/msgr -> .qa/msgr 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281440 4 -rw-r--r-- 1 ubuntu ubuntu 328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/ceph.yaml 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281437 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/% 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281459 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281456 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/msgr-failures 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281457 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281458 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/msgr-failures/few.yaml 2024-03-27T21:32:59.553 INFO:teuthology.orchestra.run.smithi063.stdout: 281438 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/.qa -> ../.qa/ 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281441 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/clusters 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281444 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281442 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/clusters/+ 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281443 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281445 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/clusters/openstack.yaml 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281460 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281446 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash 2024-03-27T21:32:59.554 INFO:teuthology.orchestra.run.smithi063.stdout: 281447 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281448 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/default 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281449 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/default/+ 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281450 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/default/.qa -> ../.qa/ 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281452 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/default/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281451 4 -rw-r--r-- 1 ubuntu ubuntu 227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/default/default.yaml 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281453 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/d-thrash/none.yaml 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/validater 2024-03-27T21:32:59.555 INFO:teuthology.orchestra.run.smithi063.stdout: 281467 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/validater/.qa -> ../.qa/ 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281468 4 -rw-r--r-- 1 ubuntu ubuntu 65 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/validater/lockdep.yaml 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281469 4 -rw-r--r-- 1 ubuntu ubuntu 992 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/validater/valgrind.yaml 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281439 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/tasks 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281462 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281465 4 -rw-r--r-- 1 ubuntu ubuntu 224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/tasks/rados_cls_all.yaml 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281463 4 -rw-r--r-- 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/tasks/mon_recovery.yaml 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281464 4 -rw-r--r-- 1 ubuntu ubuntu 743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/tasks/rados_api_tests.yaml 2024-03-27T21:32:59.556 INFO:teuthology.orchestra.run.smithi063.stdout: 281454 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/verify/mon_election -> .qa/mon_election 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281423 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/upgrade 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281424 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281425 0 lrwxrwxrwx 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/upgrade/parallel -> ../../upgrade/reef-x/parallel 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281273 4 drwxr-xr-x 11 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281297 4 -rw-r--r-- 1 ubuntu ubuntu 149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/ceph.yaml 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281274 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/% 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/d-balancer 2024-03-27T21:32:59.557 INFO:teuthology.orchestra.run.smithi063.stdout: 281304 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/d-balancer/.qa -> ../.qa/ 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281305 4 -rw-r--r-- 1 ubuntu ubuntu 148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/d-balancer/crush-compat.yaml 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281306 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/d-balancer/on.yaml 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281308 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/msgr-failures 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281309 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281311 4 -rw-r--r-- 1 ubuntu ubuntu 237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/msgr-failures/few.yaml 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281310 4 -rw-r--r-- 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/msgr-failures/fastclose.yaml 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281312 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/msgr-failures/osd-delay.yaml 2024-03-27T21:32:59.558 INFO:teuthology.orchestra.run.smithi063.stdout: 281275 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/.qa -> ../.qa/ 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281322 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281323 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281324 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281328 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads/snaps-few-objects.yaml 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281329 4 -rw-r--r-- 1 ubuntu ubuntu 126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads/test_rbd_api.yaml 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281326 4 -rw-r--r-- 1 ubuntu ubuntu 598 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads/radosbench.yaml 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281327 4 -rw-r--r-- 1 ubuntu ubuntu 185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads/rbd_cls.yaml 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281325 4 -rw-r--r-- 1 ubuntu ubuntu 999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/workloads/cache-snaps.yaml 2024-03-27T21:32:59.559 INFO:teuthology.orchestra.run.smithi063.stdout: 281298 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/clusters 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281299 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/clusters/+ 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281300 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281301 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/clusters/openstack.yaml 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281302 4 -rw-r--r-- 1 ubuntu ubuntu 328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/clusters/three-plus-one.yaml 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281313 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281292 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/backoff 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281296 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/backoff/peering_and_degraded.yaml 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281293 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/backoff/.qa -> ../.qa/ 2024-03-27T21:32:59.560 INFO:teuthology.orchestra.run.smithi063.stdout: 281294 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/backoff/normal.yaml 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281295 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/backoff/peering.yaml 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281279 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-size-min-size-overrides 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281281 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-size-min-size-overrides/2-size-2-min-size.yaml -> .qa/overrides/2-size-2-min-size.yaml 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281280 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-size-min-size-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281282 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-size-min-size-overrides/3-size-2-min-size.yaml -> .qa/overrides/3-size-2-min-size.yaml 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281314 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers 2024-03-27T21:32:59.561 INFO:teuthology.orchestra.run.smithi063.stdout: 281315 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281321 4 -rw-r--r-- 1 ubuntu ubuntu 660 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/pggrow.yaml 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281318 4 -rw-r--r-- 1 ubuntu ubuntu 730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/mapgap.yaml 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281316 4 -rw-r--r-- 1 ubuntu ubuntu 709 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/careful.yaml 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281320 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/none.yaml 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281317 4 -rw-r--r-- 1 ubuntu ubuntu 672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/default.yaml 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281319 4 -rw-r--r-- 1 ubuntu ubuntu 571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/thrashers/morepggrow.yaml 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281307 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/mon_election -> .qa/mon_election 2024-03-27T21:32:59.562 INFO:teuthology.orchestra.run.smithi063.stdout: 281276 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-distro$ 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281277 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-distro$/.qa -> ../.qa/ 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281278 0 lrwxrwxrwx 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/0-distro$/centos_8.stream_container_tools.yaml -> .qa/distros/podman/centos_8.stream_container_tools.yaml 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281283 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281289 4 -rw-r--r-- 1 ubuntu ubuntu 902 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/pacific.yaml 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281284 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/.qa -> ../.qa/ 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281291 4 -rw-r--r-- 1 ubuntu ubuntu 899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/reef.yaml 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281285 4 -rw-r--r-- 1 ubuntu ubuntu 506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/nautilus-v1only.yaml 2024-03-27T21:32:59.563 INFO:teuthology.orchestra.run.smithi063.stdout: 281286 4 -rw-r--r-- 1 ubuntu ubuntu 508 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/nautilus-v2only.yaml 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281288 4 -rw-r--r-- 1 ubuntu ubuntu 902 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/octopus.yaml 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281290 4 -rw-r--r-- 1 ubuntu ubuntu 901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/quincy.yaml 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281287 4 -rw-r--r-- 1 ubuntu ubuntu 404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-old-clients/1-install/nautilus.yaml 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281113 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/% 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281114 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/.qa -> ../.qa/ 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281115 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281116 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads 2024-03-27T21:32:59.564 INFO:teuthology.orchestra.run.smithi063.stdout: 281117 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281124 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/mon.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281127 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/scrub.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281119 4 -rw-r--r-- 1 ubuntu ubuntu 254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/crush.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281126 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/osd.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281123 4 -rw-r--r-- 1 ubuntu ubuntu 259 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/mon-stretch.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281118 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/c2c.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281122 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/misc.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281125 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/osd-backfill.yaml 2024-03-27T21:32:59.565 INFO:teuthology.orchestra.run.smithi063.stdout: 281121 4 -rw-r--r-- 1 ubuntu ubuntu 252 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/mgr.yaml 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281120 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/standalone/workloads/erasure-code.yaml 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281330 4 drwxr-xr-x 13 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281377 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr -> .qa/msgr 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281360 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/ceph.yaml 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281366 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/crc-failures 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281367 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/crc-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281368 4 -rw-r--r-- 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/crc-failures/bad_map_crc_failure.yaml 2024-03-27T21:32:59.566 INFO:teuthology.orchestra.run.smithi063.stdout: 281369 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/crc-failures/default.yaml 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281331 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/% 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281370 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/d-balancer 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281371 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/d-balancer/.qa -> ../.qa/ 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281375 4 -rw-r--r-- 1 ubuntu ubuntu 292 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/d-balancer/upmap-read.yaml 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281372 4 -rw-r--r-- 1 ubuntu ubuntu 148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/d-balancer/crush-compat.yaml 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281374 4 -rw-r--r-- 1 ubuntu ubuntu 286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/d-balancer/read.yaml 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281373 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/d-balancer/on.yaml 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281384 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.567 INFO:teuthology.orchestra.run.smithi063.stdout: 281378 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr-failures 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281379 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281383 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr-failures/osd-dispatch-delay.yaml 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281381 4 -rw-r--r-- 1 ubuntu ubuntu 237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr-failures/few.yaml 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281380 4 -rw-r--r-- 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr-failures/fastclose.yaml 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281382 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/msgr-failures/osd-delay.yaml 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281332 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281337 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/1-pg-log-overrides 2024-03-27T21:32:59.568 INFO:teuthology.orchestra.run.smithi063.stdout: 281338 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/1-pg-log-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281339 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281340 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml -> .qa/overrides/short_pg_log.yaml 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281395 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281386 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281396 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281420 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/snaps-few-objects-localized.yaml 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281405 4 -rw-r--r-- 1 ubuntu ubuntu 1152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache.yaml 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281419 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/snaps-few-objects-balanced.yaml 2024-03-27T21:32:59.569 INFO:teuthology.orchestra.run.smithi063.stdout: 281397 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281408 4 -rw-r--r-- 1 ubuntu ubuntu 375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281421 4 -rw-r--r-- 1 ubuntu ubuntu 289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/snaps-few-objects.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281411 4 -rw-r--r-- 1 ubuntu ubuntu 480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/radosbench.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281412 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/redirect.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281413 4 -rw-r--r-- 1 ubuntu ubuntu 341 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/redirect_promote_tests.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281403 4 -rw-r--r-- 1 ubuntu ubuntu 1230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache-snaps-balanced.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281422 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml 2024-03-27T21:32:59.570 INFO:teuthology.orchestra.run.smithi063.stdout: 281410 4 -rw-r--r-- 1 ubuntu ubuntu 971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/radosbench-high-concurrency.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281414 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/redirect_set_object.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281402 4 -rw-r--r-- 1 ubuntu ubuntu 1342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache-pool-snaps.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281401 4 -rw-r--r-- 1 ubuntu ubuntu 1159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281417 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/small-objects-localized.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281406 4 -rw-r--r-- 1 ubuntu ubuntu 477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/dedup-io-mixed.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281409 4 -rw-r--r-- 1 ubuntu ubuntu 468 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/rados_api_tests.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281407 4 -rw-r--r-- 1 ubuntu ubuntu 540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/dedup-io-snaps.yaml 2024-03-27T21:32:59.571 INFO:teuthology.orchestra.run.smithi063.stdout: 281404 4 -rw-r--r-- 1 ubuntu ubuntu 1206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache-snaps.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281415 4 -rw-r--r-- 1 ubuntu ubuntu 321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/set-chunks-read.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281416 4 -rw-r--r-- 1 ubuntu ubuntu 439 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/small-objects-balanced.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281400 4 -rw-r--r-- 1 ubuntu ubuntu 1140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache-agent-small.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281399 4 -rw-r--r-- 1 ubuntu ubuntu 1200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/cache-agent-big.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281418 4 -rw-r--r-- 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/small-objects.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281398 4 -rw-r--r-- 1 ubuntu ubuntu 375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281361 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/clusters 2024-03-27T21:32:59.572 INFO:teuthology.orchestra.run.smithi063.stdout: 281362 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/clusters/+ 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281363 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281365 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/clusters/openstack.yaml 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281364 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/clusters/fixed-4.yaml -> .qa/clusters/fixed-4.yaml 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281385 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281355 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/backoff 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281359 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/backoff/peering_and_degraded.yaml 2024-03-27T21:32:59.573 INFO:teuthology.orchestra.run.smithi063.stdout: 281356 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/backoff/.qa -> ../.qa/ 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281357 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/backoff/normal.yaml 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281358 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/backoff/peering.yaml 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281349 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/3-scrub-overrides 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281351 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/3-scrub-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281353 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/3-scrub-overrides/max-simultaneous-scrubs-3.yaml 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281352 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/3-scrub-overrides/max-simultaneous-scrubs-1.yaml 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281354 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/3-scrub-overrides/max-simultaneous-scrubs-5.yaml 2024-03-27T21:32:59.574 INFO:teuthology.orchestra.run.smithi063.stdout: 281350 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/3-scrub-overrides/$ 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281333 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/0-size-min-size-overrides 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281335 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml -> .qa/overrides/2-size-2-min-size.yaml 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281334 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/0-size-min-size-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281336 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml -> .qa/overrides/3-size-2-min-size.yaml 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281387 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281388 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281394 4 -rw-r--r-- 1 ubuntu ubuntu 666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/pggrow.yaml 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281391 4 -rw-r--r-- 1 ubuntu ubuntu 820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/mapgap.yaml 2024-03-27T21:32:59.575 INFO:teuthology.orchestra.run.smithi063.stdout: 281389 4 -rw-r--r-- 1 ubuntu ubuntu 742 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/careful.yaml 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281393 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/none.yaml 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281390 4 -rw-r--r-- 1 ubuntu ubuntu 800 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/default.yaml 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281392 4 -rw-r--r-- 1 ubuntu ubuntu 554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/thrashers/morepggrow.yaml 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281376 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/mon_election -> .qa/mon_election 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281341 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281347 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/more-async-recovery.yaml 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281343 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.576 INFO:teuthology.orchestra.run.smithi063.stdout: 281346 4 -rw-r--r-- 1 ubuntu ubuntu 138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/more-async-partial-recovery.yaml 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281348 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/more-partial-recovery.yaml 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281342 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/$ 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281345 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/more-active-recovery.yaml -> .qa/overrides/more-active-recovery.yaml 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281344 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash/2-recovery-overrides/default.yaml 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281128 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281131 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/ceph.yaml -> ../thrash/ceph.yaml 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281129 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/% 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281139 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.577 INFO:teuthology.orchestra.run.smithi063.stdout: 281138 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/msgr-failures -> ../thrash/msgr-failures 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281130 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/.qa -> ../.qa/ 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281151 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281142 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281152 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/workloads 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281153 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281155 0 lrwxrwxrwx 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml -> .qa/erasure-code/ec-rados-plugin=jerasure-k=4-m=2.yaml 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281154 0 lrwxrwxrwx 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=clay-k=4-m=2.yaml -> .qa/erasure-code/ec-rados-plugin=clay-k=4-m=2.yaml 2024-03-27T21:32:59.578 INFO:teuthology.orchestra.run.smithi063.stdout: 281156 0 lrwxrwxrwx 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml -> .qa/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281140 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281141 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/recovery-overrides -> ../thrash/2-recovery-overrides 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281144 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281150 4 -rw-r--r-- 1 ubuntu ubuntu 366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281148 4 -rw-r--r-- 1 ubuntu ubuntu 531 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281147 4 -rw-r--r-- 1 ubuntu ubuntu 498 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml 2024-03-27T21:32:59.579 INFO:teuthology.orchestra.run.smithi063.stdout: 281145 4 -rw-r--r-- 1 ubuntu ubuntu 499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/careful.yaml 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281146 4 -rw-r--r-- 1 ubuntu ubuntu 529 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/default.yaml 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281149 4 -rw-r--r-- 1 ubuntu ubuntu 366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281132 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/cluster 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281133 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/cluster/+ 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281134 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281136 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281135 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281137 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-big/mon_election -> .qa/mon_election 2024-03-27T21:32:59.580 INFO:teuthology.orchestra.run.smithi063.stdout: 281176 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281182 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/ceph.yaml -> ../thrash/ceph.yaml 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281177 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/% 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/arch 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281181 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281180 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/arch/.qa -> ../.qa/ 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281186 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281185 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/msgr-failures -> ../thrash/msgr-failures 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281178 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/.qa -> ../.qa/ 2024-03-27T21:32:59.581 INFO:teuthology.orchestra.run.smithi063.stdout: 281191 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281189 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281192 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/workloads 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281194 0 lrwxrwxrwx 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml -> .qa/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281193 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281183 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/clusters -> ../thrash/clusters 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281187 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281188 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/recovery-overrides -> ../thrash/2-recovery-overrides 2024-03-27T21:32:59.582 INFO:teuthology.orchestra.run.smithi063.stdout: 281190 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/thrashers -> ../thrash/thrashers 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281184 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code-isa/mon_election -> .qa/mon_election 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281238 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281243 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/fast 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281244 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/fast/.qa -> ../.qa/ 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281246 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/fast/normal.yaml 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281245 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/fast/fast.yaml 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281241 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/ceph.yaml 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281239 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/% 2024-03-27T21:32:59.583 INFO:teuthology.orchestra.run.smithi063.stdout: 281249 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281248 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/msgr-failures -> ../thrash/msgr-failures 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281240 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/.qa -> ../.qa/ 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281261 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281252 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/supported-random-distro$ -> ../basic/supported-random-distro$ 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281262 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281263 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281267 4 lrwxrwxrwx 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=8-m=6-crush.yaml -> .qa/erasure-code/ec-rados-plugin=jerasure-k=8-m=6-crush.yaml 2024-03-27T21:32:59.584 INFO:teuthology.orchestra.run.smithi063.stdout: 281264 0 lrwxrwxrwx 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=clay-k=4-m=2.yaml -> .qa/erasure-code/ec-rados-plugin=clay-k=4-m=2.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281266 0 lrwxrwxrwx 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml -> .qa/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281268 4 -rw-r--r-- 1 ubuntu ubuntu 536 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281270 4 -rw-r--r-- 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281271 4 -rw-r--r-- 1 ubuntu ubuntu 227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-small-objects-many-deletes.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281265 0 lrwxrwxrwx 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml -> .qa/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281272 4 -rw-r--r-- 1 ubuntu ubuntu 351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281269 4 -rw-r--r-- 1 ubuntu ubuntu 376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/workloads/ec-small-objects-balanced.yaml 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281242 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/clusters -> ../thrash/clusters 2024-03-27T21:32:59.585 INFO:teuthology.orchestra.run.smithi063.stdout: 281250 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281251 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/recovery-overrides -> ../thrash/2-recovery-overrides 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281258 4 -rw-r--r-- 1 ubuntu ubuntu 535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/minsize_recovery.yaml 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281254 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281260 4 -rw-r--r-- 1 ubuntu ubuntu 366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281257 4 -rw-r--r-- 1 ubuntu ubuntu 498 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/fastread.yaml 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281255 4 -rw-r--r-- 1 ubuntu ubuntu 480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/careful.yaml 2024-03-27T21:32:59.586 INFO:teuthology.orchestra.run.smithi063.stdout: 281256 4 -rw-r--r-- 1 ubuntu ubuntu 510 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/default.yaml 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 281259 4 -rw-r--r-- 1 ubuntu ubuntu 366 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 281247 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/thrash-erasure-code/mon_election -> .qa/mon_election 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 280855 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/cephadm 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 280856 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/cephadm/.qa -> ../.qa/ 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 280859 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/cephadm/smoke-singlehost -> .qa/suites/orch/cephadm/smoke-singlehost/ 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 280857 0 lrwxrwxrwx 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/cephadm/osds -> .qa/suites/orch/cephadm/osds/ 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 280860 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/cephadm/workunits -> .qa/suites/orch/cephadm/workunits/ 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 280858 0 lrwxrwxrwx 1 ubuntu ubuntu 29 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/cephadm/smoke -> .qa/suites/orch/cephadm/smoke 2024-03-27T21:32:59.587 INFO:teuthology.orchestra.run.smithi063.stdout: 281426 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281430 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/2-inject-leak 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281431 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/2-inject-leak/.qa -> ../.qa/ 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281432 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/2-inject-leak/mon.yaml 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281434 4 -rw-r--r-- 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/2-inject-leak/osd.yaml 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281433 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/2-inject-leak/none.yaml 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281427 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/% 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281428 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/.qa -> ../.qa/ 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281429 4 -rw-r--r-- 1 ubuntu ubuntu 685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/1-start.yaml 2024-03-27T21:32:59.588 INFO:teuthology.orchestra.run.smithi063.stdout: 281435 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/valgrind-leaks/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280823 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280833 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/msgr -> .qa/msgr 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280826 4 -rw-r--r-- 1 ubuntu ubuntu 380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/ceph.yaml 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280824 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/% 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280838 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/objectstore -> .qa/objectstore_debug 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/msgr-failures 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280835 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.589 INFO:teuthology.orchestra.run.smithi063.stdout: 280836 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/msgr-failures/few.yaml 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280837 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/msgr-failures/many.yaml 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280825 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280840 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280827 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/clusters 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280830 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280828 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/clusters/+ 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280829 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.590 INFO:teuthology.orchestra.run.smithi063.stdout: 280831 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/clusters/openstack.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280839 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/rados.yaml -> .qa/config/rados.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280841 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280843 4 -rw-r--r-- 1 ubuntu ubuntu 662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/libcephsqlite.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280851 4 -rw-r--r-- 1 ubuntu ubuntu 204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280854 4 -rw-r--r-- 1 ubuntu ubuntu 889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/scrub_test.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280842 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280850 4 -rw-r--r-- 1 ubuntu ubuntu 197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280845 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_cls_all.yaml 2024-03-27T21:32:59.591 INFO:teuthology.orchestra.run.smithi063.stdout: 280847 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_stress_watch.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280853 4 -rw-r--r-- 1 ubuntu ubuntu 959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/repair_test.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280844 4 -rw-r--r-- 1 ubuntu ubuntu 581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_api_tests.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280852 4 -rw-r--r-- 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/readwrite.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280846 4 -rw-r--r-- 1 ubuntu ubuntu 407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_python.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280849 4 -rw-r--r-- 1 ubuntu ubuntu 197 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280848 4 -rw-r--r-- 1 ubuntu ubuntu 214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/tasks/rados_striper.yaml 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 280832 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rados/basic/mon_election -> .qa/mon_election 2024-03-27T21:32:59.592 INFO:teuthology.orchestra.run.smithi063.stdout: 279003 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279004 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/% 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279006 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/0-clusters 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279007 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/0-clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279008 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/0-clusters/3-node.yaml 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279005 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/.qa -> ../.qa/ 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279022 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/4-epel 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279024 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/4-epel/no_epel.yaml 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279023 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/4-epel/.qa -> ../.qa/ 2024-03-27T21:32:59.593 INFO:teuthology.orchestra.run.smithi063.stdout: 279025 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/4-epel/use_epel.yaml 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279009 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/1-distros 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279010 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/1-distros/.qa -> ../.qa/ 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279012 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/1-distros/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279011 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/1-distros/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279013 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/2-ceph 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279014 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/2-ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279015 4 -rw-r--r-- 1 ubuntu ubuntu 822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/2-ceph/ceph_ansible.yaml 2024-03-27T21:32:59.594 INFO:teuthology.orchestra.run.smithi063.stdout: 279016 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/3-ceph-config 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279018 4 -rw-r--r-- 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/3-ceph-config/bluestore_with_dmcrypt.yaml 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279017 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/3-ceph-config/.qa -> ../.qa/ 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279021 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/3-ceph-config/dmcrypt_on.yaml 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279019 4 -rw-r--r-- 1 ubuntu ubuntu 144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/3-ceph-config/bluestore_without_dmcrypt.yaml 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279020 4 -rw-r--r-- 1 ubuntu ubuntu 95 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/3-ceph-config/dmcrypt_off.yaml 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279026 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/5-containers 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279027 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/5-containers/.qa -> ../.qa/ 2024-03-27T21:32:59.595 INFO:teuthology.orchestra.run.smithi063.stdout: 279029 4 -rw-r--r-- 1 ubuntu ubuntu 202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/5-containers/no_containers.yaml 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 279028 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/5-containers/containerized.yaml 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 279030 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/6-tasks 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 279031 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/6-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 279032 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/cephmetrics/6-tasks/cephmetrics.yaml 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 278917 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/.qa -> ../.qa/ 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 280774 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 280777 4 -rw-r--r-- 1 ubuntu ubuntu 494 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/ceph.yaml 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 280775 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/% 2024-03-27T21:32:59.596 INFO:teuthology.orchestra.run.smithi063.stdout: 280778 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/objectstore 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280779 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280780 4 -rw-r--r-- 1 ubuntu ubuntu 327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/objectstore/bluestore.yaml 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280776 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/.qa -> ../.qa/ 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280784 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280785 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/workloads 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280788 4 -rw-r--r-- 1 ubuntu ubuntu 591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/workloads/fio_4K_rand_write.yaml 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280786 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.597 INFO:teuthology.orchestra.run.smithi063.stdout: 280789 4 -rw-r--r-- 1 ubuntu ubuntu 580 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/workloads/radosbench_4K_write.yaml 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 280787 4 -rw-r--r-- 1 ubuntu ubuntu 642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/workloads/client_endpoint_rbd_4K_rand_write.yaml 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 280781 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/settings 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 280782 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/settings/.qa -> ../.qa/ 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 280783 4 -rw-r--r-- 1 ubuntu ubuntu 2106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/perf-basic/settings/optimized.yaml 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 282341 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 282342 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/% 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 282356 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/objectstore -> .qa/objectstore 2024-03-27T21:32:59.598 INFO:teuthology.orchestra.run.smithi063.stdout: 282343 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/.qa -> ../.qa/ 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282347 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/install 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282349 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/install/install.yaml 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282348 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/install/.qa -> ../.qa/ 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282350 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/mount 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282351 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282353 4 -rw-r--r-- 1 ubuntu ubuntu 204 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/mount/kclient.yaml 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282355 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/mount/noceph.yaml 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282354 4 -rw-r--r-- 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/mount/native.yaml 2024-03-27T21:32:59.599 INFO:teuthology.orchestra.run.smithi063.stdout: 282352 4 -rw-r--r-- 1 ubuntu ubuntu 84 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/mount/fuse.yaml 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282344 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/clusters 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282346 4 -rw-r--r-- 1 ubuntu ubuntu 172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/clusters/samba-basic.yaml 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282345 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/workload 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282358 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/workload/.qa -> ../.qa/ 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282359 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/workload/cifs-dbench.yaml 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282361 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/workload/cifs-kernel-build.yaml.disabled 2024-03-27T21:32:59.600 INFO:teuthology.orchestra.run.smithi063.stdout: 282362 4 -rw-r--r-- 1 ubuntu ubuntu 3221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/workload/smbtorture.yaml 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282360 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/samba/workload/cifs-fsstress.yaml 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 281998 4 drwxr-xr-x 21 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282000 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282006 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282001 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/+ 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282002 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/.qa -> ../.qa/ 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282003 4 -rw-r--r-- 1 ubuntu ubuntu 124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/cluster.yaml 2024-03-27T21:32:59.601 INFO:teuthology.orchestra.run.smithi063.stdout: 282007 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282004 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282008 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/tasks 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282010 4 -rw-r--r-- 1 ubuntu ubuntu 1907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/tasks/cloud_transition_s3tests.yaml 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282009 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282005 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/cloud-transition/overrides.yaml 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282037 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282038 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/+ 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282039 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/.qa -> ../.qa/ 2024-03-27T21:32:59.602 INFO:teuthology.orchestra.run.smithi063.stdout: 282040 4 -rw-r--r-- 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/cluster.yaml 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282043 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282041 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282044 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/tasks 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282046 4 -rw-r--r-- 1 ubuntu ubuntu 398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/tasks/rgw_d4ntests.yaml 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282045 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282042 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/d4n/overrides.yaml 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 281999 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/.qa -> ../.qa/ 2024-03-27T21:32:59.603 INFO:teuthology.orchestra.run.smithi063.stdout: 282116 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282125 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/realms 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282126 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/realms/.qa -> ../.qa/ 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282128 4 -rw-r--r-- 1 ubuntu ubuntu 775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/realms/two-zonegroup.yaml 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282127 4 -rw-r--r-- 1 ubuntu ubuntu 596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/realms/three-zones.yaml 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282117 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/% 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282118 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/.qa -> ../.qa/ 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282123 4 -rw-r--r-- 1 ubuntu ubuntu 433 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/omap_limits.yaml 2024-03-27T21:32:59.604 INFO:teuthology.orchestra.run.smithi063.stdout: 282120 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282129 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282119 4 -rw-r--r-- 1 ubuntu ubuntu 165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/clusters.yaml 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282122 4 -rw-r--r-- 1 ubuntu ubuntu 134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/notify.yaml 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282133 4 -rw-r--r-- 1 ubuntu ubuntu 521 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/valgrind.yaml.disabled 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282121 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282130 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/tasks 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282131 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282132 4 -rw-r--r-- 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/tasks/test_multi.yaml 2024-03-27T21:32:59.605 INFO:teuthology.orchestra.run.smithi063.stdout: 282124 4 -rw-r--r-- 1 ubuntu ubuntu 698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multisite/overrides.yaml 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282159 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282160 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/% 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282161 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/.qa -> ../.qa/ 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282171 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282165 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/clusters 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282164 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/clusters/fixed-1.yaml -> .qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.606 INFO:teuthology.orchestra.run.smithi063.stdout: 282163 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282166 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282168 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/tasks 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282169 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282170 4 -rw-r--r-- 1 ubuntu ubuntu 171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/tasks/service-token.yaml 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282167 4 -rw-r--r-- 1 ubuntu ubuntu 795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/service-token/overrides.yaml 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282184 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282193 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.607 INFO:teuthology.orchestra.run.smithi063.stdout: 282185 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/% 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282192 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/rgw_frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282186 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/.qa -> ../.qa/ 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282189 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/objectstore.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282187 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/cluster.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282194 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282188 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282191 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/pool-type.yaml -> .qa/rgw_pool_type/replicated.yaml 2024-03-27T21:32:59.608 INFO:teuthology.orchestra.run.smithi063.stdout: 282195 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/tasks 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282196 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/tasks/+ 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282197 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282200 4 -rw-r--r-- 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/tasks/2-s3tests.yaml 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282199 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/tasks/1-keycloak.yaml 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282198 4 -rw-r--r-- 1 ubuntu ubuntu 63 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/tasks/0-install.yaml 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282190 4 -rw-r--r-- 1 ubuntu ubuntu 625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/sts/overrides.yaml 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282083 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua 2024-03-27T21:32:59.609 INFO:teuthology.orchestra.run.smithi063.stdout: 282088 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282084 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/% 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282085 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/.qa -> ../.qa/ 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282091 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/supported-distros -> .qa/distros/supported-random-distro$/ 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282087 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282086 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/beast.yaml -> .qa/rgw_frontend/beast.yaml 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282089 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282092 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/tasks 2024-03-27T21:32:59.610 INFO:teuthology.orchestra.run.smithi063.stdout: 282093 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/tasks/+ 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282095 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/tasks/test_lua.yaml 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282094 4 -rw-r--r-- 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/tasks/0-install.yaml 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282090 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lua/overrides.yaml 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282239 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282240 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools/+ 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282241 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools/.qa -> ../.qa/ 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282243 4 -rw-r--r-- 1 ubuntu ubuntu 173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools/cluster.yaml 2024-03-27T21:32:59.611 INFO:teuthology.orchestra.run.smithi063.stdout: 282245 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools/tasks.yaml 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282242 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282244 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tools/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282172 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/all 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282176 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/all/.qa -> ../.qa/ 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282177 4 -rw-r--r-- 1 ubuntu ubuntu 367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/all/radosgw-admin.yaml 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282173 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/% 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282180 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/objectstore -> .qa/objectstore_cephfs 2024-03-27T21:32:59.612 INFO:teuthology.orchestra.run.smithi063.stdout: 282174 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/.qa -> ../.qa/ 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282178 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282183 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282182 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/rgw_pool_type -> .qa/rgw_pool_type 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282179 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282181 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/singleton/overrides.yaml 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282201 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282211 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282202 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/% 2024-03-27T21:32:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 282203 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/.qa -> ../.qa/ 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282216 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282208 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282205 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/clusters 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282207 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/clusters/fixed-1.yaml -> .qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282206 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282209 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282212 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/tasks 2024-03-27T21:32:59.614 INFO:teuthology.orchestra.run.smithi063.stdout: 282215 4 -rw-r--r-- 1 ubuntu ubuntu 1689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/tasks/tempest.yaml 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282213 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282214 4 -rw-r--r-- 1 ubuntu ubuntu 905 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/tasks/s3tests.yaml 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282210 4 -rw-r--r-- 1 ubuntu ubuntu 669 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/overrides.yaml 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282204 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/tempest/0-install.yaml 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282278 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282305 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/sharding$ -> .qa/rgw_bucket_sharding 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282304 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.615 INFO:teuthology.orchestra.run.smithi063.stdout: 282279 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/% 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282297 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/objectstore -> .qa/objectstore_cephfs 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282294 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/msgr-failures 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282295 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282296 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/msgr-failures/few.yaml 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282280 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/.qa -> ../.qa/ 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/inline-data$ 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282292 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/inline-data$/off.yaml 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282293 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/inline-data$/on.yaml 2024-03-27T21:32:59.616 INFO:teuthology.orchestra.run.smithi063.stdout: 282285 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/datacache 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282287 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/datacache/no_datacache.yaml 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282286 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/datacache/.qa -> ../.qa/ 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282288 4 -rw-r--r-- 1 ubuntu ubuntu 435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/datacache/rgw-datacache.yaml 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/striping$ 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282307 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/striping$/.qa -> ../.qa/ 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282309 4 -rw-r--r-- 1 ubuntu ubuntu 186 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/striping$/stripe-greater-than-chunk.yaml 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282308 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/striping$/stripe-equals-chunk.yaml 2024-03-27T21:32:59.617 INFO:teuthology.orchestra.run.smithi063.stdout: 282289 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282310 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282303 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/rgw_pool_type -> .qa/rgw_pool_type 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282282 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/clusters 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282284 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282283 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282322 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/validater 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282323 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/validater/.qa -> ../.qa/ 2024-03-27T21:32:59.618 INFO:teuthology.orchestra.run.smithi063.stdout: 282324 4 -rw-r--r-- 1 ubuntu ubuntu 95 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/validater/lockdep.yaml 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282325 4 -rw-r--r-- 1 ubuntu ubuntu 546 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/validater/valgrind.yaml 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282290 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282311 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282312 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/+ 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282319 4 -rw-r--r-- 1 ubuntu ubuntu 134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/s3tests-java.yaml 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282314 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/bucket-check.yaml 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282313 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282321 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/versioning.yaml 2024-03-27T21:32:59.619 INFO:teuthology.orchestra.run.smithi063.stdout: 282318 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/reshard.yaml 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282316 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/mp_reupload.yaml 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282315 4 -rw-r--r-- 1 ubuntu ubuntu 445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/cls.yaml 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282317 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/ragweed.yaml 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282320 4 -rw-r--r-- 1 ubuntu ubuntu 59 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/tasks/s3tests.yaml 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282299 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/proto 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282300 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/proto/.qa -> ../.qa/ 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282302 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/proto/https.yaml 2024-03-27T21:32:59.620 INFO:teuthology.orchestra.run.smithi063.stdout: 282301 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/proto/http.yaml 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282298 4 -rw-r--r-- 1 ubuntu ubuntu 573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/overrides.yaml 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282281 4 -rw-r--r-- 1 ubuntu ubuntu 405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/verify/0-install.yaml 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282246 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282247 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/% 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282276 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/objectstore -> .qa/objectstore_cephfs 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282269 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/2-setup.yaml 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282248 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/.qa -> ../.qa 2024-03-27T21:32:59.621 INFO:teuthology.orchestra.run.smithi063.stdout: 282270 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/3-upgrade-sequence 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282272 4 -rw-r--r-- 1 ubuntu ubuntu 601 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/3-upgrade-sequence/rgws-then-osds.yaml 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282271 4 -rw-r--r-- 1 ubuntu ubuntu 600 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/3-upgrade-sequence/osds-then-rgws.yaml 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282273 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/cluster.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282274 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282275 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282277 4 -rw-r--r-- 1 ubuntu ubuntu 418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/overrides.yaml 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282249 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install 2024-03-27T21:32:59.622 INFO:teuthology.orchestra.run.smithi063.stdout: 282250 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/.qa -> ../.qa 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282260 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282267 4 -rw-r--r-- 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/install.yaml 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282261 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/% 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282262 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/.qa -> ../.qa 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282263 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/distro$ 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282264 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/distro$/.qa -> ../.qa 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282266 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/distro$/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.623 INFO:teuthology.orchestra.run.smithi063.stdout: 282265 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/distro$/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282268 4 -rw-r--r-- 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/reef/overrides.yaml 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282251 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282258 4 -rw-r--r-- 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/install.yaml 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282252 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/% 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282253 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/.qa -> ../.qa 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282254 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/distro$ 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282255 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/distro$/.qa -> ../.qa 2024-03-27T21:32:59.624 INFO:teuthology.orchestra.run.smithi063.stdout: 282256 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/distro$/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282257 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/distro$/ubuntu_20.04.yaml -> .qa/distros/all/ubuntu_20.04.yaml 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282259 4 -rw-r--r-- 1 ubuntu ubuntu 109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/upgrade/1-install/quincy/overrides.yaml 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282326 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282336 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282327 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/% 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282328 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/.qa -> ../.qa/ 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282340 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282333 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/http.yaml 2024-03-27T21:32:59.625 INFO:teuthology.orchestra.run.smithi063.stdout: 282332 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282329 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/clusters 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282331 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282330 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282334 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282337 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/tasks 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282338 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282339 4 -rw-r--r-- 1 ubuntu ubuntu 297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/tasks/s3tests-website.yaml 2024-03-27T21:32:59.626 INFO:teuthology.orchestra.run.smithi063.stdout: 282335 4 -rw-r--r-- 1 ubuntu ubuntu 799 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/website/overrides.yaml 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282011 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282035 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282014 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/0-cluster 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282016 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/0-cluster/fixed-1.yaml -> ../../../../clusters/fixed-1.yaml 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282015 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/0-cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282012 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/% 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282013 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/.qa -> ../.qa/ 2024-03-27T21:32:59.627 INFO:teuthology.orchestra.run.smithi063.stdout: 282030 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/4-tests 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282031 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/4-tests/+ 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282032 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/4-tests/.qa -> ../.qa/ 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282033 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/4-tests/s3tests.yaml 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282036 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/ubuntu_latest.yaml -> .qa/distros/all/ubuntu_latest.yaml 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282027 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/3-rgw 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282029 4 -rw-r--r-- 1 ubuntu ubuntu 212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/3-rgw/rgw.yaml 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282028 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/3-rgw/.qa -> ../.qa/ 2024-03-27T21:32:59.628 INFO:teuthology.orchestra.run.smithi063.stdout: 282017 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/1-ceph-install 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282019 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/1-ceph-install/install.yaml 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282018 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/1-ceph-install/.qa -> ../.qa/ 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282034 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282020 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282023 4 -rw-r--r-- 1 ubuntu ubuntu 237 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms/testing.yaml 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282021 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms/.qa -> ../.qa/ 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282022 4 -rw-r--r-- 1 ubuntu ubuntu 2672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms/barbican.yaml 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282025 4 -rw-r--r-- 1 ubuntu ubuntu 664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms/vault_old.yaml 2024-03-27T21:32:59.629 INFO:teuthology.orchestra.run.smithi063.stdout: 282026 4 -rw-r--r-- 1 ubuntu ubuntu 846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms/vault_transit.yaml 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282024 4 -rw-r--r-- 1 ubuntu ubuntu 734 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/crypt/2-kms/vault_kv.yaml 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282217 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282227 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282225 4 -rw-r--r-- 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/install.yaml 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282218 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/% 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282226 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/objectstore -> .qa/objectstore_cephfs 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282219 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.630 INFO:teuthology.orchestra.run.smithi063.stdout: 282232 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282231 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282228 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/thrasher 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282229 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/thrasher/.qa -> ../.qa/ 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282230 4 -rw-r--r-- 1 ubuntu ubuntu 194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/thrasher/default.yaml 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282223 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/clusters 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282222 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.631 INFO:teuthology.orchestra.run.smithi063.stdout: 282221 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282224 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/workload 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282234 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/workload/.qa -> ../.qa/ 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282238 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/workload/rgw_user_quota.yaml 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282235 4 -rw-r--r-- 1 ubuntu ubuntu 166 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/workload/rgw_bucket_quota.yaml 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282237 4 -rw-r--r-- 1 ubuntu ubuntu 351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/workload/rgw_s3tests.yaml 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282236 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/thrash/workload/rgw_multipart_upload.yaml 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282072 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle 2024-03-27T21:32:59.632 INFO:teuthology.orchestra.run.smithi063.stdout: 282078 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282073 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/+ 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282074 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/.qa -> ../.qa/ 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282075 4 -rw-r--r-- 1 ubuntu ubuntu 173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/cluster.yaml 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282079 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282076 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282080 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/tasks 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282081 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.633 INFO:teuthology.orchestra.run.smithi063.stdout: 282082 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/tasks/rgw_s3tests.yaml 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282077 4 -rw-r--r-- 1 ubuntu ubuntu 420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/lifecycle/overrides.yaml 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282134 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282139 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282135 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/% 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282136 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/.qa -> ../.qa/ 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282138 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282137 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/beast.yaml -> .qa/rgw_frontend/beast.yaml 2024-03-27T21:32:59.634 INFO:teuthology.orchestra.run.smithi063.stdout: 282140 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282142 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282143 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282144 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/amqp 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282145 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/amqp/+ 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282148 4 -rw-r--r-- 1 ubuntu ubuntu 128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/amqp/test_amqp.yaml 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282147 0 lrwxrwxrwx 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/amqp/centos_latest.yaml -> ../../.qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282146 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/amqp/0-install.yaml 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282154 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/others 2024-03-27T21:32:59.635 INFO:teuthology.orchestra.run.smithi063.stdout: 282155 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/others/+ 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282157 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/others/supported-distros -> ../../.qa/distros/supported-random-distro$/ 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282158 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/others/test_others.yaml 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282156 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/others/0-install.yaml 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282149 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/kafka 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282150 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/kafka/+ 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282152 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/kafka/supported-distros -> ../../.qa/distros/supported-random-distro$/ 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282153 4 -rw-r--r-- 1 ubuntu ubuntu 153 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/kafka/test_kafka.yaml 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282151 4 -rw-r--r-- 1 ubuntu ubuntu 290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/tasks/kafka/0-install.yaml 2024-03-27T21:32:59.636 INFO:teuthology.orchestra.run.smithi063.stdout: 282141 4 -rw-r--r-- 1 ubuntu ubuntu 405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/notifications/overrides.yaml 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282047 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282053 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282048 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/+ 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282049 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/.qa -> ../.qa/ 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282050 4 -rw-r--r-- 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/cluster.yaml 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282054 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282051 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.637 INFO:teuthology.orchestra.run.smithi063.stdout: 282055 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/tasks 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282056 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282057 4 -rw-r--r-- 1 ubuntu ubuntu 358 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/tasks/rgw_s3tests.yaml 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282052 4 -rw-r--r-- 1 ubuntu ubuntu 243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/dbstore/overrides.yaml 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282058 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282059 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/% 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282060 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/.qa -> ../.qa/ 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282071 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.638 INFO:teuthology.orchestra.run.smithi063.stdout: 282070 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/s3a-hadoop.yaml 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282061 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/clusters 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282063 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282062 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282064 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/hadoop 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282065 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/hadoop/.qa -> ../.qa/ 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282067 4 -rw-r--r-- 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/hadoop/v32.yaml 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282066 4 -rw-r--r-- 1 ubuntu ubuntu 1 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/hadoop/default.yaml 2024-03-27T21:32:59.639 INFO:teuthology.orchestra.run.smithi063.stdout: 282068 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282069 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/hadoop-s3a/overrides.yaml 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282096 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282107 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/s3tests-branch.yaml -> .qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282097 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/% 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282104 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/objectstore -> .qa/objectstore_cephfs 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282098 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/.qa -> ../.qa/ 2024-03-27T21:32:59.640 INFO:teuthology.orchestra.run.smithi063.stdout: 282115 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282102 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/frontend -> .qa/rgw_frontend 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282106 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/rgw_pool_type -> .qa/rgw_pool_type 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282099 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/clusters 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282101 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282100 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282103 0 lrwxrwxrwx 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/ignore-pg-availability.yaml -> .qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282108 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282109 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.641 INFO:teuthology.orchestra.run.smithi063.stdout: 282112 4 -rw-r--r-- 1 ubuntu ubuntu 276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks/rgw_ragweed.yaml 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 282114 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks/rgw_user_quota.yaml 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 282110 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 282113 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks/rgw_s3tests.yaml 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 282111 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 282105 4 -rw-r--r-- 1 ubuntu ubuntu 435 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw/multifs/overrides.yaml 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 278980 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 278981 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/% 2024-03-27T21:32:59.642 INFO:teuthology.orchestra.run.smithi063.stdout: 278982 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/.qa -> ../.qa/ 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278995 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/python_versions 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278996 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/python_versions/.qa -> ../.qa/ 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278997 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/python_versions/python_2.yaml 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278998 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/python_versions/python_3.yaml 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278991 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/distros 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278992 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/distros/.qa -> ../.qa/ 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278994 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/distros/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278993 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/distros/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.643 INFO:teuthology.orchestra.run.smithi063.stdout: 278999 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/tasks 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 279000 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 279002 4 -rw-r--r-- 1 ubuntu ubuntu 187 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/tasks/rbd_import_export.yaml 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 279001 4 -rw-r--r-- 1 ubuntu ubuntu 290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/tasks/ceph-admin-commands.yaml 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 278983 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/cluster 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 278984 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 278985 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/cluster/4node.yaml 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 278986 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/config 2024-03-27T21:32:59.644 INFO:teuthology.orchestra.run.smithi063.stdout: 278990 4 -rw-r--r-- 1 ubuntu ubuntu 55 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/config/ceph_volume_dmcrypt_off.yaml 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 278987 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/config/.qa -> ../.qa/ 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 278989 4 -rw-r--r-- 1 ubuntu ubuntu 162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/config/ceph_volume_bluestore_dmcrypt.yaml 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 278988 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-deploy/config/ceph_volume_bluestore.yaml 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 280220 4 drwxr-xr-x 13 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 280254 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 280255 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/% 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 280275 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/objectstore 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 280276 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.645 INFO:teuthology.orchestra.run.smithi063.stdout: 280277 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280256 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/.qa -> ../.qa/ 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280268 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$ 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280270 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$/crc-rxbounce.yaml 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280274 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$/secure.yaml 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280272 4 -rw-r--r-- 1 ubuntu ubuntu 126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$/legacy-rxbounce.yaml 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280271 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$/crc.yaml 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280269 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$/.qa -> ../.qa/ 2024-03-27T21:32:59.646 INFO:teuthology.orchestra.run.smithi063.stdout: 280273 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ms_mode$/legacy.yaml 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280278 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280279 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/.qa -> ../.qa/ 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280288 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280289 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy/% 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy/msgr-failures 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280292 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280293 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy/msgr-failures/few.yaml 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280290 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy/.qa -> ../.qa/ 2024-03-27T21:32:59.647 INFO:teuthology.orchestra.run.smithi063.stdout: 280294 4 -rw-r--r-- 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/fancy/randomized-striping-on.yaml 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280280 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280281 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/% 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280287 4 -rw-r--r-- 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/randomized-striping-off.yaml 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280283 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/msgr-failures 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280284 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280285 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/msgr-failures/few.yaml 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280286 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/msgr-failures/many.yaml 2024-03-27T21:32:59.648 INFO:teuthology.orchestra.run.smithi063.stdout: 280282 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/striping/default/.qa -> ../.qa/ 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280260 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/clusters 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280261 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280262 4 -rw-r--r-- 1 ubuntu ubuntu 365 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/clusters/3-node.yaml 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280264 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/features 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280265 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/features/.qa -> ../.qa/ 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280266 4 -rw-r--r-- 1 ubuntu ubuntu 109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/features/no-object-map.yaml 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280267 4 -rw-r--r-- 1 ubuntu ubuntu 148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/features/object-map.yaml 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280257 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ceph 2024-03-27T21:32:59.649 INFO:teuthology.orchestra.run.smithi063.stdout: 280259 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ceph/ceph.yaml 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280258 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280263 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/conf.yaml 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280295 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/tasks 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280296 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280297 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/tasks/fsx-1-client.yaml 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280298 4 -rw-r--r-- 1 ubuntu ubuntu 184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/fsx/tasks/fsx-3-client.yaml 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280221 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/.qa -> ../.qa/ 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280336 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount 2024-03-27T21:32:59.650 INFO:teuthology.orchestra.run.smithi063.stdout: 280337 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/% 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280358 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/msgr-failures 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280359 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280360 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/msgr-failures/few.yaml 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280361 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/msgr-failures/many.yaml 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280338 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/.qa -> ../.qa/ 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280339 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280344 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/install 2024-03-27T21:32:59.651 INFO:teuthology.orchestra.run.smithi063.stdout: 280346 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/install/ceph.yaml 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280345 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/install/.qa -> ../.qa/ 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280347 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280357 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/secure.yaml 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280348 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/.qa -> ../.qa/ 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280353 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/legacy$ 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280355 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/legacy$/legacy-rxbounce.yaml 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280354 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/legacy$/.qa -> ../.qa/ 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280356 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/legacy$/legacy.yaml 2024-03-27T21:32:59.652 INFO:teuthology.orchestra.run.smithi063.stdout: 280349 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/crc$ 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280351 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/crc$/crc-rxbounce.yaml 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280352 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/crc$/crc.yaml 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280350 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/ms_mode/crc$/.qa -> ../.qa/ 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/clusters 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280342 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280341 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280343 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/conf.yaml 2024-03-27T21:32:59.653 INFO:teuthology.orchestra.run.smithi063.stdout: 280362 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280368 4 -rw-r--r-- 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_latest_osdmap_on_map.yaml 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280374 4 -rw-r--r-- 1 ubuntu ubuntu 236 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280363 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280377 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280379 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280376 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280370 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_udev_enumerate.yaml 2024-03-27T21:32:59.654 INFO:teuthology.orchestra.run.smithi063.stdout: 280373 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_udev_symlinks.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280367 4 -rw-r--r-- 1 ubuntu ubuntu 144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_huge_osdmap.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280371 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_udev_netlink_enobufs.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280375 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280380 4 -rw-r--r-- 1 ubuntu ubuntu 72 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280364 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_data_pool.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280372 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_udev_netns.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280365 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_exclusive_option.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280378 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml 2024-03-27T21:32:59.655 INFO:teuthology.orchestra.run.smithi063.stdout: 280366 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_fallocate.yaml 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280369 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd-nomount/tasks/krbd_namespaces.yaml 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280434 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280435 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/% 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280436 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/.qa -> ../.qa/ 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280439 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$ 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280441 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$/crc-rxbounce.yaml 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280445 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$/secure.yaml 2024-03-27T21:32:59.656 INFO:teuthology.orchestra.run.smithi063.stdout: 280443 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$/legacy-rxbounce.yaml 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280442 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$/crc.yaml 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280440 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$/.qa -> ../.qa/ 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280444 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/ms_mode$/legacy.yaml 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280437 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280438 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/conf.yaml 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280446 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/tasks 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280447 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280448 4 -rw-r--r-- 1 ubuntu ubuntu 305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton/tasks/krbd_watch_errors.yaml 2024-03-27T21:32:59.657 INFO:teuthology.orchestra.run.smithi063.stdout: 280497 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280499 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280500 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/% 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280501 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/.qa -> ../.qa/ 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280502 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280506 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/clusters 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280508 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/clusters/fixed-1.yaml -> .qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280507 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280503 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/ceph 2024-03-27T21:32:59.658 INFO:teuthology.orchestra.run.smithi063.stdout: 280505 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/ceph/ceph.yaml 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280504 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280509 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/conf.yaml 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280510 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/tasks 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280511 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280512 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/sysfs/tasks/stable_writes.yaml 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280498 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/.qa -> ../.qa/ 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280513 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac 2024-03-27T21:32:59.659 INFO:teuthology.orchestra.run.smithi063.stdout: 280514 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/% 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280515 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/.qa -> ../.qa/ 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280516 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280520 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/clusters 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280522 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280521 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280527 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/verify 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280528 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/verify/.qa -> ../.qa/ 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280529 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/verify/many-resets.yaml 2024-03-27T21:32:59.660 INFO:teuthology.orchestra.run.smithi063.stdout: 280530 4 -rw-r--r-- 1 ubuntu ubuntu 151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/verify/no-resets.yaml 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280517 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/ceph 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280519 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/ceph/ceph.yaml 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280518 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280523 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/conf.yaml 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280524 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/tasks 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280525 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280526 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/wac/wac/tasks/wac.yaml 2024-03-27T21:32:59.661 INFO:teuthology.orchestra.run.smithi063.stdout: 280299 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280300 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/% 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280301 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280310 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$ 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280312 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$/crc-rxbounce.yaml 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280316 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$/secure.yaml 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280314 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$/legacy-rxbounce.yaml 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280313 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$/crc.yaml 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280311 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$/.qa -> ../.qa/ 2024-03-27T21:32:59.662 INFO:teuthology.orchestra.run.smithi063.stdout: 280315 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/ms_mode$/legacy.yaml 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280302 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/install 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280309 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/install/ceph.yaml 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280308 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/install/.qa -> ../.qa/ 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/clusters 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280304 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280305 4 -rw-r--r-- 1 ubuntu ubuntu 372 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/clusters/2-node.yaml 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280306 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/conf.yaml 2024-03-27T21:32:59.663 INFO:teuthology.orchestra.run.smithi063.stdout: 280317 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/tasks 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280318 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280320 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/tasks/compare-mirror-images.yaml 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280319 4 -rw-r--r-- 1 ubuntu ubuntu 284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/mirror/tasks/compare-mirror-image-alternate-primary.yaml 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280449 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280450 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/% 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280451 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280460 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$ 2024-03-27T21:32:59.664 INFO:teuthology.orchestra.run.smithi063.stdout: 280462 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$/crc-rxbounce.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280466 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$/secure.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280464 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$/legacy-rxbounce.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280463 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$/crc.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280461 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$/.qa -> ../.qa/ 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280465 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ms_mode$/legacy.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280452 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280473 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/workloads 2024-03-27T21:32:59.665 INFO:teuthology.orchestra.run.smithi063.stdout: 280476 4 -rw-r--r-- 1 ubuntu ubuntu 189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/workloads/krbd_diff_continuous.yaml 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280475 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280477 4 -rw-r--r-- 1 ubuntu ubuntu 223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/workloads/rbd_fio.yaml 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280478 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280456 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/clusters 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280458 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280457 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280453 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ceph 2024-03-27T21:32:59.666 INFO:teuthology.orchestra.run.smithi063.stdout: 280455 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ceph/ceph.yaml 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280454 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280459 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/conf.yaml 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashers 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280470 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashers/mon-thrasher.yaml 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280468 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280471 4 -rw-r--r-- 1 ubuntu ubuntu 200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashers/pggrow.yaml 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280472 4 -rw-r--r-- 1 ubuntu ubuntu 401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashers/upmap.yaml 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280469 4 -rw-r--r-- 1 ubuntu ubuntu 322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/thrash/thrashers/backoff.yaml 2024-03-27T21:32:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 280321 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280322 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/% 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280323 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/.qa -> ../.qa/ 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280324 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280328 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/clusters 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280330 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280329 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/ceph 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280327 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/ceph/ceph.yaml 2024-03-27T21:32:59.668 INFO:teuthology.orchestra.run.smithi063.stdout: 280326 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280331 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/conf.yaml 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280332 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/tasks 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280335 4 -rw-r--r-- 1 ubuntu ubuntu 74 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/tasks/krbd_rxbounce.yaml 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280333 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280334 4 -rw-r--r-- 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/ms_modeless/tasks/krbd_default_map_options.yaml 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280415 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280416 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/% 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/msgr-failures 2024-03-27T21:32:59.669 INFO:teuthology.orchestra.run.smithi063.stdout: 280428 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280429 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/msgr-failures/few.yaml 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280430 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/msgr-failures/many.yaml 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280417 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280420 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$ 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280422 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$/crc-rxbounce.yaml 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280426 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$/secure.yaml 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280424 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$/legacy-rxbounce.yaml 2024-03-27T21:32:59.670 INFO:teuthology.orchestra.run.smithi063.stdout: 280423 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$/crc.yaml 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280421 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$/.qa -> ../.qa/ 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280425 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/ms_mode$/legacy.yaml 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280418 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280419 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/conf.yaml 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280431 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/tasks 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280432 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280433 4 -rw-r--r-- 1 ubuntu ubuntu 917 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/singleton-msgr-failures/tasks/rbd_xfstests.yaml 2024-03-27T21:32:59.671 INFO:teuthology.orchestra.run.smithi063.stdout: 280381 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280382 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/% 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280400 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/msgr-failures 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280401 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280402 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/msgr-failures/few.yaml 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280403 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/msgr-failures/many.yaml 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280383 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/.qa -> ../.qa/ 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280384 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280389 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode 2024-03-27T21:32:59.672 INFO:teuthology.orchestra.run.smithi063.stdout: 280399 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/secure.yaml 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280390 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/.qa -> ../.qa/ 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280395 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/legacy$ 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280397 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/legacy$/legacy-rxbounce.yaml 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280396 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/legacy$/.qa -> ../.qa/ 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280398 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/legacy$/legacy.yaml 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280391 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/crc$ 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280393 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/crc$/crc-rxbounce.yaml 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280394 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/crc$/crc.yaml 2024-03-27T21:32:59.673 INFO:teuthology.orchestra.run.smithi063.stdout: 280392 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/ms_mode/crc$/.qa -> ../.qa/ 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280385 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/clusters 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280387 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280386 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280388 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/conf.yaml 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280404 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280405 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280413 4 -rw-r--r-- 1 ubuntu ubuntu 129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml 2024-03-27T21:32:59.674 INFO:teuthology.orchestra.run.smithi063.stdout: 280406 4 -rw-r--r-- 1 ubuntu ubuntu 206 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_fio.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280410 4 -rw-r--r-- 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280412 4 -rw-r--r-- 1 ubuntu ubuntu 309 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280407 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280408 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280414 4 -rw-r--r-- 1 ubuntu ubuntu 104 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280411 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280409 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280222 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic 2024-03-27T21:32:59.675 INFO:teuthology.orchestra.run.smithi063.stdout: 280223 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/% 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280224 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280225 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280233 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280243 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/secure.yaml 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280234 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/.qa -> ../.qa/ 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280239 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/legacy$ 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280241 4 -rw-r--r-- 1 ubuntu ubuntu 100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/legacy$/legacy-rxbounce.yaml 2024-03-27T21:32:59.676 INFO:teuthology.orchestra.run.smithi063.stdout: 280240 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/legacy$/.qa -> ../.qa/ 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280242 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/legacy$/legacy.yaml 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280235 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/crc$ 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280237 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/crc$/crc-rxbounce.yaml 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280238 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/crc$/crc.yaml 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280236 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ms_mode/crc$/.qa -> ../.qa/ 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/clusters 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280231 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/clusters/fixed-1.yaml -> .qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280230 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.677 INFO:teuthology.orchestra.run.smithi063.stdout: 280226 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ceph 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280228 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ceph/ceph.yaml 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280227 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280232 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/conf.yaml 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280251 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_parent_overlap.yaml 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280252 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_read_only.yaml 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280253 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_whole_object_zeroout.yaml 2024-03-27T21:32:59.678 INFO:teuthology.orchestra.run.smithi063.stdout: 280245 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280249 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_modprobe.yaml 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280248 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_huge_image.yaml 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280250 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_msgr_segments.yaml 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280247 4 -rw-r--r-- 1 ubuntu ubuntu 214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_discard.yaml 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280246 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/basic/tasks/krbd_deep_flatten.yaml 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280479 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280480 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/% 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280481 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/.qa -> ../.qa/ 2024-03-27T21:32:59.679 INFO:teuthology.orchestra.run.smithi063.stdout: 280485 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/clusters 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280486 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280487 4 -rw-r--r-- 1 ubuntu ubuntu 391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/clusters/separate-client.yaml 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280482 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/ceph 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280484 4 -rw-r--r-- 1 ubuntu ubuntu 451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/ceph/ceph.yaml 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280483 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280488 4 -rw-r--r-- 1 ubuntu ubuntu 174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/conf.yaml 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280494 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/tasks 2024-03-27T21:32:59.680 INFO:teuthology.orchestra.run.smithi063.stdout: 280495 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 280496 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/tasks/unmap.yaml 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 280489 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/kernels 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 280490 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/kernels/.qa -> ../.qa/ 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 280493 4 -rw-r--r-- 1 ubuntu ubuntu 160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/kernels/single-major-on.yaml 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 280491 4 -rw-r--r-- 1 ubuntu ubuntu 229 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/kernels/pre-single-major.yaml 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 280492 4 -rw-r--r-- 1 ubuntu ubuntu 160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/krbd/unmap/kernels/single-major-off.yaml 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 282526 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade 2024-03-27T21:32:59.681 INFO:teuthology.orchestra.run.smithi063.stdout: 282528 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/cephfs -> .qa/suites/fs/upgrade/ 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282527 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282639 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/pacific-x 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282643 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/pacific-x/0-random-distro$ -> .qa/distros/container-hosts 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282641 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/pacific-x/% 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282642 0 lrwxrwxrwx 1 ubuntu ubuntu 9 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/pacific-x/.qa -> ../../.qa 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282644 4 -rw-r--r-- 1 ubuntu ubuntu 460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/pacific-x/0-start.yaml 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282645 4 -rw-r--r-- 1 ubuntu ubuntu 1823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/pacific-x/1-tasks.yaml 2024-03-27T21:32:59.682 INFO:teuthology.orchestra.run.smithi063.stdout: 282646 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/quincy-x 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282649 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/quincy-x/0-random-distro$ -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282647 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/quincy-x/% 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282648 0 lrwxrwxrwx 1 ubuntu ubuntu 9 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/quincy-x/.qa -> ../../.qa 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282650 4 -rw-r--r-- 1 ubuntu ubuntu 460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/quincy-x/0-start.yaml 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282651 4 -rw-r--r-- 1 ubuntu ubuntu 1813 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/telemetry-upgrade/quincy-x/1-tasks.yaml 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282592 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282593 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/.qa -> ../.qa/ 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282611 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split 2024-03-27T21:32:59.683 INFO:teuthology.orchestra.run.smithi063.stdout: 282617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282618 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282624 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/snaps-few-objects.yaml 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282619 4 -rw-r--r-- 1 ubuntu ubuntu 418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/radosbench.yaml 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282621 4 -rw-r--r-- 1 ubuntu ubuntu 266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/rbd-import-export.yaml 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282622 4 -rw-r--r-- 1 ubuntu ubuntu 245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/rbd_api.yaml 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282620 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/rbd-cls.yaml 2024-03-27T21:32:59.684 INFO:teuthology.orchestra.run.smithi063.stdout: 282623 4 -rw-r--r-- 1 ubuntu ubuntu 391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/2-first-half-tasks/readwrite.yaml 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282612 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/% 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282613 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/.qa -> ../.qa/ 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282615 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/0-roles.yaml 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282626 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/+ 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282627 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282633 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/snaps-few-objects.yaml 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282628 4 -rw-r--r-- 1 ubuntu ubuntu 528 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/radosbench.yaml 2024-03-27T21:32:59.685 INFO:teuthology.orchestra.run.smithi063.stdout: 282630 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/rbd-import-export.yaml 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282631 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/rbd_api.yaml 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282629 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/rbd-cls.yaml 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282632 4 -rw-r--r-- 1 ubuntu ubuntu 387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/3-stress-tasks/readwrite.yaml 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282616 4 -rw-r--r-- 1 ubuntu ubuntu 3138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/1-start.yaml 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282638 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/mon_election -> .qa/mon_election 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282614 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282634 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/4-second-half-tasks 2024-03-27T21:32:59.686 INFO:teuthology.orchestra.run.smithi063.stdout: 282635 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/4-second-half-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282636 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/4-second-half-tasks/radosbench.yaml 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282637 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/stress-split/4-second-half-tasks/rbd-import-export.yaml 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282594 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282601 4 -rw-r--r-- 1 ubuntu ubuntu 650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/upgrade-sequence.yaml 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282597 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/0-random-distro$ -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282595 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/% 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282596 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/.qa -> ../.qa/ 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282598 4 -rw-r--r-- 1 ubuntu ubuntu 460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/0-start.yaml 2024-03-27T21:32:59.687 INFO:teuthology.orchestra.run.smithi063.stdout: 282599 4 -rw-r--r-- 1 ubuntu ubuntu 1143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/1-tasks.yaml 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282603 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/+ 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282610 4 -rw-r--r-- 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/test_rbd_python.yaml 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282604 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/.qa -> ../.qa/ 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282608 4 -rw-r--r-- 1 ubuntu ubuntu 360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/rbd_import_export.yaml 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282609 4 -rw-r--r-- 1 ubuntu ubuntu 322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/test_rbd_api.yaml 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282606 4 -rw-r--r-- 1 ubuntu ubuntu 260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/rados_api.yaml 2024-03-27T21:32:59.688 INFO:teuthology.orchestra.run.smithi063.stdout: 282605 4 -rw-r--r-- 1 ubuntu ubuntu 577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/ec-rados-default.yaml 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282607 4 -rw-r--r-- 1 ubuntu ubuntu 331 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/workload/rados_loadgenbig.yaml 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282600 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/reef-x/parallel/mon_election -> .qa/mon_election 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282529 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282530 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/.qa -> ../.qa/ 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282564 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282570 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282571 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282577 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/snaps-few-objects.yaml 2024-03-27T21:32:59.689 INFO:teuthology.orchestra.run.smithi063.stdout: 282572 4 -rw-r--r-- 1 ubuntu ubuntu 418 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/radosbench.yaml 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282574 4 -rw-r--r-- 1 ubuntu ubuntu 268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/rbd-import-export.yaml 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282575 4 -rw-r--r-- 1 ubuntu ubuntu 247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/rbd_api.yaml 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282573 4 -rw-r--r-- 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/rbd-cls.yaml 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282576 4 -rw-r--r-- 1 ubuntu ubuntu 391 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/2-first-half-tasks/readwrite.yaml 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282565 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/% 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282566 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/.qa -> ../.qa/ 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282568 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/0-roles.yaml 2024-03-27T21:32:59.690 INFO:teuthology.orchestra.run.smithi063.stdout: 282578 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282579 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/+ 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282580 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282586 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/snaps-few-objects.yaml 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282581 4 -rw-r--r-- 1 ubuntu ubuntu 528 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/radosbench.yaml 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282583 4 -rw-r--r-- 1 ubuntu ubuntu 264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/rbd-import-export.yaml 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282584 4 -rw-r--r-- 1 ubuntu ubuntu 243 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/rbd_api.yaml 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282582 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/rbd-cls.yaml 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282585 4 -rw-r--r-- 1 ubuntu ubuntu 387 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/3-stress-tasks/readwrite.yaml 2024-03-27T21:32:59.691 INFO:teuthology.orchestra.run.smithi063.stdout: 282569 4 -rw-r--r-- 1 ubuntu ubuntu 3185 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/1-start.yaml 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282591 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/mon_election -> .qa/mon_election 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282567 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282587 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/4-second-half-tasks 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282588 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/4-second-half-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282589 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/4-second-half-tasks/radosbench.yaml 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282590 4 -rw-r--r-- 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/stress-split/4-second-half-tasks/rbd-import-export.yaml 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282531 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check 2024-03-27T21:32:59.692 INFO:teuthology.orchestra.run.smithi063.stdout: 282534 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/0-cluster 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282535 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/0-cluster/+ 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282536 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/0-cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282537 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/0-cluster/openstack.yaml 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282538 4 -rw-r--r-- 1 ubuntu ubuntu 770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/0-cluster/start.yaml 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282532 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/% 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282543 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/objectstore 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282544 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282545 4 -rw-r--r-- 1 ubuntu ubuntu 247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/objectstore/filestore-xfs.yaml 2024-03-27T21:32:59.693 INFO:teuthology.orchestra.run.smithi063.stdout: 282533 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/.qa -> ../.qa 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282542 4 -rw-r--r-- 1 ubuntu ubuntu 569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/2\ -\ upgrade.yaml 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282539 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/1-ceph-install 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282540 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/1-ceph-install/.qa -> ../.qa/ 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282541 4 -rw-r--r-- 1 ubuntu ubuntu 789 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/1-ceph-install/quincy.yaml 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282546 4 -rw-r--r-- 1 ubuntu ubuntu 343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/filestore-remove-check/ubuntu_20.04.yaml 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282547 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282554 4 -rw-r--r-- 1 ubuntu ubuntu 650 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/upgrade-sequence.yaml 2024-03-27T21:32:59.694 INFO:teuthology.orchestra.run.smithi063.stdout: 282550 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/0-random-distro$ -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282548 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/% 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282549 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/.qa -> ../.qa/ 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282551 4 -rw-r--r-- 1 ubuntu ubuntu 460 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/0-start.yaml 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282552 4 -rw-r--r-- 1 ubuntu ubuntu 1202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/1-tasks.yaml 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282555 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282556 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/+ 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282563 4 -rw-r--r-- 1 ubuntu ubuntu 417 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/test_rbd_python.yaml 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282557 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/.qa -> ../.qa/ 2024-03-27T21:32:59.695 INFO:teuthology.orchestra.run.smithi063.stdout: 282561 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/rbd_import_export.yaml 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 282562 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/test_rbd_api.yaml 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 282559 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/rados_api.yaml 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 282558 4 -rw-r--r-- 1 ubuntu ubuntu 577 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/ec-rados-default.yaml 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 282560 4 -rw-r--r-- 1 ubuntu ubuntu 333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/workload/rados_loadgenbig.yaml 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 282553 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/upgrade/quincy-x/parallel/mon_election -> .qa/mon_election 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 278918 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 278919 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/.qa -> ../.qa/ 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 278920 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash 2024-03-27T21:32:59.696 INFO:teuthology.orchestra.run.smithi063.stdout: 278921 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/% 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278922 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278931 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/openstack.yaml 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278932 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/workloads 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278933 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278935 4 -rw-r--r-- 1 ubuntu ubuntu 217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/workloads/snaps-few-objects.yaml 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278934 4 -rw-r--r-- 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/workloads/radosbench.yaml 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278926 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/clusters 2024-03-27T21:32:59.697 INFO:teuthology.orchestra.run.smithi063.stdout: 278927 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 278929 4 -rw-r--r-- 1 ubuntu ubuntu 459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/clusters/medium.yaml 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 278930 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/clusters/small.yaml 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 278928 4 -rw-r--r-- 1 ubuntu ubuntu 1512 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/clusters/big.yaml 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 278923 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/ceph 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 278924 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 278925 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/big/rados-thrash/ceph/cephadm.yaml 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 282652 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 282653 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/.qa -> ../.qa/ 2024-03-27T21:32:59.698 INFO:teuthology.orchestra.run.smithi063.stdout: 282654 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282655 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/% 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282656 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282666 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282660 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/install 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282662 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/install/install.yaml 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282661 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/install/.qa -> ../.qa/ 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282657 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/clusters 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282659 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/clusters/fixed-1.yaml -> .qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.699 INFO:teuthology.orchestra.run.smithi063.stdout: 282658 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 282663 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/tasks 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 282664 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 282665 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/windows/basic/tasks/windows_tests.yaml 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 279056 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 279057 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/.qa -> ../.qa/ 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 279075 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 279076 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/% 2024-03-27T21:32:59.700 INFO:teuthology.orchestra.run.smithi063.stdout: 279083 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/crimson-supported-all-distro -> .qa/distros/crimson-supported-all-distro/ 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279089 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/objectstore 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279090 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279091 4 -rw-r--r-- 1 ubuntu ubuntu 711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/objectstore/bluestore.yaml 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279077 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/.qa -> ../.qa/ 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279085 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/deploy 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279087 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/deploy/ceph.yaml 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279086 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/deploy/.qa -> ../.qa/ 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279088 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/deploy/cephadm.yaml.disabled 2024-03-27T21:32:59.701 INFO:teuthology.orchestra.run.smithi063.stdout: 279095 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279103 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/radosbench_4K_seq_read.yaml 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279096 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279104 4 -rw-r--r-- 1 ubuntu ubuntu 720 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/radosbench_4M_rand_read.yaml 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279101 4 -rw-r--r-- 1 ubuntu ubuntu 702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/fio_4M_rand_write.yaml 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279099 4 -rw-r--r-- 1 ubuntu ubuntu 701 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/fio_4M_rand_read.yaml 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279108 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/sample_fio.yaml 2024-03-27T21:32:59.702 INFO:teuthology.orchestra.run.smithi063.stdout: 279107 4 -rw-r--r-- 1 ubuntu ubuntu 116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/radosbench_omap_write.yaml 2024-03-27T21:32:59.705 INFO:teuthology.orchestra.run.smithi063.stdout: 279102 4 -rw-r--r-- 1 ubuntu ubuntu 717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/radosbench_4K_rand_read.yaml 2024-03-27T21:32:59.705 INFO:teuthology.orchestra.run.smithi063.stdout: 279097 4 -rw-r--r-- 1 ubuntu ubuntu 698 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/fio_4K_rand_read.yaml 2024-03-27T21:32:59.705 INFO:teuthology.orchestra.run.smithi063.stdout: 279100 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/fio_4M_rand_rw.yaml 2024-03-27T21:32:59.705 INFO:teuthology.orchestra.run.smithi063.stdout: 279109 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/sample_radosbench.yaml 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279106 4 -rw-r--r-- 1 ubuntu ubuntu 694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/radosbench_4M_write.yaml 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279105 4 -rw-r--r-- 1 ubuntu ubuntu 695 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/radosbench_4M_seq_read.yaml 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279098 4 -rw-r--r-- 1 ubuntu ubuntu 696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/workloads/fio_4K_rand_rw.yaml 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279078 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/clusters 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279081 4 -rw-r--r-- 1 ubuntu ubuntu 675 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/clusters/fixed-2.yaml 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279082 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/clusters/openstack.yaml.disabled 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279079 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/clusters/+ 2024-03-27T21:32:59.706 INFO:teuthology.orchestra.run.smithi063.stdout: 279080 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279084 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/crimson_qa_overrides.yaml -> .qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279092 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/settings 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279093 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/settings/.qa -> ../.qa/ 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279094 4 -rw-r--r-- 1 ubuntu ubuntu 2072 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/perf/settings/optimized.yaml 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279130 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279133 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/all 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279134 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/all/.qa -> ../.qa 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279135 4 -rw-r--r-- 1 ubuntu ubuntu 721 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/all/osd-backfill.yaml 2024-03-27T21:32:59.707 INFO:teuthology.orchestra.run.smithi063.stdout: 279131 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/% 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279136 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/crimson-supported-all-distro -> .qa/distros/crimson-supported-all-distro/ 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279138 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/objectstore -> ../thrash/objectstore 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279132 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/.qa -> ../.qa 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279139 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/rados.yaml -> ./.qa/suites/rados/singleton/rados.yaml 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279137 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/singleton/crimson_qa_overrides.yaml -> .qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279140 4 drwxr-xr-x 10 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279141 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/% 2024-03-27T21:32:59.708 INFO:teuthology.orchestra.run.smithi063.stdout: 279164 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/crimson-supported-all-distro -> .qa/distros/crimson-supported-all-distro/ 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279170 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/objectstore 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279171 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279172 4 -rw-r--r-- 1 ubuntu ubuntu 711 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/objectstore/bluestore.yaml 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279142 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279147 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/1-pg-log-overrides 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279148 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/1-pg-log-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279149 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/1-pg-log-overrides/normal_pg_log.yaml 2024-03-27T21:32:59.709 INFO:teuthology.orchestra.run.smithi063.stdout: 279150 0 lrwxrwxrwx 1 ubuntu ubuntu 31 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/1-pg-log-overrides/short_pg_log.yaml.disabled -> .qa/overrides/short_pg_log.yaml 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279176 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/deploy 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279168 4 -rw-r--r-- 1 ubuntu ubuntu 144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/deploy/ceph.yaml 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279167 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/deploy/.qa -> ../.qa/ 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279169 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/deploy/cephadm.yaml.disabled 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279177 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads 2024-03-27T21:32:59.710 INFO:teuthology.orchestra.run.smithi063.stdout: 279187 4 -rw-r--r-- 1 ubuntu ubuntu 278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/snaps-few-objects-localized.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279186 4 -rw-r--r-- 1 ubuntu ubuntu 277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/snaps-few-objects-balanced.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279178 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279180 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/pool-snaps-few-objects.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279188 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/snaps-few-objects.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279182 4 -rw-r--r-- 1 ubuntu ubuntu 427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/radosbench.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279189 4 -rw-r--r-- 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/write_fadvise_dontneed.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279181 4 -rw-r--r-- 1 ubuntu ubuntu 918 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/radosbench-high-concurrency.yaml 2024-03-27T21:32:59.711 INFO:teuthology.orchestra.run.smithi063.stdout: 279184 4 -rw-r--r-- 1 ubuntu ubuntu 421 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/small-objects-localized.yaml 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279183 4 -rw-r--r-- 1 ubuntu ubuntu 420 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/small-objects-balanced.yaml 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279185 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/small-objects.yaml 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279179 4 -rw-r--r-- 1 ubuntu ubuntu 324 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/workloads/admin_socket_objecter_requests.yaml 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279159 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/clusters 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279162 4 -rw-r--r-- 1 ubuntu ubuntu 653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/clusters/fixed-2.yaml 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279163 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/clusters/openstack.yaml.disabled 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279160 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/clusters/+ 2024-03-27T21:32:59.712 INFO:teuthology.orchestra.run.smithi063.stdout: 279161 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279165 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/crimson_qa_overrides.yaml -> .qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/0-size-min-size-overrides 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279144 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/0-size-min-size-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279145 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml.disabled -> .qa/overrides/2-size-2-min-size.yaml 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279146 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml -> .qa/overrides/3-size-2-min-size.yaml 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/thrashers 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279174 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279175 4 -rw-r--r-- 1 ubuntu ubuntu 950 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/thrashers/default.yaml 2024-03-27T21:32:59.713 INFO:teuthology.orchestra.run.smithi063.stdout: 279151 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279158 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/more-partial-recovery.yaml.disabled 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279153 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279157 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/more-async-recovery.yaml.disabled 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279152 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/$ 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279155 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/more-active-recovery.yaml.disabled -> .qa/overrides/more-active-recovery.yaml 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279154 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/default.yaml 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279156 4 -rw-r--r-- 1 ubuntu ubuntu 138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/thrash/2-recovery-overrides/more-async-partial-recovery.yaml.disabled 2024-03-27T21:32:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 279110 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279111 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/% 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279116 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/crimson-supported-all-distro -> .qa/distros/crimson-supported-all-distro/ 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279112 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/.qa -> ../.qa/ 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279118 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/deploy 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279120 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/deploy/ceph.yaml 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279119 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/deploy/.qa -> ../.qa/ 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279121 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/deploy/cephadm.yaml.disabled 2024-03-27T21:32:59.715 INFO:teuthology.orchestra.run.smithi063.stdout: 279113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/clusters 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279115 4 -rw-r--r-- 1 ubuntu ubuntu 719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/clusters/fixed-1.yaml 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279114 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279117 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/crimson_qa_overrides.yaml -> .qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279127 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/rbd_lock_and_fence.yaml 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279123 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279126 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/rbd_cls_tests.yaml 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279125 4 -rw-r--r-- 1 ubuntu ubuntu 277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/rbd_api_tests_old_format.yaml 2024-03-27T21:32:59.716 INFO:teuthology.orchestra.run.smithi063.stdout: 279128 4 -rw-r--r-- 1 ubuntu ubuntu 297 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/rbd_python_api_tests.yaml 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279129 4 -rw-r--r-- 1 ubuntu ubuntu 263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/rbd_python_api_tests_old_format.yaml 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279124 4 -rw-r--r-- 1 ubuntu ubuntu 404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/rbd/tasks/rbd_api_tests.yaml 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279058 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279059 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/% 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279064 0 lrwxrwxrwx 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/crimson-supported-all-distro -> .qa/distros/crimson-supported-all-distro/ 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279060 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279066 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/deploy 2024-03-27T21:32:59.717 INFO:teuthology.orchestra.run.smithi063.stdout: 279068 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/deploy/ceph.yaml 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279067 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/deploy/.qa -> ../.qa/ 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279069 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/deploy/cephadm.yaml.disabled 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279061 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/clusters 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279063 4 -rw-r--r-- 1 ubuntu ubuntu 653 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/clusters/fixed-2.yaml 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279062 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279065 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/crimson_qa_overrides.yaml -> .qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279070 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/tasks 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279071 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.718 INFO:teuthology.orchestra.run.smithi063.stdout: 279072 4 -rw-r--r-- 1 ubuntu ubuntu 635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/tasks/rados_api_tests.yaml 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 279074 4 -rw-r--r-- 1 ubuntu ubuntu 318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/tasks/readwrite.yaml 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 279073 4 -rw-r--r-- 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados/basic/tasks/rados_python.yaml 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 280204 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 280205 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/.qa -> ../.qa/ 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 280206 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 280207 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/% 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 280208 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.719 INFO:teuthology.orchestra.run.smithi063.stdout: 280209 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/clusters 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280211 4 -rw-r--r-- 1 ubuntu ubuntu 289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/clusters/fixed-3.yaml 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280210 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280212 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/distros 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280213 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/distros/.qa -> ../.qa/ 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280214 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/distros/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280215 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/tasks 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280216 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280219 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/tasks/wordcount.yaml 2024-03-27T21:32:59.720 INFO:teuthology.orchestra.run.smithi063.stdout: 280218 4 -rw-r--r-- 1 ubuntu ubuntu 150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/tasks/terasort.yaml 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 280217 4 -rw-r--r-- 1 ubuntu ubuntu 106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/hadoop/basic/tasks/repl.yaml 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278936 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278945 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278946 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests/% 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278947 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests/.qa -> ../.qa/ 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278948 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests/distros -> .qa/distros/all 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278949 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests/tasks 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278950 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.721 INFO:teuthology.orchestra.run.smithi063.stdout: 278951 4 -rw-r--r-- 1 ubuntu ubuntu 426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/tests/tasks/release.yaml 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278937 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/.qa -> ../.qa/ 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278938 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278939 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any/% 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278940 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any/.qa -> ../.qa/ 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278941 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any/distros -> .qa/distros/all 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278942 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any/tasks 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278943 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.722 INFO:teuthology.orchestra.run.smithi063.stdout: 278944 4 -rw-r--r-- 1 ubuntu ubuntu 195 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/buildpackages/any/tasks/release.yaml 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282499 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282500 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/.qa -> ../.qa/ 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282501 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282502 4 -rw-r--r-- 1 ubuntu ubuntu 1 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/% 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282507 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/msgr-failures 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282508 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282509 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/msgr-failures/few.yaml 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282510 4 -rw-r--r-- 1 ubuntu ubuntu 176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/msgr-failures/many.yaml 2024-03-27T21:32:59.723 INFO:teuthology.orchestra.run.smithi063.stdout: 282503 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282504 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/clusters 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282506 4 -rw-r--r-- 1 ubuntu ubuntu 103 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/clusters/fixed-3.yaml 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282505 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282511 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282514 4 -rw-r--r-- 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/bonnie.yaml 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282512 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282518 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/fio.yaml 2024-03-27T21:32:59.724 INFO:teuthology.orchestra.run.smithi063.stdout: 282515 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/dbench-short.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282522 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/iogen.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282521 4 -rw-r--r-- 1 ubuntu ubuntu 117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/fsync-tester.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282524 4 -rw-r--r-- 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/iozone.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282513 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/blogbench.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282525 4 -rw-r--r-- 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/pjd.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282523 4 -rw-r--r-- 1 ubuntu ubuntu 116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/iozone-sync.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282519 4 -rw-r--r-- 1 ubuntu ubuntu 113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/fsstress.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282516 4 -rw-r--r-- 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/dbench.yaml 2024-03-27T21:32:59.725 INFO:teuthology.orchestra.run.smithi063.stdout: 282517 4 -rw-r--r-- 1 ubuntu ubuntu 109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/ffsb.yaml 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 282520 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/tgt/basic/tasks/fsx.yaml 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 279190 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/dummy 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 279193 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/dummy/all 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 279194 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/dummy/all/.qa -> ../.qa/ 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 279195 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/dummy/all/nop.yaml 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 279191 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/dummy/% 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 279192 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/dummy/.qa -> ../.qa/ 2024-03-27T21:32:59.726 INFO:teuthology.orchestra.run.smithi063.stdout: 282407 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282409 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282410 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/% 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282411 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/.qa -> ../.qa/ 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282412 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/clusters 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282413 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282414 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/clusters/fixed-3-cephfs.yaml -> .qa/clusters/fixed-3-cephfs.yaml 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282415 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/tasks 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282416 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.727 INFO:teuthology.orchestra.run.smithi063.stdout: 282417 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282418 4 -rw-r--r-- 1 ubuntu ubuntu 304 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282408 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/.qa -> ../.qa/ 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282419 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282420 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/% 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282421 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/workloads 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282433 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: 282435 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/workloads/iozone_cfuse.yaml 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282436 4 -rw-r--r-- 1 ubuntu ubuntu 60 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/workloads/radosbench.yaml 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282437 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/workloads/readwrite.yaml 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282434 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/workloads/bonnie_cfuse.yaml 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282422 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/clusters 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282426 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/clusters/8-osd.yaml 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282423 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282424 4 -rw-r--r-- 1 ubuntu ubuntu 228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/clusters/16-osd.yaml 2024-03-27T21:32:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: 282425 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/clusters/3-osd-1-machine.yaml 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 282427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/thrashers 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 282428 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 282430 4 -rw-r--r-- 1 ubuntu ubuntu 168 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/thrashers/fast.yaml 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 282429 4 -rw-r--r-- 1 ubuntu ubuntu 132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/thrashers/default.yaml 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 282431 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/stress/thrash/thrashers/more-down.yaml 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 278952 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 278953 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/.qa -> ../.qa/ 2024-03-27T21:32:59.730 INFO:teuthology.orchestra.run.smithi063.stdout: 278954 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278955 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/.qa -> ../.qa/ 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278956 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278970 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/3-config 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278972 4 -rw-r--r-- 1 ubuntu ubuntu 144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/3-config/bluestore_with_dmcrypt.yaml 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278971 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/3-config/.qa -> ../.qa/ 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278974 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/3-config/dmcrypt_on.yaml 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278973 4 -rw-r--r-- 1 ubuntu ubuntu 95 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/3-config/dmcrypt_off.yaml 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278957 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/% 2024-03-27T21:32:59.731 INFO:teuthology.orchestra.run.smithi063.stdout: 278959 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/0-clusters 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278960 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/0-clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278962 4 -rw-r--r-- 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/0-clusters/4-node.yaml 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278961 4 -rw-r--r-- 1 ubuntu ubuntu 311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/0-clusters/3-node.yaml 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278975 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/4-tasks 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278976 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/4-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278978 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/4-tasks/rbd_import_export.yaml 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278979 4 -rw-r--r-- 1 ubuntu ubuntu 300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/4-tasks/rest.yaml 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278977 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/4-tasks/ceph-admin-commands.yaml 2024-03-27T21:32:59.732 INFO:teuthology.orchestra.run.smithi063.stdout: 278958 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278963 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/1-distros 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278964 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/1-distros/.qa -> ../.qa/ 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278966 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/1-distros/ubuntu_latest.yaml -> .qa/distros/supported/ubuntu_latest.yaml 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278965 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/1-distros/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278967 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/2-ceph 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278968 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/2-ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 278969 4 -rw-r--r-- 1 ubuntu ubuntu 958 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/ceph-ansible/smoke/basic/2-ceph/ceph_ansible.yaml 2024-03-27T21:32:59.733 INFO:teuthology.orchestra.run.smithi063.stdout: 281470 4 drwxr-xr-x 21 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281671 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281672 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/% 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281684 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/qemu 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281685 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/qemu/.qa -> ../.qa/ 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281686 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/qemu/xfstests.yaml 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281683 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/objectstore -> .qa/objectstore 2024-03-27T21:32:59.734 INFO:teuthology.orchestra.run.smithi063.stdout: 281673 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/.qa -> ../.qa/ 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281682 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/conf -> .qa/rbd/conf 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281687 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281688 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/workloads 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281689 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281691 4 -rw-r--r-- 1 ubuntu ubuntu 260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/workloads/dynamic_features_no_cache.yaml 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281692 4 -rw-r--r-- 1 ubuntu ubuntu 175 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/workloads/rebuild_object_map.yaml 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281690 4 -rw-r--r-- 1 ubuntu ubuntu 173 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/workloads/dynamic_features.yaml 2024-03-27T21:32:59.735 INFO:teuthology.orchestra.run.smithi063.stdout: 281677 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/clusters 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281680 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281678 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/clusters/+ 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281679 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281681 0 lrwxrwxrwx 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/clusters/openstack.yaml -> ../../qemu/clusters/openstack.yaml 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281674 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/base 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281676 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/base/install.yaml 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281675 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/maintenance/base/.qa -> ../.qa/ 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281542 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device 2024-03-27T21:32:59.736 INFO:teuthology.orchestra.run.smithi063.stdout: 281543 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/% 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281553 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/objectstore -> .qa/objectstore 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281552 0 lrwxrwxrwx 1 ubuntu ubuntu 23 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/msgr-failures -> ../thrash/msgr-failures 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281544 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/.qa -> ../.qa/ 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281551 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/conf -> .qa/rbd/conf 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281556 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281554 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281557 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/workloads 2024-03-27T21:32:59.737 INFO:teuthology.orchestra.run.smithi063.stdout: 281562 4 -rw-r--r-- 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/workloads/rbd_nbd.yaml 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281559 4 -rw-r--r-- 1 ubuntu ubuntu 189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/workloads/diff-continuous-krbd.yaml 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281558 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281560 4 -rw-r--r-- 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/workloads/diff-continuous-nbd.yaml 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281561 4 -rw-r--r-- 1 ubuntu ubuntu 226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/workloads/rbd_fsx_nbd.yaml 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281545 0 lrwxrwxrwx 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/base -> ../thrash/base 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281555 0 lrwxrwxrwx 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/thrashers -> ../thrash/thrashers 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281546 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/cluster 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281549 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/cluster/fixed-3.yaml 2024-03-27T21:32:59.738 INFO:teuthology.orchestra.run.smithi063.stdout: 281547 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/cluster/+ 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281548 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281550 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/device/cluster/openstack.yaml -> ../../thrash/clusters/openstack.yaml 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281615 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281616 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/% 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281617 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/.qa -> ../.qa/ 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281627 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/conf -> .qa/rbd/conf 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281618 0 lrwxrwxrwx 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/0-single-container-host.yaml -> .qa/distros/single-container-host.yaml 2024-03-27T21:32:59.739 INFO:teuthology.orchestra.run.smithi063.stdout: 281628 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/workloads 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281629 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281630 4 -rw-r--r-- 1 ubuntu ubuntu 548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/workloads/cephadm_iscsi.yaml 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281619 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/base 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281621 4 -rw-r--r-- 1 ubuntu ubuntu 268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/base/install.yaml 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281620 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/base/.qa -> ../.qa/ 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281622 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/cluster 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281625 4 -rw-r--r-- 1 ubuntu ubuntu 223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/cluster/fixed-3.yaml 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281623 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/cluster/+ 2024-03-27T21:32:59.740 INFO:teuthology.orchestra.run.smithi063.stdout: 281624 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281626 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/iscsi/cluster/openstack.yaml 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281851 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281852 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/% 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281875 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/objectstore -> .qa/objectstore 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281872 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/msgr-failures 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281873 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281874 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/msgr-failures/few.yaml 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281853 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/.qa -> ../.qa/ 2024-03-27T21:32:59.741 INFO:teuthology.orchestra.run.smithi063.stdout: 281865 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/conf -> .qa/rbd/conf 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281876 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281877 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/workloads 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281878 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281881 4 -rw-r--r-- 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281882 4 -rw-r--r-- 1 ubuntu ubuntu 132 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/workloads/qemu_xfstests.yaml 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281879 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/workloads/qemu_bonnie.yaml 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281880 4 -rw-r--r-- 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/workloads/qemu_fsstress.yaml 2024-03-27T21:32:59.742 INFO:teuthology.orchestra.run.smithi063.stdout: 281860 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/clusters 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281863 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281861 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/clusters/+ 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281862 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281864 4 -rw-r--r-- 1 ubuntu ubuntu 156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/clusters/openstack.yaml 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281867 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/features 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281868 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/features/.qa -> ../.qa/ 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281869 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/features/defaults.yaml 2024-03-27T21:32:59.743 INFO:teuthology.orchestra.run.smithi063.stdout: 281870 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/features/journaling.yaml 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281871 4 -rw-r--r-- 1 ubuntu ubuntu 171 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/features/readbalance.yaml 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281866 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/data-pool -> .qa/rbd/data-pool/ 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281854 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/cache 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281855 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/cache/.qa -> ../.qa/ 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281859 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/cache/writethrough.yaml 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281856 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/cache/none.yaml 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281858 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/cache/writeback.yaml 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281857 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/qemu/cache/writearound.yaml 2024-03-27T21:32:59.744 INFO:teuthology.orchestra.run.smithi063.stdout: 281960 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281970 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/validator 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281971 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/validator/.qa -> ../.qa/ 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281972 4 -rw-r--r-- 1 ubuntu ubuntu 273 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/validator/memcheck.yaml 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281961 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/% 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281969 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/objectstore -> .qa/objectstore 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281962 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/.qa -> ../.qa/ 2024-03-27T21:32:59.745 INFO:teuthology.orchestra.run.smithi063.stdout: 281968 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/conf -> .qa/rbd/conf 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281973 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281974 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281982 4 -rw-r--r-- 1 ubuntu ubuntu 178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/rbd_mirror.yaml 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281975 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/c_api_tests.yaml 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281976 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281981 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281979 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/python_api_tests.yaml 2024-03-27T21:32:59.746 INFO:teuthology.orchestra.run.smithi063.stdout: 281977 4 -rw-r--r-- 1 ubuntu ubuntu 263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281980 4 -rw-r--r-- 1 ubuntu ubuntu 202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281978 4 -rw-r--r-- 1 ubuntu ubuntu 62 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/workloads/fsx.yaml 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281967 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/clusters -> ../basic/clusters 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281966 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281963 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/base 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281965 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/base/install.yaml 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281964 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/valgrind/base/.qa -> ../.qa/ 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281597 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache 2024-03-27T21:32:59.747 INFO:teuthology.orchestra.run.smithi063.stdout: 281598 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/% 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281599 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/.qa -> ../.qa/ 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281605 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/conf -> .qa/rbd/conf 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281609 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281610 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/workloads 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281614 4 -rw-r--r-- 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/workloads/qemu_on_immutable_object_cache_and_thrash.yaml 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281611 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.748 INFO:teuthology.orchestra.run.smithi063.stdout: 281612 0 lrwxrwxrwx 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/workloads/c_api_tests_with_defaults.yaml -> ../../librbd/workloads/c_api_tests_with_defaults.yaml 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281613 4 -rw-r--r-- 1 ubuntu ubuntu 214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/workloads/fio_on_immutable_object_cache.yaml 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281600 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/clusters 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281601 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/clusters/+ 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281602 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281603 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/clusters/fix-2.yaml 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281604 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/clusters/openstack.yaml 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281606 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/pool 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281607 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/pool/.qa -> ../.qa/ 2024-03-27T21:32:59.749 INFO:teuthology.orchestra.run.smithi063.stdout: 281608 4 -rw-r--r-- 1 ubuntu ubuntu 330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/immutable-object-cache/pool/ceph_and_immutable_object_cache.yaml 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281471 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/.qa -> ../.qa/ 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281563 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281564 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/% 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281585 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/objectstore -> .qa/objectstore 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281582 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/msgr-failures 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281583 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281584 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/msgr-failures/few.yaml 2024-03-27T21:32:59.750 INFO:teuthology.orchestra.run.smithi063.stdout: 281565 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/.qa -> ../.qa/ 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281577 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/conf -> .qa/rbd/conf 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281586 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281587 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281593 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_luks2_luks1.yaml 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281590 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_luks1_luks1.yaml 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281588 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.751 INFO:teuthology.orchestra.run.smithi063.stdout: 281595 4 -rw-r--r-- 1 ubuntu ubuntu 227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_none_luks1.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281589 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_luks1.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281591 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_luks1_luks2.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281596 4 -rw-r--r-- 1 ubuntu ubuntu 227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_none_luks2.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281592 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_luks2.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281594 4 -rw-r--r-- 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/workloads/qemu_xfstests_luks2_luks2.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281572 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/clusters 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281575 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.752 INFO:teuthology.orchestra.run.smithi063.stdout: 281573 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/clusters/+ 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281574 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281576 4 -rw-r--r-- 1 ubuntu ubuntu 156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/clusters/openstack.yaml 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281579 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/features 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281580 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/features/.qa -> ../.qa/ 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281581 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/features/defaults.yaml 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281578 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/data-pool -> .qa/rbd/data-pool/ 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281566 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/cache 2024-03-27T21:32:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 281567 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/cache/.qa -> ../.qa/ 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281571 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/cache/writethrough.yaml 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281568 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/cache/none.yaml 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281570 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/cache/writeback.yaml 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281569 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/encryption/cache/writearound.yaml 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281495 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281496 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/% 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281512 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/objectstore -> .qa/objectstore 2024-03-27T21:32:59.754 INFO:teuthology.orchestra.run.smithi063.stdout: 281509 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/msgr-failures 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281510 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281511 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/msgr-failures/few.yaml 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281497 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/.qa -> ../.qa/ 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281502 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/conf -> .qa/rbd/conf 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281513 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281514 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281515 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281520 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/rbd_cli_migration.yaml 2024-03-27T21:32:59.755 INFO:teuthology.orchestra.run.smithi063.stdout: 281518 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/rbd_cli_import_export.yaml 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281521 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/rbd_support_module_recovery.yaml 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281519 4 -rw-r--r-- 1 ubuntu ubuntu 145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/rbd_cli_luks_encryption.yaml 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281517 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/rbd_cli_groups.yaml 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281516 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/workloads/rbd_cli_generic.yaml 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281501 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/clusters -> ../basic/clusters 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281504 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/features 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281505 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/features/.qa -> ../.qa/ 2024-03-27T21:32:59.756 INFO:teuthology.orchestra.run.smithi063.stdout: 281508 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/features/layering.yaml 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281506 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/features/defaults.yaml 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281507 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/features/journaling.yaml 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281503 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/data-pool -> .qa/rbd/data-pool/ 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281498 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/base 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281500 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/base/install.yaml 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281499 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli/base/.qa -> ../.qa/ 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281522 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281523 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/% 2024-03-27T21:32:59.757 INFO:teuthology.orchestra.run.smithi063.stdout: 281536 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/objectstore -> .qa/objectstore 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281533 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/msgr-failures 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281534 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281535 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/msgr-failures/few.yaml 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281524 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/.qa -> ../.qa/ 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281529 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/conf -> .qa/rbd/conf 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281537 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281538 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/workloads 2024-03-27T21:32:59.758 INFO:teuthology.orchestra.run.smithi063.stdout: 281539 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281541 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/workloads/rbd_cli_import_export.yaml 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281540 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/workloads/rbd_cli_generic.yaml 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281528 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/clusters -> ../basic/clusters 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281530 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/features 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281532 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/features/format-1.yaml 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281531 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/features/.qa -> ../.qa/ 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/base 2024-03-27T21:32:59.759 INFO:teuthology.orchestra.run.smithi063.stdout: 281527 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/base/install.yaml 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281526 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/cli_v1/base/.qa -> ../.qa/ 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281631 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281632 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/% 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281647 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/extra-conf 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281648 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/extra-conf/.qa -> ../.qa/ 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281651 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/extra-conf/permit-partial-discard.yaml 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281650 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/extra-conf/none.yaml 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281649 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/extra-conf/copy-on-read.yaml 2024-03-27T21:32:59.760 INFO:teuthology.orchestra.run.smithi063.stdout: 281659 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/objectstore -> .qa/objectstore 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281656 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/msgr-failures 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281657 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281658 4 -rw-r--r-- 1 ubuntu ubuntu 209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/msgr-failures/few.yaml 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281633 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/.qa -> ../.qa/ 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281645 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/conf -> .qa/rbd/conf 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281660 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281661 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads 2024-03-27T21:32:59.761 INFO:teuthology.orchestra.run.smithi063.stdout: 281662 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281663 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/c_api_tests.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281670 4 -rw-r--r-- 1 ubuntu ubuntu 220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/rbd_fio.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281664 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281669 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281667 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/python_api_tests.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281665 4 -rw-r--r-- 1 ubuntu ubuntu 263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281668 4 -rw-r--r-- 1 ubuntu ubuntu 202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml 2024-03-27T21:32:59.762 INFO:teuthology.orchestra.run.smithi063.stdout: 281666 4 -rw-r--r-- 1 ubuntu ubuntu 57 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/workloads/fsx.yaml 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/clusters 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281643 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281641 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/clusters/+ 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281642 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281644 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/clusters/openstack.yaml 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281646 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/data-pool -> .qa/rbd/data-pool/ 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281652 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/min-compat-client 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281653 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/min-compat-client/.qa -> ../.qa/ 2024-03-27T21:32:59.763 INFO:teuthology.orchestra.run.smithi063.stdout: 281655 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/min-compat-client/octopus.yaml 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281654 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/min-compat-client/default.yaml 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281634 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/cache 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281635 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/cache/.qa -> ../.qa/ 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281639 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/cache/writethrough.yaml 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281636 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/cache/none.yaml 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281638 4 -rw-r--r-- 1 ubuntu ubuntu 110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/cache/writeback.yaml 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281637 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/librbd/cache/writearound.yaml 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281720 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash 2024-03-27T21:32:59.764 INFO:teuthology.orchestra.run.smithi063.stdout: 281721 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/% 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281726 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/clients 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281727 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/clients/.qa -> ../.qa/ 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281728 4 -rw-r--r-- 1 ubuntu ubuntu 2003 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/clients/mirror.yaml 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281736 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/objectstore -> .qa/objectstore 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281735 0 lrwxrwxrwx 1 ubuntu ubuntu 22 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/msgr-failures -> ../basic/msgr-failures 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281722 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281734 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/conf -> .qa/rbd/conf 2024-03-27T21:32:59.765 INFO:teuthology.orchestra.run.smithi063.stdout: 281744 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281745 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281746 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281749 4 -rw-r--r-- 1 ubuntu ubuntu 406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/rbd-mirror-journal-workunit.yaml 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281752 4 -rw-r--r-- 1 ubuntu ubuntu 490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/rbd-mirror-snapshot-stress-workunit-minimum.yaml 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281750 4 -rw-r--r-- 1 ubuntu ubuntu 505 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock.yaml 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281751 4 -rw-r--r-- 1 ubuntu ubuntu 526 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/rbd-mirror-snapshot-stress-workunit-fast-diff.yaml 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281747 4 -rw-r--r-- 1 ubuntu ubuntu 967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/rbd-mirror-fsx-workunit.yaml 2024-03-27T21:32:59.766 INFO:teuthology.orchestra.run.smithi063.stdout: 281748 4 -rw-r--r-- 1 ubuntu ubuntu 451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/workloads/rbd-mirror-journal-stress-workunit.yaml 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281741 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/rbd-mirror 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281743 4 -rw-r--r-- 1 ubuntu ubuntu 691 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/rbd-mirror/four-per-cluster.yaml 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281742 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/rbd-mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281737 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/policy 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281738 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/policy/.qa -> ../.qa/ 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281740 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/policy/simple.yaml 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281739 4 -rw-r--r-- 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/policy/none.yaml 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281723 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/base 2024-03-27T21:32:59.767 INFO:teuthology.orchestra.run.smithi063.stdout: 281725 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/base/install.yaml 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281724 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/base/.qa -> ../.qa/ 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281729 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/cluster 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281730 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/cluster/+ 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281731 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281733 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/cluster/openstack.yaml 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281732 4 -rw-r--r-- 1 ubuntu ubuntu 758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror-thrash/cluster/2-node.yaml 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281896 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281899 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all 2024-03-27T21:32:59.768 INFO:teuthology.orchestra.run.smithi063.stdout: 281918 4 -rw-r--r-- 1 ubuntu ubuntu 172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/snap-diff.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281916 4 -rw-r--r-- 1 ubuntu ubuntu 226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/read-flags-writeback.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281906 4 -rw-r--r-- 1 ubuntu ubuntu 334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281900 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/.qa -> ../.qa/ 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281912 4 -rw-r--r-- 1 ubuntu ubuntu 225 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/rbd_mirror.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281908 4 -rw-r--r-- 1 ubuntu ubuntu 369 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/qemu-iotests-writeback.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281905 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/permissions.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281901 4 -rw-r--r-- 1 ubuntu ubuntu 149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/admin_socket.yaml 2024-03-27T21:32:59.769 INFO:teuthology.orchestra.run.smithi063.stdout: 281914 4 -rw-r--r-- 1 ubuntu ubuntu 106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281909 4 -rw-r--r-- 1 ubuntu ubuntu 364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281917 4 -rw-r--r-- 1 ubuntu ubuntu 221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/read-flags-writethrough.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281902 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/formatted-output.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281904 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/mon-command-help.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281910 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/qos.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281919 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/verify_pool.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281903 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/merge_diff.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281913 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/rbd_tasks.yaml 2024-03-27T21:32:59.770 INFO:teuthology.orchestra.run.smithi063.stdout: 281911 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281907 4 -rw-r--r-- 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/qemu-iotests-writearound.yaml 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281915 4 -rw-r--r-- 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/all/read-flags-no-cache.yaml 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281897 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/% 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281921 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/objectstore -> .qa/objectstore 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281898 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/.qa -> ../.qa/ 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281922 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/openstack.yaml 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281920 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/conf -> .qa/rbd/conf 2024-03-27T21:32:59.771 INFO:teuthology.orchestra.run.smithi063.stdout: 281923 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281883 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281886 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/all 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281887 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/all/.qa -> ../.qa/ 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281888 4 -rw-r--r-- 1 ubuntu ubuntu 257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/all/issue-20295.yaml 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281884 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/% 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281890 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/objectstore 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281893 0 lrwxrwxrwx 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/objectstore/bluestore-comp-snappy.yaml -> .qa/objectstore/bluestore-comp-snappy.yaml 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281891 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.772 INFO:teuthology.orchestra.run.smithi063.stdout: 281892 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/objectstore/bluestore-bitmap.yaml -> .qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281885 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/.qa -> ../.qa/ 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281894 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/openstack.yaml 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281889 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/conf -> .qa/rbd/conf 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281895 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/singleton-bluestore/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281753 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281754 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/% 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281757 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/clients 2024-03-27T21:32:59.773 INFO:teuthology.orchestra.run.smithi063.stdout: 281758 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/clients/+ 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281759 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/clients/.qa -> ../.qa/ 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281760 4 -rw-r--r-- 1 ubuntu ubuntu 1285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/clients/mirror-extra.yaml 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281761 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/clients/mirror.yaml -> ../../mirror-thrash/clients/mirror.yaml 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281765 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/objectstore -> ../mirror-thrash/objectstore 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281764 0 lrwxrwxrwx 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/msgr-failures -> ../mirror-thrash/msgr-failures 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281755 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/.qa -> ../.qa/ 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281763 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/conf -> .qa/rbd/conf 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281766 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.774 INFO:teuthology.orchestra.run.smithi063.stdout: 281767 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281768 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281775 4 -rw-r--r-- 1 ubuntu ubuntu 406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-snapshot-bootstrap-workunit.yaml 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281781 4 -rw-r--r-- 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-workunit-config-key.yaml 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281772 4 -rw-r--r-- 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/compare-mirror-images-nbd.yaml 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281777 4 -rw-r--r-- 1 ubuntu ubuntu 477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-snapshot-workunit-fast-diff.yaml 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281769 4 -rw-r--r-- 1 ubuntu ubuntu 247 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/compare-mirror-image-alternate-primary-krbd.yaml 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281780 4 -rw-r--r-- 1 ubuntu ubuntu 348 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit-min-compat-client-octopus.yaml 2024-03-27T21:32:59.775 INFO:teuthology.orchestra.run.smithi063.stdout: 281783 4 -rw-r--r-- 1 ubuntu ubuntu 455 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-workunit-policy-none.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281782 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-workunit-min-compat-client-octopus.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281770 4 -rw-r--r-- 1 ubuntu ubuntu 286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/compare-mirror-image-alternate-primary-nbd.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281774 4 -rw-r--r-- 1 ubuntu ubuntu 404 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-journal-bootstrap-workunit.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281773 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-ha-workunit.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281776 4 -rw-r--r-- 1 ubuntu ubuntu 456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-snapshot-workunit-exclusive-lock.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281784 4 -rw-r--r-- 1 ubuntu ubuntu 457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-workunit-policy-simple.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281778 4 -rw-r--r-- 1 ubuntu ubuntu 467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-snapshot-workunit-journaling.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281779 4 -rw-r--r-- 1 ubuntu ubuntu 441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/rbd-mirror-snapshot-workunit-minimum.yaml 2024-03-27T21:32:59.776 INFO:teuthology.orchestra.run.smithi063.stdout: 281771 4 -rw-r--r-- 1 ubuntu ubuntu 230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/workloads/compare-mirror-images-krbd.yaml 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281756 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/base -> ../mirror-thrash/base 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281762 0 lrwxrwxrwx 1 ubuntu ubuntu 24 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/mirror/cluster -> ../mirror-thrash/cluster 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281924 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281925 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/% 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281939 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/objectstore -> .qa/objectstore 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281936 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/msgr-failures 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281937 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281938 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/msgr-failures/few.yaml 2024-03-27T21:32:59.777 INFO:teuthology.orchestra.run.smithi063.stdout: 281926 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281935 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/conf -> .qa/rbd/conf 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281944 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281940 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281945 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281958 4 -rw-r--r-- 1 ubuntu ubuntu 124 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281946 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281951 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml 2024-03-27T21:32:59.778 INFO:teuthology.orchestra.run.smithi063.stdout: 281955 4 -rw-r--r-- 1 ubuntu ubuntu 160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281950 4 -rw-r--r-- 1 ubuntu ubuntu 263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281953 4 -rw-r--r-- 1 ubuntu ubuntu 159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281947 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/journal.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281949 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281954 4 -rw-r--r-- 1 ubuntu ubuntu 154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281952 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_cache_writearound.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281948 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_api_tests.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281957 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml 2024-03-27T21:32:59.779 INFO:teuthology.orchestra.run.smithi063.stdout: 281959 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_rate_limit.yaml 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281956 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/workloads/rbd_fsx_deep_copy.yaml 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281930 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/clusters 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281933 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/clusters/fixed-2.yaml -> .qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281931 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/clusters/+ 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281932 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281934 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/clusters/openstack.yaml 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281927 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/base 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281929 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/base/install.yaml 2024-03-27T21:32:59.780 INFO:teuthology.orchestra.run.smithi063.stdout: 281928 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/base/.qa -> ../.qa/ 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281941 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/thrashers 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281942 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/thrashers/.qa -> ../.qa/ 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281943 4 -rw-r--r-- 1 ubuntu ubuntu 150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/thrash/thrashers/default.yaml 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281801 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281802 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/.qa -> ../.qa/ 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281803 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281804 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/% 2024-03-27T21:32:59.781 INFO:teuthology.orchestra.run.smithi063.stdout: 281805 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/.qa -> ../.qa/ 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281827 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/conf -> .qa/rbd/conf 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281818 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/6-cache-size 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281819 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/6-cache-size/.qa -> ../.qa/ 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281821 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/6-cache-size/8G.yaml 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281820 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/6-cache-size/1G.yaml 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281806 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/1-base -> ../../basic/base/ 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281812 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/3-supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281814 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/5-cache-mode 2024-03-27T21:32:59.782 INFO:teuthology.orchestra.run.smithi063.stdout: 281816 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/5-cache-mode/rwl.yaml 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281815 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/5-cache-mode/.qa -> ../.qa/ 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281817 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/5-cache-mode/ssd.yaml 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281822 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/7-workloads 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281823 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/7-workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281825 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/7-workloads/fio.yaml 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281824 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/7-workloads/c_api_tests_with_defaults.yaml -> ../../../librbd/workloads/c_api_tests_with_defaults.yaml 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281826 4 -rw-r--r-- 1 ubuntu ubuntu 183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/7-workloads/recovery.yaml 2024-03-27T21:32:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: 281813 4 -rw-r--r-- 1 ubuntu ubuntu 319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/4-cache-path.yaml 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281807 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/2-cluster 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281808 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/2-cluster/+ 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281809 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/2-cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281810 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/2-cluster/fix-2.yaml 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281811 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/home/2-cluster/openstack.yaml 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281828 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281829 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/% 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281830 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/.qa -> ../.qa/ 2024-03-27T21:32:59.784 INFO:teuthology.orchestra.run.smithi063.stdout: 281850 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/conf -> .qa/rbd/conf 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281843 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/6-cache-size 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281844 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/6-cache-size/.qa -> ../.qa/ 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281845 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/6-cache-size/1G.yaml 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281846 4 -rw-r--r-- 1 ubuntu ubuntu 89 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/6-cache-size/5G.yaml 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281831 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/1-base -> ../../basic/base/ 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281837 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/3-supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281839 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/5-cache-mode 2024-03-27T21:32:59.785 INFO:teuthology.orchestra.run.smithi063.stdout: 281841 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/5-cache-mode/rwl.yaml 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281840 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/5-cache-mode/.qa -> ../.qa/ 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281842 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/5-cache-mode/ssd.yaml 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281847 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/7-workloads 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281848 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/7-workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281849 4 -rw-r--r-- 1 ubuntu ubuntu 131 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/7-workloads/qemu_xfstests.yaml 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281838 4 -rw-r--r-- 1 ubuntu ubuntu 868 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/4-cache-path.yaml 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281832 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/2-cluster 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281833 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/2-cluster/+ 2024-03-27T21:32:59.786 INFO:teuthology.orchestra.run.smithi063.stdout: 281834 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/2-cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281835 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/2-cluster/fix-2.yaml 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281836 4 -rw-r--r-- 1 ubuntu ubuntu 93 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/pwl-cache/tmpfs/2-cluster/openstack.yaml 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281472 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281473 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/% 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281487 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/objectstore -> .qa/objectstore 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281484 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/msgr-failures 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281485 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/msgr-failures/.qa -> ../.qa/ 2024-03-27T21:32:59.787 INFO:teuthology.orchestra.run.smithi063.stdout: 281486 4 -rw-r--r-- 1 ubuntu ubuntu 177 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/msgr-failures/few.yaml 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281474 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281483 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/conf -> .qa/rbd/conf 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281488 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281478 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/clusters 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281481 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/clusters/fixed-1.yaml -> .qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281479 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/clusters/+ 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281480 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281482 4 -rw-r--r-- 1 ubuntu ubuntu 87 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/clusters/openstack.yaml 2024-03-27T21:32:59.788 INFO:teuthology.orchestra.run.smithi063.stdout: 281475 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/base 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281477 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/base/install.yaml 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281476 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/base/.qa -> ../.qa/ 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281489 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/tasks 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281493 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281490 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281492 4 -rw-r--r-- 1 ubuntu ubuntu 143 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/tasks/rbd_cls_tests.yaml 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281491 4 -rw-r--r-- 1 ubuntu ubuntu 228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281494 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml 2024-03-27T21:32:59.789 INFO:teuthology.orchestra.run.smithi063.stdout: 281785 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281786 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/% 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281787 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/.qa -> ../.qa/ 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281797 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/conf -> .qa/rbd/conf 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281798 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/workloads 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281799 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281800 4 -rw-r--r-- 1 ubuntu ubuntu 929 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/workloads/nvmeof_initiator.yaml 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281791 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.790 INFO:teuthology.orchestra.run.smithi063.stdout: 281788 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/base 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281790 4 -rw-r--r-- 1 ubuntu ubuntu 232 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/base/install.yaml 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281789 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/base/.qa -> ../.qa/ 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281792 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/cluster 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281793 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/cluster/+ 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281794 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281796 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/cluster/openstack.yaml 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281795 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/nvmeof/cluster/fixed-4.yaml 2024-03-27T21:32:59.791 INFO:teuthology.orchestra.run.smithi063.stdout: 281693 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281694 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/% 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281695 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/.qa -> ../.qa/ 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281703 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/4-supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281716 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/9-cleanup 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281718 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/9-cleanup/cleanup.yaml 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281717 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/9-cleanup/.qa -> ../.qa/ 2024-03-27T21:32:59.792 INFO:teuthology.orchestra.run.smithi063.stdout: 281719 0 lrwxrwxrwx 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/conf -> .qa/rbd/conf 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281696 0 lrwxrwxrwx 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/1-base -> ../thrash/base 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281702 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/3-objectstore -> .qa/objectstore 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281710 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/7-io-workloads 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281711 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/7-io-workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281712 4 -rw-r--r-- 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/7-io-workloads/qemu_xfstests.yaml 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281704 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/5-data-pool -> .qa/rbd/data-pool/ 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281705 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/6-prepare 2024-03-27T21:32:59.793 INFO:teuthology.orchestra.run.smithi063.stdout: 281707 4 -rw-r--r-- 1 ubuntu ubuntu 822 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/6-prepare/qcow2-file.yaml 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281706 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/6-prepare/.qa -> ../.qa/ 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281709 4 -rw-r--r-- 1 ubuntu ubuntu 961 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/6-prepare/raw-file.yaml 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281708 4 -rw-r--r-- 1 ubuntu ubuntu 690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/6-prepare/qcow2-http.yaml 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281713 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/8-migrate-workloads 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281715 4 -rw-r--r-- 1 ubuntu ubuntu 325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/8-migrate-workloads/execute.yaml 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281714 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/8-migrate-workloads/.qa -> ../.qa/ 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281697 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/2-clusters 2024-03-27T21:32:59.794 INFO:teuthology.orchestra.run.smithi063.stdout: 281700 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/2-clusters/fixed-3.yaml -> .qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 281698 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/2-clusters/+ 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 281699 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/2-clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 281701 4 -rw-r--r-- 1 ubuntu ubuntu 156 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rbd/migration/2-clusters/openstack.yaml 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 280531 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 280532 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/.qa -> ../.qa/ 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 280533 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 280538 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/objectstore -> .qa/objectstore 2024-03-27T21:32:59.795 INFO:teuthology.orchestra.run.smithi063.stdout: 280534 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280535 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/clusters 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280537 4 -rw-r--r-- 1 ubuntu ubuntu 99 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/clusters/fixed-3.yaml 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280536 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280539 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/tasks 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280540 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280542 4 -rw-r--r-- 1 ubuntu ubuntu 459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 280541 4 -rw-r--r-- 1 ubuntu ubuntu 452 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2024-03-27T21:32:59.796 INFO:teuthology.orchestra.run.smithi063.stdout: 282438 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282439 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/.qa -> ../.qa/ 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282487 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282488 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/% 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282489 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/.qa -> ../.qa/ 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282490 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/distros -> .qa/distros/supported 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282491 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/tasks 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282492 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.797 INFO:teuthology.orchestra.run.smithi063.stdout: 282493 4 -rw-r--r-- 1 ubuntu ubuntu 465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282494 4 -rw-r--r-- 1 ubuntu ubuntu 561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282495 4 -rw-r--r-- 1 ubuntu ubuntu 425 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/rgw/tasks/s3tests.yaml 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282459 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/all 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282464 4 -rw-r--r-- 1 ubuntu ubuntu 386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/all/ceph.yaml 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282463 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/all/.qa -> ../.qa/ 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282466 4 -rw-r--r-- 1 ubuntu ubuntu 1189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/all/upgrade.yaml 2024-03-27T21:32:59.798 INFO:teuthology.orchestra.run.smithi063.stdout: 282465 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/all/thrashosds.yaml 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282467 4 -rw-r--r-- 1 ubuntu ubuntu 330 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/all/workunit.yaml 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282460 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/% 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282461 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/multi-cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282458 4 -rw-r--r-- 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/integration.yaml 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282440 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282441 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/% 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282442 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/.qa -> ../.qa/ 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282443 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/supported-distros -> .qa/distros/supported 2024-03-27T21:32:59.799 INFO:teuthology.orchestra.run.smithi063.stdout: 282444 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/tasks 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282445 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282447 4 -rw-r--r-- 1 ubuntu ubuntu 302 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/tasks/tag.yaml 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282446 4 -rw-r--r-- 1 ubuntu ubuntu 293 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/buildpackages/tasks/default.yaml 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282477 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282478 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/% 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282479 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/.qa -> ../.qa/ 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282480 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/clusters 2024-03-27T21:32:59.800 INFO:teuthology.orchestra.run.smithi063.stdout: 282481 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282483 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/clusters/single.yaml 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282482 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/clusters/empty.yaml 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282484 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/tasks 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282485 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282486 4 -rw-r--r-- 1 ubuntu ubuntu 19 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/nop/tasks/nop.yaml 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282448 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282449 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/% 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282450 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.801 INFO:teuthology.orchestra.run.smithi063.stdout: 282451 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/clusters 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282452 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282453 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/clusters/single.yaml 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282454 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/distros -> .qa/distros/supported 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282455 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/tasks 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282456 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282457 4 -rw-r--r-- 1 ubuntu ubuntu 35 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/ceph/tasks/teuthology.yaml 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282496 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/workunits 2024-03-27T21:32:59.802 INFO:teuthology.orchestra.run.smithi063.stdout: 282497 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/workunits/.qa -> ../.qa/ 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282498 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/workunits/yes.yaml 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282468 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282469 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/% 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282470 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/.qa -> ../.qa/ 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282471 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/clusters 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282472 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282473 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/clusters/single.yaml 2024-03-27T21:32:59.803 INFO:teuthology.orchestra.run.smithi063.stdout: 282474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/tasks 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 282475 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 282476 4 -rw-r--r-- 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/teuthology/no-ceph/tasks/teuthology.yaml 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 279033 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 279034 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/.qa -> ../.qa 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 279035 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 279036 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/.qa -> ../.qa/ 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 279037 4 drwxr-xr-x 6 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic 2024-03-27T21:32:59.804 INFO:teuthology.orchestra.run.smithi063.stdout: 279038 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/% 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279049 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/objectstore 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279050 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279051 4 -rw-r--r-- 1 ubuntu ubuntu 86 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/objectstore/seastore.yaml 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279039 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279046 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/deploy 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279048 4 -rw-r--r-- 1 ubuntu ubuntu 383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/deploy/ceph.yaml 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279047 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/deploy/.qa -> ../.qa/ 2024-03-27T21:32:59.805 INFO:teuthology.orchestra.run.smithi063.stdout: 279041 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/clusters 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279043 4 -rw-r--r-- 1 ubuntu ubuntu 321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/clusters/fixed-1.yaml 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279044 4 -rw-r--r-- 1 ubuntu ubuntu 401 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/clusters/fixed-2.yaml 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279042 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279045 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/crimson_qa_overrides.yaml -> .qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279040 0 lrwxrwxrwx 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/centos_latest.yaml -> .qa/distros/supported/centos_latest.yaml 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279052 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/tasks 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279053 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.806 INFO:teuthology.orchestra.run.smithi063.stdout: 279054 4 -rw-r--r-- 1 ubuntu ubuntu 625 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/tasks/rados_api_tests.yaml 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 279055 4 -rw-r--r-- 1 ubuntu ubuntu 318 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/crimson-rados-experimental/seastore/basic/tasks/readwrite.yaml 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280554 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280555 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/.qa -> ../.qa/ 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280743 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280744 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/.qa -> ../.qa/ 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280745 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280752 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/0-nvme-loop.yaml -> .qa/overrides/nvme_loop.yaml 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280746 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/% 2024-03-27T21:32:59.807 INFO:teuthology.orchestra.run.smithi063.stdout: 280747 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/.qa -> ../.qa/ 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280770 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/rook 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280772 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/rook/1.7.2.yaml 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280771 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/rook/.qa -> ../.qa/ 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280773 4 -rw-r--r-- 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/rook/master.yaml 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280754 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/2-workload 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280755 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/2-workload/.qa -> ../.qa/ 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280757 4 -rw-r--r-- 1 ubuntu ubuntu 68 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/2-workload/radosbench.yaml 2024-03-27T21:32:59.808 INFO:teuthology.orchestra.run.smithi063.stdout: 280756 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/2-workload/none.yaml 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280765 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/net 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280766 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/net/.qa -> ../.qa/ 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280767 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/net/calico.yaml 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280768 4 -rw-r--r-- 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/net/flannel.yaml 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280769 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/net/host.yaml 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280753 4 -rw-r--r-- 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/1-rook.yaml 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280758 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/cluster 2024-03-27T21:32:59.809 INFO:teuthology.orchestra.run.smithi063.stdout: 280759 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/cluster/.qa -> ../.qa/ 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280760 4 -rw-r--r-- 1 ubuntu ubuntu 112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/cluster/1-node.yaml 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280761 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/cluster/3-node.yaml 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280748 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/0-distro 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280749 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/0-distro/.qa -> ../.qa/ 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280750 0 lrwxrwxrwx 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/0-distro/ubuntu_22.04.yaml -> .qa/distros/container-hosts/ubuntu_22.04.yaml 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280762 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/k8s 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280763 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/k8s/.qa -> ../.qa/ 2024-03-27T21:32:59.810 INFO:teuthology.orchestra.run.smithi063.stdout: 280764 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/k8s/1.21.yaml 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280751 4 -rw-r--r-- 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/rook/smoke/0-kubeadm.yaml 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280556 4 drwxr-xr-x 15 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280557 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/.qa -> ../.qa/ 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280635 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280638 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/0-random-distro$ -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280636 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/% 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280637 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/.qa -> ../.qa/ 2024-03-27T21:32:59.811 INFO:teuthology.orchestra.run.smithi063.stdout: 280640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/2-services 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280643 4 -rw-r--r-- 1 ubuntu ubuntu 257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/2-services/rgw.yaml 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280641 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/2-services/.qa -> ../.qa/ 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280642 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/2-services/basic.yaml 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280639 4 -rw-r--r-- 1 ubuntu ubuntu 450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/1-start.yaml 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280644 4 -rw-r--r-- 1 ubuntu ubuntu 157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-singlehost/3-final.yaml 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280588 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280592 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/0-nvme-loop.yaml -> .qa/overrides/nvme_loop.yaml 2024-03-27T21:32:59.812 INFO:teuthology.orchestra.run.smithi063.stdout: 280589 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/% 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280590 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/.qa -> ../.qa/ 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280593 4 -rw-r--r-- 1 ubuntu ubuntu 461 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/1-start.yaml 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280594 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280600 4 -rw-r--r-- 1 ubuntu ubuntu 678 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops/rmdir-reactivate.yaml 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280595 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops/.qa -> ../.qa/ 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280596 4 -rw-r--r-- 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops/repave-all.yaml 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280597 4 -rw-r--r-- 1 ubuntu ubuntu 636 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops/rm-zap-add.yaml 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280599 4 -rw-r--r-- 1 ubuntu ubuntu 592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops/rm-zap-wait.yaml 2024-03-27T21:32:59.813 INFO:teuthology.orchestra.run.smithi063.stdout: 280598 4 -rw-r--r-- 1 ubuntu ubuntu 571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/2-ops/rm-zap-flag.yaml 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280591 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/osds/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280602 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280603 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/% 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280604 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/.qa -> ../.qa 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280606 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/tasks 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280607 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/tasks/.qa -> ../.qa 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280609 4 -rw-r--r-- 1 ubuntu ubuntu 2851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/tasks/deploy_smb_domain.yaml 2024-03-27T21:32:59.814 INFO:teuthology.orchestra.run.smithi063.stdout: 280608 4 -rw-r--r-- 1 ubuntu ubuntu 2662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/tasks/deploy_smb_basic.yaml 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280605 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smb/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280559 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280562 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/0-centos_9.stream.yaml -> .qa/distros/podman/centos_9.stream.yaml 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280569 4 -rw-r--r-- 1 ubuntu ubuntu 325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/4-final.yaml 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280560 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/% 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280561 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280568 4 -rw-r--r-- 1 ubuntu ubuntu 1576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/3-upgrade-with-workload.yaml 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280566 4 -rw-r--r-- 1 ubuntu ubuntu 440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/1-start.yaml 2024-03-27T21:32:59.815 INFO:teuthology.orchestra.run.smithi063.stdout: 280563 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/1-bootstrap 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280564 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/1-bootstrap/.qa -> ../.qa/ 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280565 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/1-bootstrap/17.2.0.yaml 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280567 4 -rw-r--r-- 1 ubuntu ubuntu 879 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mgr-nfs-upgrade/2-nfs.yaml 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280571 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280572 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/% 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280573 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/.qa -> ../.qa/ 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280576 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/task 2024-03-27T21:32:59.816 INFO:teuthology.orchestra.run.smithi063.stdout: 280579 4 -rw-r--r-- 1 ubuntu ubuntu 241 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/task/test_orch_cli.yaml 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280578 4 -rw-r--r-- 1 ubuntu ubuntu 172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/task/test_cephadm_timeout.yaml 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280577 4 -rw-r--r-- 1 ubuntu ubuntu 211 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/task/test_adoption.yaml 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280580 4 -rw-r--r-- 1 ubuntu ubuntu 602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/task/test_orch_cli_mon.yaml 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280575 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/mon_election -> .qa/mon_election 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280574 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/no-agent-workunits/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280686 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280703 0 lrwxrwxrwx 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/agent -> ../smoke/agent 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280702 4 -rw-r--r-- 1 ubuntu ubuntu 230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/5-upgrade-ls.yaml 2024-03-27T21:32:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 280687 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/% 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280688 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280701 4 -rw-r--r-- 1 ubuntu ubuntu 666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/4-wait.yaml 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280689 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/1-start-distro 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280690 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/1-start-distro/.qa -> ../.qa/ 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280691 4 -rw-r--r-- 1 ubuntu ubuntu 427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/1-start-distro/1-start-centos_9.stream.yaml 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280692 4 -rw-r--r-- 1 ubuntu ubuntu 424 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/1-start-distro/1-start-ubuntu_20.04.yaml 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280697 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/3-upgrade 2024-03-27T21:32:59.818 INFO:teuthology.orchestra.run.smithi063.stdout: 280698 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/3-upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280699 4 -rw-r--r-- 1 ubuntu ubuntu 1007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/3-upgrade/simple.yaml 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280700 8 -rw-r--r-- 1 ubuntu ubuntu 7926 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/3-upgrade/staggered.yaml 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280693 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/2-repo_digest 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280694 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/2-repo_digest/.qa -> ../.qa/ 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280695 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/2-repo_digest/defaut.yaml 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280696 4 -rw-r--r-- 1 ubuntu ubuntu 105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/2-repo_digest/repo_digest.yaml 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280704 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/upgrade/mon_election -> .qa/mon_election 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280601 0 lrwxrwxrwx 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/rbd_iscsi -> .qa/suites/rbd/iscsi 2024-03-27T21:32:59.819 INFO:teuthology.orchestra.run.smithi063.stdout: 280671 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280683 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/fixed-2.yaml -> ../smoke/fixed-2.yaml 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280684 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/msgr -> .qa/msgr 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280672 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/% 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280685 4 -rw-r--r-- 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/root.yaml 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280677 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/3-tasks 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280678 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/3-tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280682 0 lrwxrwxrwx 1 ubuntu ubuntu 56 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/3-tasks/snaps-few-objects.yaml -> .qa/suites/rados/thrash/workloads/snaps-few-objects.yaml 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280680 0 lrwxrwxrwx 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/3-tasks/radosbench.yaml -> .qa/suites/rados/thrash/workloads/radosbench.yaml 2024-03-27T21:32:59.820 INFO:teuthology.orchestra.run.smithi063.stdout: 280679 0 lrwxrwxrwx 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/3-tasks/rados_api_tests.yaml -> .qa/suites/rados/thrash/workloads/rados_api_tests.yaml 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280681 0 lrwxrwxrwx 1 ubuntu ubuntu 52 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/3-tasks/small-objects.yaml -> .qa/suites/rados/thrash/workloads/small-objects.yaml 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280673 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/.qa -> ../.qa/ 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280676 4 -rw-r--r-- 1 ubuntu ubuntu 696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/2-thrash.yaml 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280675 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/1-start.yaml 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280674 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/thrash/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280558 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/mds_upgrade_sequence -> .qa/suites/fs/upgrade/mds_upgrade_sequence/ 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280705 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work 2024-03-27T21:32:59.821 INFO:teuthology.orchestra.run.smithi063.stdout: 280709 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/fixed-2.yaml -> ../smoke/fixed-2.yaml 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280715 0 lrwxrwxrwx 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/msgr -> .qa/msgr 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280706 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/% 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280707 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/.qa -> ../.qa/ 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280717 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/tasks 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280718 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280719 0 lrwxrwxrwx 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/tasks/rados_api_tests.yaml -> .qa/suites/rados/basic/tasks/rados_api_tests.yaml 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280721 4 -rw-r--r-- 1 ubuntu ubuntu 400 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/tasks/rotate-keys.yaml 2024-03-27T21:32:59.822 INFO:teuthology.orchestra.run.smithi063.stdout: 280720 0 lrwxrwxrwx 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/tasks/rados_python.yaml -> .qa/suites/rados/basic/tasks/rados_python.yaml 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280714 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/mon_election -> .qa/mon_election 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280708 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280716 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/start.yaml 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280710 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/mode 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280713 4 -rw-r--r-- 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/mode/root.yaml 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280711 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/mode/.qa -> ../.qa/ 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280712 4 -rw-r--r-- 1 ubuntu ubuntu 97 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/with-work/mode/packaged.yaml 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280581 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli 2024-03-27T21:32:59.823 INFO:teuthology.orchestra.run.smithi063.stdout: 280586 0 lrwxrwxrwx 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli/agent -> ../smoke/agent 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280584 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli/0-random-distro$ -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280587 4 -rw-r--r-- 1 ubuntu ubuntu 514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli/orchestrator_cli.yaml 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280582 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli/% 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280583 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli/.qa -> ../.qa/ 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280585 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/orchestrator_cli/2-node-mgr.yaml -> .qa/clusters/2-node-mgr.yaml 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280722 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280726 0 lrwxrwxrwx 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/agent -> ../smoke/agent 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280723 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/% 2024-03-27T21:32:59.824 INFO:teuthology.orchestra.run.smithi063.stdout: 280724 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/.qa -> ../.qa/ 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280728 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280729 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/.qa -> ../.qa/ 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280740 4 -rw-r--r-- 1 ubuntu ubuntu 2661 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_monitoring_stack_basic.yaml 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280731 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_cephadm.yaml 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280733 4 -rw-r--r-- 1 ubuntu ubuntu 4064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_extra_daemon_features.yaml 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280734 4 -rw-r--r-- 1 ubuntu ubuntu 2740 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_host_drain.yaml 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280742 4 -rw-r--r-- 1 ubuntu ubuntu 2084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_set_mon_crush_locations.yaml 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280735 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_iscsi_container 2024-03-27T21:32:59.825 INFO:teuthology.orchestra.run.smithi063.stdout: 280736 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_iscsi_container/+ 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280737 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_iscsi_container/.qa -> ../.qa/ 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280739 4 -rw-r--r-- 1 ubuntu ubuntu 362 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_iscsi_container/test_iscsi_container.yaml 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280738 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_iscsi_container/centos_9.stream.yaml -> .qa/distros/podman/centos_9.stream.yaml 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280730 4 -rw-r--r-- 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_ca_signed_key.yaml 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280732 4 -rw-r--r-- 1 ubuntu ubuntu 154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_cephadm_repos.yaml 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280741 4 -rw-r--r-- 1 ubuntu ubuntu 1313 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/task/test_rgw_multisite.yaml 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280727 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/mon_election -> .qa/mon_election 2024-03-27T21:32:59.826 INFO:teuthology.orchestra.run.smithi063.stdout: 280725 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/workunits/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280645 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280652 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/agent 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280653 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/agent/.qa -> ../.qa/ 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280654 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/agent/off.yaml 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280655 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/agent/on.yaml 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280656 4 -rw-r--r-- 1 ubuntu ubuntu 426 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/fixed-2.yaml 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280651 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/0-nvme-loop.yaml -> .qa/overrides/nvme_loop.yaml 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280646 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/% 2024-03-27T21:32:59.827 INFO:teuthology.orchestra.run.smithi063.stdout: 280647 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/.qa -> ../.qa/ 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280657 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/mon_election -> .qa/mon_election 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280648 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/0-distro 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280650 0 lrwxrwxrwx 1 ubuntu ubuntu 53 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/0-distro/centos_9.stream_runc.yaml -> .qa/distros/container-hosts/centos_9.stream_runc.yaml 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280649 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/0-distro/.qa -> ../.qa 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280658 4 -rw-r--r-- 1 ubuntu ubuntu 356 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-small/start.yaml 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280610 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280614 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/0-nvme-loop.yaml -> .qa/overrides/nvme_loop.yaml 2024-03-27T21:32:59.828 INFO:teuthology.orchestra.run.smithi063.stdout: 280611 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/% 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280612 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/.qa -> ../.qa/ 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280625 4 -rw-r--r-- 1 ubuntu ubuntu 2364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs-ingress-rgw-user.yaml 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280633 4 -rw-r--r-- 1 ubuntu ubuntu 257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/rgw.yaml 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280617 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/.qa -> ../.qa/ 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280631 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nvmeof.yaml 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280619 4 -rw-r--r-- 1 ubuntu ubuntu 1405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/client-keyring.yaml 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280627 4 -rw-r--r-- 1 ubuntu ubuntu 2167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs-ingress2.yaml 2024-03-27T21:32:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 280630 4 -rw-r--r-- 1 ubuntu ubuntu 221 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs2.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280622 4 -rw-r--r-- 1 ubuntu ubuntu 248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/mirror.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280624 4 -rw-r--r-- 1 ubuntu ubuntu 2317 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs-ingress-rgw-bucket.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280623 4 -rw-r--r-- 1 ubuntu ubuntu 955 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs-haproxy-proto.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280629 4 -rw-r--r-- 1 ubuntu ubuntu 234 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280632 4 -rw-r--r-- 1 ubuntu ubuntu 1907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/rgw-ingress.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280620 4 -rw-r--r-- 1 ubuntu ubuntu 184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/iscsi.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280618 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/basic.yaml 2024-03-27T21:32:59.830 INFO:teuthology.orchestra.run.smithi063.stdout: 280621 4 -rw-r--r-- 1 ubuntu ubuntu 287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/jaeger.yaml 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280628 4 -rw-r--r-- 1 ubuntu ubuntu 1308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs-keepalive-only.yaml 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280626 4 -rw-r--r-- 1 ubuntu ubuntu 1716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/2-services/nfs-ingress.yaml 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280615 4 -rw-r--r-- 1 ubuntu ubuntu 403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/1-start.yaml 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280634 4 -rw-r--r-- 1 ubuntu ubuntu 270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/3-final.yaml 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280613 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke-roleless/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280659 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280664 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/agent 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280665 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/agent/.qa -> ../.qa/ 2024-03-27T21:32:59.831 INFO:teuthology.orchestra.run.smithi063.stdout: 280666 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/agent/off.yaml 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280667 4 -rw-r--r-- 1 ubuntu ubuntu 76 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/agent/on.yaml 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280668 4 -rw-r--r-- 1 ubuntu ubuntu 456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/fixed-2.yaml 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280663 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/0-nvme-loop.yaml -> .qa/overrides/nvme_loop.yaml 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280660 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/% 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280661 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/.qa -> ../.qa/ 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280669 0 lrwxrwxrwx 1 ubuntu ubuntu 16 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/mon_election -> .qa/mon_election 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280662 0 lrwxrwxrwx 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/0-distro -> .qa/distros/supported-container-hosts 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280670 4 -rw-r--r-- 1 ubuntu ubuntu 412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/smoke/start.yaml 2024-03-27T21:32:59.832 INFO:teuthology.orchestra.run.smithi063.stdout: 280570 0 lrwxrwxrwx 1 ubuntu ubuntu 18 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/orch/cephadm/nfs -> .qa/suites/fs/nfs/ 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281983 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281984 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281985 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281986 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/% 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281987 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/.qa -> ../.qa/ 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281992 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/supported-random-distro$ -> .qa/distros/supported-random-distro$ 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281994 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/upgrade 2024-03-27T21:32:59.833 INFO:teuthology.orchestra.run.smithi063.stdout: 281995 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/upgrade/.qa -> ../.qa/ 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281996 4 -rw-r--r-- 1 ubuntu ubuntu 165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/upgrade/primary.yaml 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281997 4 -rw-r--r-- 1 ubuntu ubuntu 182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/upgrade/secondary.yaml 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281988 4 -rw-r--r-- 1 ubuntu ubuntu 152 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/clusters.yaml 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281989 0 lrwxrwxrwx 1 ubuntu ubuntu 27 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/frontend.yaml -> .qa/rgw_frontend/beast.yaml 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281993 4 -rw-r--r-- 1 ubuntu ubuntu 300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/tasks.yaml 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281991 4 -rw-r--r-- 1 ubuntu ubuntu 489 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/realm.yaml 2024-03-27T21:32:59.834 INFO:teuthology.orchestra.run.smithi063.stdout: 281990 4 -rw-r--r-- 1 ubuntu ubuntu 692 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/rgw-multisite-upgrade/pacific-x/overrides.yaml 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280790 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280791 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/.qa -> ../.qa/ 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280792 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280793 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/% 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280799 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/objectstore -> .qa/objectstore 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280794 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/.qa -> ../.qa/ 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280803 0 lrwxrwxrwx 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/supported-distros -> .qa/distros/supported 2024-03-27T21:32:59.835 INFO:teuthology.orchestra.run.smithi063.stdout: 280820 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/thrashosds-health.yaml -> .qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280798 4 -rw-r--r-- 1 ubuntu ubuntu 145 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/ignorelist_health.yaml 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280795 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/clusters 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280796 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280797 4 -rw-r--r-- 1 ubuntu ubuntu 92 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/clusters/3osd-1per-target.yaml 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280804 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280805 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280819 4 -rw-r--r-- 1 ubuntu ubuntu 220 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/snaps-many-objects.yaml 2024-03-27T21:32:59.836 INFO:teuthology.orchestra.run.smithi063.stdout: 280818 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/snaps-few-objects.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280810 4 -rw-r--r-- 1 ubuntu ubuntu 85 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280816 4 -rw-r--r-- 1 ubuntu ubuntu 710 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/radosbench.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280814 4 -rw-r--r-- 1 ubuntu ubuntu 315 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280813 4 -rw-r--r-- 1 ubuntu ubuntu 158 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280811 4 -rw-r--r-- 1 ubuntu ubuntu 96 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280807 4 -rw-r--r-- 1 ubuntu ubuntu 183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280815 4 -rw-r--r-- 1 ubuntu ubuntu 347 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/rados_api_tests.yaml 2024-03-27T21:32:59.837 INFO:teuthology.orchestra.run.smithi063.stdout: 280812 4 -rw-r--r-- 1 ubuntu ubuntu 172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280817 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/readwrite.yaml 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280809 4 -rw-r--r-- 1 ubuntu ubuntu 205 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280808 4 -rw-r--r-- 1 ubuntu ubuntu 90 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280806 4 -rw-r--r-- 1 ubuntu ubuntu 323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280800 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/powercycle 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280801 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/powercycle/.qa -> ../.qa/ 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 280802 4 -rw-r--r-- 1 ubuntu ubuntu 450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/powercycle/osd/powercycle/default.yaml 2024-03-27T21:32:59.838 INFO:teuthology.orchestra.run.smithi063.stdout: 282363 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282364 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/.qa -> ../.qa/ 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282365 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282366 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/% 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282373 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/objectstore 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282374 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/objectstore/.qa -> ../.qa/ 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282375 0 lrwxrwxrwx 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/objectstore/bluestore-bitmap.yaml -> .qa/objectstore_debug/bluestore-bitmap.yaml 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282367 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/.qa -> ../.qa/ 2024-03-27T21:32:59.839 INFO:teuthology.orchestra.run.smithi063.stdout: 282376 0 lrwxrwxrwx 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/supported-random-distro$ -> ../../../distros/supported-random-distro$/ 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282368 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/clusters 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282369 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/clusters/+ 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282370 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282372 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/clusters/openstack.yaml 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282371 0 lrwxrwxrwx 1 ubuntu ubuntu 32 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/clusters/fixed-3-cephfs.yaml -> .qa/clusters/fixed-3-cephfs.yaml 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282377 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282378 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/% 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282379 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.840 INFO:teuthology.orchestra.run.smithi063.stdout: 282381 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282383 4 -rw-r--r-- 1 ubuntu ubuntu 159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/cfuse_workunit_suites_blogbench.yaml 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282392 4 -rw-r--r-- 1 ubuntu ubuntu 841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/mon_thrash.yaml 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282388 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/kclient_workunit_suites_dbench.yaml 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282405 4 -rw-r--r-- 1 ubuntu ubuntu 560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rgw_ec_s3tests.yaml 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282385 4 -rw-r--r-- 1 ubuntu ubuntu 155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/cfuse_workunit_suites_iozone.yaml 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282382 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/.qa -> ../.qa/ 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282399 4 -rw-r--r-- 1 ubuntu ubuntu 212 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_workunit_loadgen_mix.yaml 2024-03-27T21:32:59.841 INFO:teuthology.orchestra.run.smithi063.stdout: 282396 4 -rw-r--r-- 1 ubuntu ubuntu 244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_cls_all.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282404 4 -rw-r--r-- 1 ubuntu ubuntu 301 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rbd_workunit_suites_iozone.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282384 4 -rw-r--r-- 1 ubuntu ubuntu 146 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282386 4 -rw-r--r-- 1 ubuntu ubuntu 310 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/cfuse_workunit_suites_pjd.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282390 4 -rw-r--r-- 1 ubuntu ubuntu 235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/kclient_workunit_suites_pjd.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282394 4 -rw-r--r-- 1 ubuntu ubuntu 999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_bench.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282397 4 -rw-r--r-- 1 ubuntu ubuntu 732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_ec_snaps.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282403 4 -rw-r--r-- 1 ubuntu ubuntu 275 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rbd_python_api_tests.yaml 2024-03-27T21:32:59.842 INFO:teuthology.orchestra.run.smithi063.stdout: 282401 4 -rw-r--r-- 1 ubuntu ubuntu 210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rbd_cli_import_export.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282393 4 -rw-r--r-- 1 ubuntu ubuntu 642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_api_tests.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282395 4 -rw-r--r-- 1 ubuntu ubuntu 1216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_cache_snaps.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282402 4 -rw-r--r-- 1 ubuntu ubuntu 555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rbd_fsx.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282398 4 -rw-r--r-- 1 ubuntu ubuntu 367 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rados_python.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282400 4 -rw-r--r-- 1 ubuntu ubuntu 311 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rbd_api_tests.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282391 4 -rw-r--r-- 1 ubuntu ubuntu 291 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/libcephfs_interface_tests.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282406 4 -rw-r--r-- 1 ubuntu ubuntu 535 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/rgw_s3tests.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282387 4 -rw-r--r-- 1 ubuntu ubuntu 219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/kclient_workunit_direct_io.yaml 2024-03-27T21:32:59.843 INFO:teuthology.orchestra.run.smithi063.stdout: 282389 4 -rw-r--r-- 1 ubuntu ubuntu 240 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/test/kclient_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 282380 4 -rw-r--r-- 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/suites/smoke/basic/tasks/0-install.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278729 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278731 4 -rw-r--r-- 1 ubuntu ubuntu 159 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/2-size-2-min-size.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278735 4 -rw-r--r-- 1 ubuntu ubuntu 64 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/no_client_pidfile.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278730 4 -rw-r--r-- 1 ubuntu ubuntu 113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/2-size-1-min-size.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278732 4 -rw-r--r-- 1 ubuntu ubuntu 141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/3-size-2-min-size.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278736 4 -rw-r--r-- 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/nvme_loop.yaml 2024-03-27T21:32:59.844 INFO:teuthology.orchestra.run.smithi063.stdout: 278737 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/short_pg_log.yaml 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278733 4 -rw-r--r-- 1 ubuntu ubuntu 170 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278734 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/overrides/more-active-recovery.yaml 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278831 4 -rwxr-xr-x 1 ubuntu ubuntu 665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/runallonce.sh 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278701 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/msgr 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278703 4 -rw-r--r-- 1 ubuntu ubuntu 123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/msgr/async-v2only.yaml 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278702 4 -rw-r--r-- 1 ubuntu ubuntu 121 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/msgr/async-v1only.yaml 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278704 4 -rw-r--r-- 1 ubuntu ubuntu 66 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/msgr/async.yaml 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278442 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs 2024-03-27T21:32:59.845 INFO:teuthology.orchestra.run.smithi063.stdout: 278446 4 -rw-r--r-- 1 ubuntu ubuntu 757 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs/create_async_snap.c 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278448 4 -rw-r--r-- 1 ubuntu ubuntu 1373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs/test_rmdir_async_snap.c 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278447 4 -rw-r--r-- 1 ubuntu ubuntu 2148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs/test_async_snap.c 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278445 4 -rw-r--r-- 1 ubuntu ubuntu 919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs/clone_range.c 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278444 4 -rw-r--r-- 1 ubuntu ubuntu 167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs/Makefile 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278443 4 -rw-r--r-- 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/btrfs/.gitignore 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278833 4 -rwxr-xr-x 1 ubuntu ubuntu 129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/runonkclient.sh 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278709 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore 2024-03-27T21:32:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: 278715 4 -rw-r--r-- 1 ubuntu ubuntu 1238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-hybrid.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278716 4 -rw-r--r-- 1 ubuntu ubuntu 807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-low-osd-mem-target.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278712 4 -rw-r--r-- 1 ubuntu ubuntu 778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-comp-snappy.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278713 4 -rw-r--r-- 1 ubuntu ubuntu 776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-comp-zlib.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278710 4 -rw-r--r-- 1 ubuntu ubuntu 1339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278714 4 -rw-r--r-- 1 ubuntu ubuntu 776 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-comp-zstd.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278711 4 -rw-r--r-- 1 ubuntu ubuntu 775 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-comp-lz4.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278717 4 -rw-r--r-- 1 ubuntu ubuntu 1339 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore/bluestore-stupid.yaml 2024-03-27T21:32:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: 278449 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278518 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278532 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/prefetch_entire_dirfrags 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278534 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/prefetch_entire_dirfrags/yes.yaml 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278533 4 -rw-r--r-- 1 ubuntu ubuntu 72 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/prefetch_entire_dirfrags/no.yaml 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278536 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/subvol_versions 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278537 4 -rw-r--r-- 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/subvol_versions/create_subvol_version_v1.yaml 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278538 4 -rw-r--r-- 1 ubuntu ubuntu 34 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/subvol_versions/create_subvol_version_v2.yaml 2024-03-27T21:32:59.848 INFO:teuthology.orchestra.run.smithi063.stdout: 278519 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278535 4 -rw-r--r-- 1 ubuntu ubuntu 58 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/session_timeout.yaml 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278531 4 -rw-r--r-- 1 ubuntu ubuntu 441 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/pg_health.yaml 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278530 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/osd-asserts.yaml 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278528 4 -rw-r--r-- 1 ubuntu ubuntu 436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/ignorelist_health.yaml 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278520 4 -rw-r--r-- 1 ubuntu ubuntu 174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/frag.yaml 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278521 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278523 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse/default-perm 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278524 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse/default-perm/% 2024-03-27T21:32:59.849 INFO:teuthology.orchestra.run.smithi063.stdout: 278525 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse/default-perm/.qa -> ../.qa/ 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278527 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse/default-perm/yes.yaml 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278526 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse/default-perm/no.yaml 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278522 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/fuse/.qa -> ../.qa/ 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278529 4 -rw-r--r-- 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/overrides/ignorelist_wrongly_marked_down.yaml 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278450 0 lrwxrwxrwx 1 ubuntu ubuntu 3 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/.qa -> ../ 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278479 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278480 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/+ 2024-03-27T21:32:59.850 INFO:teuthology.orchestra.run.smithi063.stdout: 278481 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/.qa -> ../.qa/ 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278482 4 -rw-r--r-- 1 ubuntu ubuntu 190 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/client.yaml 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278483 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/mds.yaml 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278485 4 -rw-r--r-- 1 ubuntu ubuntu 178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/mon.yaml 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278486 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/osd.yaml 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278484 4 -rw-r--r-- 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/conf/mgr.yaml 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278487 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278488 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/.qa -> ../.qa/ 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278489 4 -rw-r--r-- 1 ubuntu ubuntu 282 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/fuse.yaml 2024-03-27T21:32:59.851 INFO:teuthology.orchestra.run.smithi063.stdout: 278490 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278498 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278499 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/% 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278500 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/.qa -> ../.qa/ 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278511 4 -rw-r--r-- 1 ubuntu ubuntu 84 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/ms-die-on-skipped.yaml 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278501 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278503 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/stock 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278504 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/stock/% 2024-03-27T21:32:59.852 INFO:teuthology.orchestra.run.smithi063.stdout: 278505 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/stock/.qa -> ../.qa/ 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278507 4 -rw-r--r-- 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/stock/k-stock.yaml 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278506 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/stock/centos_9.stream.yaml -> .qa/distros/all/centos_9.stream.yaml 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278502 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/.qa -> ../.qa/ 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278508 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/testing 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278510 4 -rw-r--r-- 1 ubuntu ubuntu 54 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/testing/k-testing.yaml 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278509 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/overrides/distro/testing/.qa -> ../.qa/ 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278491 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/% 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278492 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/.qa -> ../.qa/ 2024-03-27T21:32:59.853 INFO:teuthology.orchestra.run.smithi063.stdout: 278493 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/mount-syntax 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278495 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/mount-syntax/v1.yaml 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278496 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/mount-syntax/v2.yaml 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278494 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/mount-syntax/$ 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278497 4 -rw-r--r-- 1 ubuntu ubuntu 342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/mount/kclient/mount.yaml 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278512 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/objectstore-ec 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278517 4 -rw-r--r-- 1 ubuntu ubuntu 1250 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/objectstore-ec/bluestore-ec-root.yaml 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278515 4 -rw-r--r-- 1 ubuntu ubuntu 818 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/objectstore-ec/bluestore-comp-ec-root.yaml 2024-03-27T21:32:59.854 INFO:teuthology.orchestra.run.smithi063.stdout: 278513 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/objectstore-ec/.qa -> ../.qa/ 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278514 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/objectstore-ec/bluestore-bitmap.yaml -> ../../objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278516 4 -rw-r--r-- 1 ubuntu ubuntu 724 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/objectstore-ec/bluestore-comp.yaml 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278457 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278475 4 -rw-r--r-- 1 ubuntu ubuntu 267 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a5s-mds-1c-client.yaml 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278460 4 -rw-r--r-- 1 ubuntu ubuntu 167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-1-client-micro.yaml 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278458 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/.qa -> ../.qa/ 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278470 4 -rw-r--r-- 1 ubuntu ubuntu 286 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a2s-mds-1c-client-3node.yaml 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278474 4 -rw-r--r-- 1 ubuntu ubuntu 307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a5s-mds-1c-client-3node.yaml 2024-03-27T21:32:59.855 INFO:teuthology.orchestra.run.smithi063.stdout: 278459 4 -rw-r--r-- 1 ubuntu ubuntu 239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-1-client-coloc.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278468 4 -rw-r--r-- 1 ubuntu ubuntu 157 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-node-1-mds-1-osd.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278465 4 -rw-r--r-- 1 ubuntu ubuntu 268 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-3-client.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278464 4 -rw-r--r-- 1 ubuntu ubuntu 262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-2-client.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278463 4 -rw-r--r-- 1 ubuntu ubuntu 201 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-2-client-micro.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278477 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/9-mds.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278476 4 -rw-r--r-- 1 ubuntu ubuntu 307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/3-mds.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278467 4 -rw-r--r-- 1 ubuntu ubuntu 288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-4-client.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278461 4 -rw-r--r-- 1 ubuntu ubuntu 249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-1-client.yaml 2024-03-27T21:32:59.856 INFO:teuthology.orchestra.run.smithi063.stdout: 278469 4 -rw-r--r-- 1 ubuntu ubuntu 349 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a11s-mds-1c-client-3node.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278466 4 -rw-r--r-- 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-4-client-coloc.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278471 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a3s-mds-1c-client.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278462 4 -rw-r--r-- 1 ubuntu ubuntu 249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1-mds-2-client-coloc.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278472 4 -rw-r--r-- 1 ubuntu ubuntu 263 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a3s-mds-2c-client.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278478 4 -rw-r--r-- 1 ubuntu ubuntu 239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/fixed-2-ucephfs.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278473 4 -rw-r--r-- 1 ubuntu ubuntu 283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/clusters/1a3s-mds-4c-client.yaml 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278451 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/begin 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278452 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/begin/+ 2024-03-27T21:32:59.857 INFO:teuthology.orchestra.run.smithi063.stdout: 278455 4 -rw-r--r-- 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/begin/2-logrotate.yaml 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278454 4 -rw-r--r-- 1 ubuntu ubuntu 90 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/begin/1-ceph.yaml 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278456 4 -rw-r--r-- 1 ubuntu ubuntu 827 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/begin/3-modules.yaml 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278453 4 -rw-r--r-- 1 ubuntu ubuntu 1431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/begin/0-install.yaml 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278547 20 -rwxr-xr-x 1 ubuntu ubuntu 17928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/unshare_ns_mount.sh 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278539 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278541 4 -rw-r--r-- 1 ubuntu ubuntu 141 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278540 0 lrwxrwxrwx 1 ubuntu ubuntu 7 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/.qa -> ../.qa/ 2024-03-27T21:32:59.858 INFO:teuthology.orchestra.run.smithi063.stdout: 278545 4 -rw-r--r-- 1 ubuntu ubuntu 77 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/cfuse_workunit_trivial_sync.yaml 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278544 4 -rw-r--r-- 1 ubuntu ubuntu 88 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278542 4 -rw-r--r-- 1 ubuntu ubuntu 70 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278546 4 -rw-r--r-- 1 ubuntu ubuntu 217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/libcephfs_interface_tests.yaml 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278543 4 -rw-r--r-- 1 ubuntu ubuntu 261 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278821 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_frontend 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278822 4 -rw-r--r-- 1 ubuntu ubuntu 38 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_frontend/beast.yaml 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278434 4 -rw-r--r-- 1 ubuntu ubuntu 227 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/CMakeLists.txt 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278433 0 lrwxrwxrwx 1 ubuntu ubuntu 1 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/.qa -> . 2024-03-27T21:32:59.859 INFO:teuthology.orchestra.run.smithi063.stdout: 278818 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_bucket_sharding 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278820 4 -rw-r--r-- 1 ubuntu ubuntu 91 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_bucket_sharding/single.yaml 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278819 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_bucket_sharding/default.yaml 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278827 4 -rwxr-xr-x 1 ubuntu ubuntu 3517 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/run-standalone.sh 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278675 4 -rwxr-xr-x 1 ubuntu ubuntu 689 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/loopall.sh 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278683 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mgr_ttl_cache 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278685 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mgr_ttl_cache/enable.yaml 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278684 4 -rw-r--r-- 1 ubuntu ubuntu 80 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mgr_ttl_cache/disable.yaml 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278676 4 -rw-r--r-- 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/lsan.supp 2024-03-27T21:32:59.860 INFO:teuthology.orchestra.run.smithi063.stdout: 278686 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278687 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278690 4 -rwxr-xr-x 1 ubuntu ubuntu 1642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/initial_members_asok.sh 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278696 4 -rwxr-xr-x 1 ubuntu ubuntu 482 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/single_host.sh 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278692 4 -rwxr-xr-x 1 ubuntu ubuntu 1495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/simple_expand.sh 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278693 4 -rwxr-xr-x 1 ubuntu ubuntu 1084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/simple_expand_monmap.sh 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278697 4 -rwxr-xr-x 1 ubuntu ubuntu 970 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/single_host_multi.sh 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278695 4 -rwxr-xr-x 1 ubuntu ubuntu 882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/simple_single_expand2.sh 2024-03-27T21:32:59.861 INFO:teuthology.orchestra.run.smithi063.stdout: 278688 4 -rwxr-xr-x 1 ubuntu ubuntu 477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/host.sh 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 278689 4 -rwxr-xr-x 1 ubuntu ubuntu 959 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/initial_members.sh 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 278691 4 -rwxr-xr-x 1 ubuntu ubuntu 863 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/simple.sh 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 278694 4 -rwxr-xr-x 1 ubuntu ubuntu 1193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon/bootstrap/simple_single_expand.sh 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 278436 4 -rw-r--r-- 1 ubuntu ubuntu 2377 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/README 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 278834 4 -rwxr-xr-x 1 ubuntu ubuntu 1640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/setup-chroot.sh 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 278832 4 -rwxr-xr-x 1 ubuntu ubuntu 118 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/runoncfuse.sh 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 282920 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/timezone 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 282922 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/timezone/pacific.yaml 2024-03-27T21:32:59.862 INFO:teuthology.orchestra.run.smithi063.stdout: 282921 4 -rw-r--r-- 1 ubuntu ubuntu 79 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/timezone/eastern.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 282923 4 -rw-r--r-- 1 ubuntu ubuntu 162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/timezone/random.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278801 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278807 4 -rw-r--r-- 1 ubuntu ubuntu 138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/mimic.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278811 4 -rw-r--r-- 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/pacific.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278814 4 -rw-r--r-- 1 ubuntu ubuntu 138 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/squid.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278813 4 -rw-r--r-- 1 ubuntu ubuntu 136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/reef.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278804 4 -rw-r--r-- 1 ubuntu ubuntu 67 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/kraken.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278809 4 -rw-r--r-- 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/octopus.yaml 2024-03-27T21:32:59.863 INFO:teuthology.orchestra.run.smithi063.stdout: 278812 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/quincy.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278806 4 -rw-r--r-- 1 ubuntu ubuntu 538 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/luminous.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278803 4 -rw-r--r-- 1 ubuntu ubuntu 188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/jewel.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278805 4 -rw-r--r-- 1 ubuntu ubuntu 238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/luminous-with-mgr.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278810 4 -rw-r--r-- 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/pacific-from-o.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278808 4 -rw-r--r-- 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/nautilus.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278802 4 -rw-r--r-- 1 ubuntu ubuntu 148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/releases/infernalis.yaml 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278706 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/nightlies 2024-03-27T21:32:59.864 INFO:teuthology.orchestra.run.smithi063.stdout: 278707 4 -rwxr-xr-x 1 ubuntu ubuntu 439 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/nightlies/cron_wrapper 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278708 4 -rwxr-xr-x 1 ubuntu ubuntu 295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/nightlies/schedule_subset.sh 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278565 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/debug 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278570 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/debug/openstack-30G.yaml 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278566 4 -rw-r--r-- 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/debug/buildpackages.yaml 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278567 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/debug/mds_client.yaml 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278568 4 -rw-r--r-- 1 ubuntu ubuntu 290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/debug/mgr.yaml 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278569 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/debug/openstack-15G.yaml 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278815 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw 2024-03-27T21:32:59.865 INFO:teuthology.orchestra.run.smithi063.stdout: 278817 4 -rw-r--r-- 1 ubuntu ubuntu 95 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw/s3tests-branch.yaml 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278816 4 -rw-r--r-- 1 ubuntu ubuntu 316 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw/ignore-pg-availability.yaml 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278705 4 -rw-r--r-- 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mypy.ini 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 282924 4 -rw-r--r-- 1 ubuntu ubuntu 939 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tox.ini 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278823 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_pool_type 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278824 4 -rw-r--r-- 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_pool_type/ec-profile.yaml 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278826 4 -rw-r--r-- 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_pool_type/replicated.yaml 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278825 4 -rw-r--r-- 1 ubuntu ubuntu 75 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rgw_pool_type/ec.yaml 2024-03-27T21:32:59.866 INFO:teuthology.orchestra.run.smithi063.stdout: 278830 4 -rw-r--r-- 1 ubuntu ubuntu 1050 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/run_xfstests_qemu.sh 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 282925 16 -rw-r--r-- 1 ubuntu ubuntu 13176 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/valgrind.supp 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278552 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278558 4 -rw-r--r-- 1 ubuntu ubuntu 278 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/fixed-3.yaml 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278555 4 -rw-r--r-- 1 ubuntu ubuntu 321 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/fixed-1.yaml 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278556 4 -rw-r--r-- 1 ubuntu ubuntu 333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/fixed-2.yaml 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278554 4 -rw-r--r-- 1 ubuntu ubuntu 276 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/extra-client.yaml 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278553 4 -rw-r--r-- 1 ubuntu ubuntu 255 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/2-node-mgr.yaml 2024-03-27T21:32:59.867 INFO:teuthology.orchestra.run.smithi063.stdout: 278557 4 -rw-r--r-- 1 ubuntu ubuntu 308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/fixed-3-cephfs.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278559 4 -rw-r--r-- 1 ubuntu ubuntu 345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/clusters/fixed-4.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278571 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278573 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278603 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_6.3.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278600 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/opensuse_15.1.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278585 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.yaml -> centos_7.6.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278610 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_7.7.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278605 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_6.5.yaml 2024-03-27T21:32:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 278608 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_7.5.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278628 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_16.04.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278578 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.0.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278619 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/sle_12.2.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278616 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.5.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278581 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.3.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278618 0 lrwxrwxrwx 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.yaml -> rhel_8.6.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278622 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/sle_15.2.yaml 2024-03-27T21:32:59.869 INFO:teuthology.orchestra.run.smithi063.stdout: 278612 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.0.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278611 0 lrwxrwxrwx 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_7.yaml -> rhel_7.7.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278632 0 lrwxrwxrwx 1 ubuntu ubuntu 17 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_latest.yaml -> ubuntu_22.04.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278594 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/debian_6.0.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278595 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/debian_7.0.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278598 4 -rw-r--r-- 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/fedora_18.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278601 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/opensuse_15.2.yaml 2024-03-27T21:32:59.870 INFO:teuthology.orchestra.run.smithi063.stdout: 278583 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.5.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278626 4 -rw-r--r-- 1 ubuntu ubuntu 64 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_14.04_aarch64.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278604 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_6.4.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278587 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_8.1.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278574 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278588 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_8.2.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278623 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_12.04.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278629 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_18.04.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278592 4 -rw-r--r-- 1 ubuntu ubuntu 122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_9.stream.yaml 2024-03-27T21:32:59.871 INFO:teuthology.orchestra.run.smithi063.stdout: 278599 4 -rw-r--r-- 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/fedora_19.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278586 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_8.0.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278575 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_6.3.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278579 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.1.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278576 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_6.4.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278627 4 -rw-r--r-- 1 ubuntu ubuntu 61 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_14.04_i686.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278602 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/opensuse_42.3.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278620 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/sle_12.3.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278617 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.6.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278593 0 lrwxrwxrwx 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_latest.yaml -> centos_9.stream.yaml 2024-03-27T21:32:59.872 INFO:teuthology.orchestra.run.smithi063.stdout: 278580 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.2.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278606 0 lrwxrwxrwx 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_6.yaml -> rhel_6.5.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278591 0 lrwxrwxrwx 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_8.yaml -> centos_8.stream.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278630 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_20.04.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278609 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_7.6.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278607 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_7.0.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278625 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_14.04.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278590 4 -rw-r--r-- 1 ubuntu ubuntu 140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_8.stream.yaml 2024-03-27T21:32:59.873 INFO:teuthology.orchestra.run.smithi063.stdout: 278584 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.6.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278624 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_12.10.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278613 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.1.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278621 4 -rw-r--r-- 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/sle_15.1.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278577 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_6.5.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278597 4 -rw-r--r-- 1 ubuntu ubuntu 47 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/fedora_17.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278589 4 -rw-r--r-- 1 ubuntu ubuntu 135 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_8.3.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278596 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/debian_8.0.yaml 2024-03-27T21:32:59.874 INFO:teuthology.orchestra.run.smithi063.stdout: 278631 4 -rw-r--r-- 1 ubuntu ubuntu 50 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/ubuntu_22.04.yaml 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278614 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.3.yaml 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278582 4 -rw-r--r-- 1 ubuntu ubuntu 48 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/centos_7.4.yaml 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278615 4 -rw-r--r-- 1 ubuntu ubuntu 133 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/all/rhel_8.4.yaml 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/crimson-supported-all-distro 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278641 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/crimson-supported-all-distro/centos_latest.yaml -> ../all/centos_latest.yaml 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278572 0 lrwxrwxrwx 1 ubuntu ubuntu 2 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/.qa -> .. 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278638 4 -rw-r--r-- 1 ubuntu ubuntu 378 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts/centos_9.stream_runc.yaml 2024-03-27T21:32:59.875 INFO:teuthology.orchestra.run.smithi063.stdout: 278634 0 lrwxrwxrwx 1 ubuntu ubuntu 6 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts/.qa -> ../.qa 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278636 4 -rw-r--r-- 1 ubuntu ubuntu 638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts/centos_8.stream_container_tools_crun.yaml 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278635 4 -rw-r--r-- 1 ubuntu ubuntu 444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts/centos_8.stream_container_tools.yaml 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278637 4 -rw-r--r-- 1 ubuntu ubuntu 127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts/centos_9.stream.yaml 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278639 0 lrwxrwxrwx 1 ubuntu ubuntu 33 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/container-hosts/ubuntu_22.04.yaml -> .qa/distros/all/ubuntu_22.04.yaml 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278654 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278656 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported/ubuntu_latest.yaml -> ../all/ubuntu_latest.yaml 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278655 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported/centos_latest.yaml -> ../all/centos_latest.yaml 2024-03-27T21:32:59.876 INFO:teuthology.orchestra.run.smithi063.stdout: 278650 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-random-distro$ 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278653 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-random-distro$/ubuntu_latest.yaml -> ../all/ubuntu_latest.yaml 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278652 0 lrwxrwxrwx 1 ubuntu ubuntu 25 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-random-distro$/centos_latest.yaml -> ../all/centos_latest.yaml 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278651 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-random-distro$/$ 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/podman 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278643 4 -rw-r--r-- 1 ubuntu ubuntu 444 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/podman/centos_8.stream_container_tools.yaml 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278644 4 -rw-r--r-- 1 ubuntu ubuntu 172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/podman/centos_9.stream.yaml 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278645 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/single-container-host.yaml -> container-hosts/centos_9.stream.yaml 2024-03-27T21:32:59.877 INFO:teuthology.orchestra.run.smithi063.stdout: 278646 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-container-hosts 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278648 0 lrwxrwxrwx 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-container-hosts/centos_9.stream_runc.yaml -> ../container-hosts/centos_9.stream_runc.yaml 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278647 0 lrwxrwxrwx 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-container-hosts/centos_9.stream.yaml -> ../container-hosts/centos_9.stream.yaml 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278649 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/distros/supported-container-hosts/ubuntu_22.04.yaml -> ../container-hosts/ubuntu_22.04.yaml 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278435 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/Makefile 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 282919 4 -rw-r--r-- 1 ubuntu ubuntu 1001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/test_import.py 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278835 4 drwxr-xr-x 13 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278878 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill 2024-03-27T21:32:59.878 INFO:teuthology.orchestra.run.smithi063.stdout: 278880 4 -rwxr-xr-x 1 ubuntu ubuntu 3941 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-recovery-log.sh 2024-03-27T21:32:59.879 INFO:teuthology.orchestra.run.smithi063.stdout: 278881 32 -rwxr-xr-x 1 ubuntu ubuntu 31780 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-space.sh 2024-03-27T21:32:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: 278879 16 -rwxr-xr-x 1 ubuntu ubuntu 15875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-prio.sh 2024-03-27T21:32:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: 278882 28 -rwxr-xr-x 1 ubuntu ubuntu 26343 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd-backfill/osd-backfill-stats.sh 2024-03-27T21:32:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: 278847 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr 2024-03-27T21:32:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: 278848 8 -rwxr-xr-x 1 ubuntu ubuntu 7323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mgr/balancer.sh 2024-03-27T21:32:59.882 INFO:teuthology.orchestra.run.smithi063.stdout: 278849 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278851 8 -rwxr-xr-x 1 ubuntu ubuntu 6542 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/network-ping.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278852 12 -rwxr-xr-x 1 ubuntu ubuntu 8982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ok-to-stop.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278853 8 -rwxr-xr-x 1 ubuntu ubuntu 4113 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/rados-striper.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278850 20 -rwxr-xr-x 1 ubuntu ubuntu 18490 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/mclock-config.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278854 4 -rwxr-xr-x 1 ubuntu ubuntu 821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-ceph-helpers.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278855 8 -rwxr-xr-x 1 ubuntu ubuntu 5635 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/test-snaptrim-stats.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278856 12 -rwxr-xr-x 1 ubuntu ubuntu 9707 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/misc/ver-health.sh 2024-03-27T21:32:59.883 INFO:teuthology.orchestra.run.smithi063.stdout: 278840 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278841 8 -rwxr-xr-x 1 ubuntu ubuntu 7592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-choose-args.sh 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278842 12 -rwxr-xr-x 1 ubuntu ubuntu 9876 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/crush/crush-classes.sh 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278860 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278863 8 -rwxr-xr-x 1 ubuntu ubuntu 4454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mkfs.sh 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278866 4 -rwxr-xr-x 1 ubuntu ubuntu 2612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-handle-forward.sh 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278874 8 -rwxr-xr-x 1 ubuntu ubuntu 7883 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-erasure-code-profile.sh 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278872 8 -rwxr-xr-x 1 ubuntu ubuntu 6754 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-crush.sh 2024-03-27T21:32:59.884 INFO:teuthology.orchestra.run.smithi063.stdout: 278864 8 -rwxr-xr-x 1 ubuntu ubuntu 5024 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278869 4 -rwxr-xr-x 1 ubuntu ubuntu 1270 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-ping.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278871 4 -rwxr-xr-x 1 ubuntu ubuntu 2144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-seesaw.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278861 4 -rwxr-xr-x 1 ubuntu ubuntu 3385 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/health-mute.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278862 16 -rwxr-xr-x 1 ubuntu ubuntu 12753 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278876 4 -rwxr-xr-x 1 ubuntu ubuntu 2547 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-df.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278867 8 -rwxr-xr-x 1 ubuntu ubuntu 7527 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-last-epoch-clean.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278875 12 -rwxr-xr-x 1 ubuntu ubuntu 10501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-pool-create.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278877 4 -rwxr-xr-x 1 ubuntu ubuntu 1496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/test_pool_quota.sh 2024-03-27T21:32:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: 278870 4 -rwxr-xr-x 1 ubuntu ubuntu 1398 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-scrub.sh 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278868 4 -rwxr-xr-x 1 ubuntu ubuntu 1440 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-osdmap-prune.sh 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278873 8 -rwxr-xr-x 1 ubuntu ubuntu 4107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/osd-df.sh 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278865 4 -rwxr-xr-x 1 ubuntu ubuntu 1548 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-created-time.sh 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278836 4 -rw-r--r-- 1 ubuntu ubuntu 840 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/README 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278839 72 -rwxr-xr-x 1 ubuntu ubuntu 73624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278883 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278902 4 -rwxr-xr-x 1 ubuntu ubuntu 3773 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/repeer-on-acting-back.sh 2024-03-27T21:32:59.886 INFO:teuthology.orchestra.run.smithi063.stdout: 278887 4 -rwxr-xr-x 1 ubuntu ubuntu 3021 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278889 4 -rwxr-xr-x 1 ubuntu ubuntu 3502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-config.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278895 4 -rwxr-xr-x 1 ubuntu ubuntu 1537 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-reactivate.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278892 4 -rwxr-xr-x 1 ubuntu ubuntu 3114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-fast-mark-down.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278898 16 -rwxr-xr-x 1 ubuntu ubuntu 16055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-stats.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278903 8 -rwxr-xr-x 1 ubuntu ubuntu 6109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/repro_long_log.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278891 4 -rwxr-xr-x 1 ubuntu ubuntu 845 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-dup.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278897 8 -rwxr-xr-x 1 ubuntu ubuntu 4533 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-space.sh 2024-03-27T21:32:59.887 INFO:teuthology.orchestra.run.smithi063.stdout: 278899 12 -rwxr-xr-x 1 ubuntu ubuntu 12222 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-rep-recov-eio.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278894 8 -rwxr-xr-x 1 ubuntu ubuntu 4487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-markdown.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278896 16 -rwxr-xr-x 1 ubuntu ubuntu 16123 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278893 4 -rwxr-xr-x 1 ubuntu ubuntu 1599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-force-create-pg.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278884 4 -rwxr-xr-x 1 ubuntu ubuntu 1360 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278886 4 -rwxr-xr-x 1 ubuntu ubuntu 1612 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278901 8 -rwxr-xr-x 1 ubuntu ubuntu 6885 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/pg-split-merge.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278888 16 -rwxr-xr-x 1 ubuntu ubuntu 16101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2024-03-27T21:32:59.888 INFO:teuthology.orchestra.run.smithi063.stdout: 278885 24 -rwxr-xr-x 1 ubuntu ubuntu 23442 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278900 4 -rwxr-xr-x 1 ubuntu ubuntu 1581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-reuse-id.sh 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278890 4 -rwxr-xr-x 1 ubuntu ubuntu 1940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-copy-from.sh 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278837 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/c2c 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278838 4 -rwxr-xr-x 1 ubuntu ubuntu 3139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/c2c/c2c.sh 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278904 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278906 12 -rwxr-xr-x 1 ubuntu ubuntu 10421 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-recovery-scrub.sh 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278910 24 -rwxr-xr-x 1 ubuntu ubuntu 22553 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh 2024-03-27T21:32:59.889 INFO:teuthology.orchestra.run.smithi063.stdout: 278912 12 -rw-r--r-- 1 ubuntu ubuntu 10580 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/scrub-helpers.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278905 8 -rwxr-xr-x 1 ubuntu ubuntu 6662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-mapper.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278909 36 -rwxr-xr-x 1 ubuntu ubuntu 33715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278908 172 -rwxr-xr-x 1 ubuntu ubuntu 173409 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278911 4 -rwxr-xr-x 1 ubuntu ubuntu 2466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-unexpected-clone.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278907 8 -rwxr-xr-x 1 ubuntu ubuntu 5100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-dump.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278843 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278844 8 -rwxr-xr-x 1 ubuntu ubuntu 4144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code-plugins.sh 2024-03-27T21:32:59.890 INFO:teuthology.orchestra.run.smithi063.stdout: 278845 12 -rwxr-xr-x 1 ubuntu ubuntu 10393 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-code.sh 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278846 20 -rwxr-xr-x 1 ubuntu ubuntu 19747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/erasure-code/test-erasure-eio.sh 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278913 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/special 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278914 92 -rwxr-xr-x 1 ubuntu ubuntu 92636 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/special/ceph_objectstore_tool.py 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278915 4 -rwxr-xr-x 1 ubuntu ubuntu 880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/special/test-failure.sh 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278857 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon-stretch 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278858 8 -rwxr-xr-x 1 ubuntu ubuntu 4639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon-stretch/mon-stretch-fail-recovery.sh 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278859 8 -rwxr-xr-x 1 ubuntu ubuntu 4966 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon-stretch/mon-stretch-uneven-crush-weights.sh 2024-03-27T21:32:59.891 INFO:teuthology.orchestra.run.smithi063.stdout: 278829 8 -rwxr-xr-x 1 ubuntu ubuntu 8000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/run_xfstests.sh 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278738 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/packages 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278739 4 -rw-r--r-- 1 ubuntu ubuntu 1558 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/packages/packages.yaml 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278740 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278741 4 -rwxr-xr-x 1 ubuntu ubuntu 991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/cephscrub.sh 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278742 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278744 4 -rwxr-xr-x 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install.sh 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278768 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/files 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278770 56 -rw-r--r-- 1 ubuntu ubuntu 55353 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/files/glance-api.template.conf 2024-03-27T21:32:59.892 INFO:teuthology.orchestra.run.smithi063.stdout: 278769 120 -rw-r--r-- 1 ubuntu ubuntu 121456 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/files/cinder.template.conf 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278771 40 -rw-r--r-- 1 ubuntu ubuntu 39814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/files/kilo.template.conf 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278772 120 -rw-r--r-- 1 ubuntu ubuntu 122641 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/files/nova.template.conf 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278760 4 -rwxr-xr-x 1 ubuntu ubuntu 731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/copy_func.sh 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278759 4 -rwxr-xr-x 1 ubuntu ubuntu 2662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/connectceph.sh 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278743 4 -rw-r--r-- 1 ubuntu ubuntu 1561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/README 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278773 4 -rwxr-xr-x 1 ubuntu ubuntu 999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/fix_conf_file.sh 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278745 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278747 4 -rwxr-xr-x 1 ubuntu ubuntu 1184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/ceph_install.sh 2024-03-27T21:32:59.893 INFO:teuthology.orchestra.run.smithi063.stdout: 278756 4 -rwxr-xr-x 1 ubuntu ubuntu 760 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/repolocs.sh 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278749 0 lrwxrwxrwx 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/copy_func.sh -> ../copy_func.sh 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278746 4 -rw-r--r-- 1 ubuntu ubuntu 1346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/README 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278755 4 -rwxr-xr-x 1 ubuntu ubuntu 388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/multi_action.sh 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278758 4 -rwxr-xr-x 1 ubuntu ubuntu 884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/talknice.sh 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278757 4 -rwxr-xr-x 1 ubuntu ubuntu 277 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/staller.sh 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278750 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/execs 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278752 4 -rwxr-xr-x 1 ubuntu ubuntu 1464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/execs/ceph_ansible.sh 2024-03-27T21:32:59.894 INFO:teuthology.orchestra.run.smithi063.stdout: 278754 4 -rwxr-xr-x 1 ubuntu ubuntu 142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/execs/edit_groupvars_osds.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278753 4 -rwxr-xr-x 1 ubuntu ubuntu 101 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/execs/edit_ansible_hosts.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278751 4 -rwxr-xr-x 1 ubuntu ubuntu 708 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/execs/cdn_setup.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278748 4 -rw-r--r-- 1 ubuntu ubuntu 203 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/ceph_install_w_ansible/config 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278774 4 -rwxr-xr-x 1 ubuntu ubuntu 491 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/image_create.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278775 4 -rwxr-xr-x 1 ubuntu ubuntu 763 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/openstack.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278761 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278763 4 -rwxr-xr-x 1 ubuntu ubuntu 1092 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs/ceph_cluster.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278764 4 -rwxr-xr-x 1 ubuntu ubuntu 422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs/libvirt-secret.sh 2024-03-27T21:32:59.895 INFO:teuthology.orchestra.run.smithi063.stdout: 278766 4 -rwxr-xr-x 1 ubuntu ubuntu 986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs/run_openstack.sh 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278765 4 -rwxr-xr-x 1 ubuntu ubuntu 554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs/openstack-preinstall.sh 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278767 4 -rwxr-xr-x 1 ubuntu ubuntu 415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs/start_openstack.sh 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278762 4 -rwxr-xr-x 1 ubuntu ubuntu 699 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/execs/ceph-pool-create.sh 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278776 4 -rwxr-xr-x 1 ubuntu ubuntu 604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/qa_scripts/openstack/packstack.sh 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278672 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/libceph 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278674 4 -rw-r--r-- 1 ubuntu ubuntu 1709 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/libceph/trivial_libceph.c 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278673 4 -rw-r--r-- 1 ubuntu ubuntu 165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/libceph/Makefile 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278777 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd 2024-03-27T21:32:59.896 INFO:teuthology.orchestra.run.smithi063.stdout: 278787 12 -rw-r--r-- 1 ubuntu ubuntu 8495 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_deep_flatten.t 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278792 4 -rw-r--r-- 1 ubuntu ubuntu 901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_discard_granularity.t 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278793 4 -rw-r--r-- 1 ubuntu ubuntu 878 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_get_features.t 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278799 12 -rw-r--r-- 1 ubuntu ubuntu 10290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_zeroout.t 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278779 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/conf 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278780 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/conf/+ 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278781 4 -rw-r--r-- 1 ubuntu ubuntu 82 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/conf/disable-pool-app.yaml 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278778 4 -rw-r--r-- 1 ubuntu ubuntu 2161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/common.sh 2024-03-27T21:32:59.897 INFO:teuthology.orchestra.run.smithi063.stdout: 278794 4 -rw-r--r-- 1 ubuntu ubuntu 1328 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_huge_image.t 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278797 4 -rw-r--r-- 1 ubuntu ubuntu 1968 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_parent_overlap.t 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278791 12 -rw-r--r-- 1 ubuntu ubuntu 10162 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_discard_512b.t 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278798 4 -rw-r--r-- 1 ubuntu ubuntu 3645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_whole_object_zeroout.t 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278796 4 -rw-r--r-- 1 ubuntu ubuntu 2630 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_msgr_segments.t 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278789 12 -rw-r--r-- 1 ubuntu ubuntu 11011 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_discard.t 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278782 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/data-pool 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278785 4 -rw-r--r-- 1 ubuntu ubuntu 189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/data-pool/replicated.yaml 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278784 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/data-pool/none.yaml 2024-03-27T21:32:59.898 INFO:teuthology.orchestra.run.smithi063.stdout: 278783 4 -rw-r--r-- 1 ubuntu ubuntu 873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/data-pool/ec.yaml 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278795 4 -rw-r--r-- 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_modprobe.t 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278800 4 -rwxr-xr-x 1 ubuntu ubuntu 676 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/rbd.sh 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278790 12 -rw-r--r-- 1 ubuntu ubuntu 9307 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_discard_4M.t 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278786 12 -rw-r--r-- 1 ubuntu ubuntu 9994 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_blkroset.t 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278788 4 -rw-r--r-- 1 ubuntu ubuntu 2166 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/rbd/krbd_default_map_options.t 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278680 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mds 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278682 4 -rwxr-xr-x 1 ubuntu ubuntu 370 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mds/test_mdstable_failures.sh 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278681 4 -rwxr-xr-x 1 ubuntu ubuntu 506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mds/test_anchortable.sh 2024-03-27T21:32:59.899 INFO:teuthology.orchestra.run.smithi063.stdout: 278548 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/client 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 278550 4 -rw-r--r-- 1 ubuntu ubuntu 873 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/client/common.sh 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 278551 48 -rw-r--r-- 1 ubuntu ubuntu 45147 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/client/gen-1774.sh 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 278549 4 -rwxr-xr-x 1 ubuntu ubuntu 381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/client/30_subdir_mount.sh 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 282667 4 drwxr-xr-x 7 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 282673 20 -rw-r--r-- 1 ubuntu ubuntu 19447 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/barbican.py 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 282773 4 -rw-r--r-- 1 ubuntu ubuntu 2473 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/immutable_object_cache_thrash.py 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 282782 12 -rw-r--r-- 1 ubuntu ubuntu 8809 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/lua_tests.py 2024-03-27T21:32:59.900 INFO:teuthology.orchestra.run.smithi063.stdout: 282878 8 -rw-r--r-- 1 ubuntu ubuntu 4238 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw_multisite_tests.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282853 28 -rw-r--r-- 1 ubuntu ubuntu 26167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/qemu.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282901 4 -rw-r--r-- 1 ubuntu ubuntu 1662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tox.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282689 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephadm_cases 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282692 4 -rw-r--r-- 1 ubuntu ubuntu 2509 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephadm_cases/test_cli_mon.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282691 4 -rw-r--r-- 1 ubuntu ubuntu 2465 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephadm_cases/test_cli.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282690 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephadm_cases/__init__.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282763 8 -rw-r--r-- 1 ubuntu ubuntu 4925 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/divergent_priors.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282765 8 -rw-r--r-- 1 ubuntu ubuntu 5995 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/dnsmasq.py 2024-03-27T21:32:59.901 INFO:teuthology.orchestra.run.smithi063.stdout: 282775 8 -rw-r--r-- 1 ubuntu ubuntu 4672 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/kclient.py 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282869 8 -rw-r--r-- 1 ubuntu ubuntu 5837 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rep_lost_unfound_delete.py 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282788 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282826 8 -rw-r--r-- 1 ubuntu ubuntu 6107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_failover.py 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282827 8 -rw-r--r-- 1 ubuntu ubuntu 6853 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_insights.py 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282821 4 -rw-r--r-- 1 ubuntu ubuntu 2474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_cache.py 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282831 4 -rw-r--r-- 1 ubuntu ubuntu 2507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_prometheus.py 2024-03-27T21:32:59.902 INFO:teuthology.orchestra.run.smithi063.stdout: 282830 16 -rw-r--r-- 1 ubuntu ubuntu 14713 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_progress.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282790 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282816 4 -rw-r--r-- 1 ubuntu ubuntu 2000 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_settings.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282810 20 -rw-r--r-- 1 ubuntu ubuntu 17214 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_pool.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282800 4 -rw-r--r-- 1 ubuntu ubuntu 1306 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_feedback.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282813 4 -rw-r--r-- 1 ubuntu ubuntu 1154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_requests.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282808 16 -rw-r--r-- 1 ubuntu ubuntu 13727 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_osd.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282797 16 -rw-r--r-- 1 ubuntu ubuntu 15716 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_cluster_configuration.py 2024-03-27T21:32:59.903 INFO:teuthology.orchestra.run.smithi063.stdout: 282814 32 -rw-r--r-- 1 ubuntu ubuntu 31731 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_rgw.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282795 12 -rw-r--r-- 1 ubuntu ubuntu 12245 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_cephfs.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282804 8 -rw-r--r-- 1 ubuntu ubuntu 5697 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_mgr_module.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282803 4 -rw-r--r-- 1 ubuntu ubuntu 922 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_logs.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282819 24 -rw-r--r-- 1 ubuntu ubuntu 22020 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_user.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282815 8 -rw-r--r-- 1 ubuntu ubuntu 5072 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_role.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282806 4 -rw-r--r-- 1 ubuntu ubuntu 1041 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_motd.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282794 16 -rw-r--r-- 1 ubuntu ubuntu 14445 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_auth.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282817 4 -rw-r--r-- 1 ubuntu ubuntu 1428 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_summary.py 2024-03-27T21:32:59.904 INFO:teuthology.orchestra.run.smithi063.stdout: 282801 12 -rw-r--r-- 1 ubuntu ubuntu 11280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_health.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282791 4 -rw-r--r-- 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/__init__.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282792 28 -rw-r--r-- 1 ubuntu ubuntu 25696 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/helper.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282802 8 -rw-r--r-- 1 ubuntu ubuntu 6190 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_host.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282807 4 -rw-r--r-- 1 ubuntu ubuntu 702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_orchestrator.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282818 4 -rw-r--r-- 1 ubuntu ubuntu 2880 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_telemetry.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282798 4 -rw-r--r-- 1 ubuntu ubuntu 2801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_crush_rule.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282793 4 -rw-r--r-- 1 ubuntu ubuntu 561 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_api.py 2024-03-27T21:32:59.905 INFO:teuthology.orchestra.run.smithi063.stdout: 282805 4 -rw-r--r-- 1 ubuntu ubuntu 729 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_monitor.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282799 4 -rw-r--r-- 1 ubuntu ubuntu 3390 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_erasure_code_profile.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282812 8 -rw-r--r-- 1 ubuntu ubuntu 6472 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_rbd_mirroring.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282811 40 -rw-r--r-- 1 ubuntu ubuntu 40160 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_rbd.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282809 4 -rw-r--r-- 1 ubuntu ubuntu 2785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_perf_counters.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282796 4 -rw-r--r-- 1 ubuntu ubuntu 686 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/dashboard/test_cluster.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282829 12 -rw-r--r-- 1 ubuntu ubuntu 8477 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_orchestrator_cli.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282825 4 -rw-r--r-- 1 ubuntu ubuntu 1266 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_devicehealth.py 2024-03-27T21:32:59.906 INFO:teuthology.orchestra.run.smithi063.stdout: 282824 8 -rw-r--r-- 1 ubuntu ubuntu 7149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_dashboard.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282822 4 -rw-r--r-- 1 ubuntu ubuntu 1073 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_cli.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282789 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/__init__.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282820 12 -rw-r--r-- 1 ubuntu ubuntu 8728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/mgr_test_case.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282828 12 -rw-r--r-- 1 ubuntu ubuntu 9787 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_module_selftest.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282823 4 -rw-r--r-- 1 ubuntu ubuntu 3380 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mgr/test_crash.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282770 8 -rw-r--r-- 1 ubuntu ubuntu 6260 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/fs.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282867 12 -rw-r--r-- 1 ubuntu ubuntu 8550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rebuild_mondb.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282914 8 -rw-r--r-- 1 ubuntu ubuntu 7359 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/vip.py 2024-03-27T21:32:59.907 INFO:teuthology.orchestra.run.smithi063.stdout: 282888 12 -rw-r--r-- 1 ubuntu ubuntu 8991 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tempest.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282895 4 -rw-r--r-- 1 ubuntu ubuntu 355 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/teuthology_integration.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282874 8 -rw-r--r-- 1 ubuntu ubuntu 4733 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw_logsocket.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282889 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tests 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282891 4 -rw-r--r-- 1 ubuntu ubuntu 371 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tests/conftest.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282892 4 -rw-r--r-- 1 ubuntu ubuntu 2096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tests/test_devstack.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282894 4 -rw-r--r-- 1 ubuntu ubuntu 1663 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tests/test_radosgw_admin.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282890 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tests/__init__.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282893 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tests/test_import_yaml.py 2024-03-27T21:32:59.908 INFO:teuthology.orchestra.run.smithi063.stdout: 282861 28 -rw-r--r-- 1 ubuntu ubuntu 25715 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rbd.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282900 12 -rw-r--r-- 1 ubuntu ubuntu 8763 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/thrashosds.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282862 12 -rw-r--r-- 1 ubuntu ubuntu 9543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rbd_fio.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282672 8 -rw-r--r-- 1 ubuntu ubuntu 6634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/backfill_toofull.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282780 4 -rw-r--r-- 1 ubuntu ubuntu 223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/logrotate.conf 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282693 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282704 84 -rw-r--r-- 1 ubuntu ubuntu 84154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_admin.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282715 36 -rw-r--r-- 1 ubuntu ubuntu 34747 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_failover.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282731 4 -rw-r--r-- 1 ubuntu ubuntu 651 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_newops.py 2024-03-27T21:32:59.909 INFO:teuthology.orchestra.run.smithi063.stdout: 282703 4 -rw-r--r-- 1 ubuntu ubuntu 1502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_acls.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282738 4 -rw-r--r-- 1 ubuntu ubuntu 1483 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_recovery_fs.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282723 20 -rw-r--r-- 1 ubuntu ubuntu 16591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_journal_repair.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282721 20 -rw-r--r-- 1 ubuntu ubuntu 16812 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_full.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282708 48 -rw-r--r-- 1 ubuntu ubuntu 45543 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_cephfs_shell.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282720 4 -rw-r--r-- 1 ubuntu ubuntu 3807 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_fstop.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282730 12 -rw-r--r-- 1 ubuntu ubuntu 8588 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_multimds_misc.py 2024-03-27T21:32:59.910 INFO:teuthology.orchestra.run.smithi063.stdout: 282717 20 -rw-r--r-- 1 ubuntu ubuntu 20469 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_forward_scrub.py 2024-03-27T21:32:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: 282728 28 -rw-r--r-- 1 ubuntu ubuntu 26790 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_misc.py 2024-03-27T21:32:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: 282713 4 -rw-r--r-- 1 ubuntu ubuntu 2364 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_dump_tree.py 2024-03-27T21:32:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: 282739 8 -rw-r--r-- 1 ubuntu ubuntu 7029 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_recovery_pool.py 2024-03-27T21:32:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: 282695 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/admin 2024-03-27T21:32:59.913 INFO:teuthology.orchestra.run.smithi063.stdout: 282696 36 -rw-r--r-- 1 ubuntu ubuntu 32771 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/admin/test_fs_swap.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282734 4 -rw-r--r-- 1 ubuntu ubuntu 4005 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_pool_perm.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282710 32 -rw-r--r-- 1 ubuntu ubuntu 32150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_client_recovery.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282742 12 -rw-r--r-- 1 ubuntu ubuntu 9335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_sessionmap.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282746 8 -rw-r--r-- 1 ubuntu ubuntu 6671 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_subvolume.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282699 68 -rw-r--r-- 1 ubuntu ubuntu 67381 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/filesystem.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282736 8 -rw-r--r-- 1 ubuntu ubuntu 6308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_quota.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282702 60 -rw-r--r-- 1 ubuntu ubuntu 59140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/mount.py 2024-03-27T21:32:59.914 INFO:teuthology.orchestra.run.smithi063.stdout: 282740 8 -rw-r--r-- 1 ubuntu ubuntu 6745 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_scrub.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282700 20 -rw-r--r-- 1 ubuntu ubuntu 19666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/fuse_mount.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282707 4 -rw-r--r-- 1 ubuntu ubuntu 2130 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_cap_flush.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282719 4 -rw-r--r-- 1 ubuntu ubuntu 2796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_fscrypt.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282725 28 -rw-r--r-- 1 ubuntu ubuntu 24654 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_mds_metrics.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282716 8 -rw-r--r-- 1 ubuntu ubuntu 5001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_flush.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282732 52 -rw-r--r-- 1 ubuntu ubuntu 52090 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_nfs.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282726 4 -rw-r--r-- 1 ubuntu ubuntu 2013 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_meta_injection.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282705 4 -rw-r--r-- 1 ubuntu ubuntu 2592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_auto_repair.py 2024-03-27T21:32:59.915 INFO:teuthology.orchestra.run.smithi063.stdout: 282694 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/__init__.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282697 16 -rw-r--r-- 1 ubuntu ubuntu 12712 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/caps_helper.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282749 20 -rw-r--r-- 1 ubuntu ubuntu 19209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/xfstests_dev.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282729 12 -rw-r--r-- 1 ubuntu ubuntu 11333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_multifs_auth.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282745 40 -rw-r--r-- 1 ubuntu ubuntu 39778 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_strays.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282743 56 -rw-r--r-- 1 ubuntu ubuntu 55628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_snap_schedules.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282748 4 -rw-r--r-- 1 ubuntu ubuntu 209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/tests_from_xfstests_dev.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282735 28 -rw-r--r-- 1 ubuntu ubuntu 27921 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_quiesce.py 2024-03-27T21:32:59.916 INFO:teuthology.orchestra.run.smithi063.stdout: 282709 20 -rw-r--r-- 1 ubuntu ubuntu 17048 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_client_limits.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282733 4 -rw-r--r-- 1 ubuntu ubuntu 3151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_openfiletable.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282747 344 -rw-r--r-- 1 ubuntu ubuntu 350140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_volumes.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282714 28 -rw-r--r-- 1 ubuntu ubuntu 24907 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_exports.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282698 20 -rw-r--r-- 1 ubuntu ubuntu 17940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/cephfs_test_case.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282711 28 -rw-r--r-- 1 ubuntu ubuntu 27112 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_damage.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282744 28 -rw-r--r-- 1 ubuntu ubuntu 26559 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_snapshots.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282727 72 -rw-r--r-- 1 ubuntu ubuntu 73722 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_mirroring.py 2024-03-27T21:32:59.917 INFO:teuthology.orchestra.run.smithi063.stdout: 282718 16 -rw-r--r-- 1 ubuntu ubuntu 12308 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_fragment.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282737 4 -rw-r--r-- 1 ubuntu ubuntu 1031 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_readahead.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282706 8 -rw-r--r-- 1 ubuntu ubuntu 5038 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_backtrace.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282741 20 -rw-r--r-- 1 ubuntu ubuntu 17560 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_scrub_checks.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282724 8 -rw-r--r-- 1 ubuntu ubuntu 4451 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_mantle.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282722 4 -rw-r--r-- 1 ubuntu ubuntu 3928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_journal_migration.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282701 16 -rw-r--r-- 1 ubuntu ubuntu 13882 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/kernel_mount.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282712 36 -rw-r--r-- 1 ubuntu ubuntu 33182 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs/test_data_scan.py 2024-03-27T21:32:59.918 INFO:teuthology.orchestra.run.smithi063.stdout: 282833 4 -rw-r--r-- 1 ubuntu ubuntu 2281 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mon_recovery.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282751 8 -rw-r--r-- 1 ubuntu ubuntu 7264 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs_mirror_thrash.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282777 20 -rw-r--r-- 1 ubuntu ubuntu 17982 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/keystone.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282767 8 -rw-r--r-- 1 ubuntu ubuntu 7848 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ec_inconsistent_hinfo.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282873 8 -rw-r--r-- 1 ubuntu ubuntu 5081 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw_cloudtier.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282761 16 -rw-r--r-- 1 ubuntu ubuntu 13327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/devstack.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282903 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/userdata_teardown.yaml 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282886 16 -rw-r--r-- 1 ubuntu ubuntu 14841 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/scrub_test.py 2024-03-27T21:32:59.919 INFO:teuthology.orchestra.run.smithi063.stdout: 282783 4 -rw-r--r-- 1 ubuntu ubuntu 2680 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/manypools.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282850 4 -rw-r--r-- 1 ubuntu ubuntu 2753 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/populate_rbd_pool.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282670 8 -rw-r--r-- 1 ubuntu ubuntu 4983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/autotest.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282779 8 -rwxr-xr-x 1 ubuntu ubuntu 4936 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/locktest.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282880 24 -rw-r--r-- 1 ubuntu ubuntu 21645 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rook.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282883 16 -rw-r--r-- 1 ubuntu ubuntu 15922 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/s3tests_java.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282841 4 -rw-r--r-- 1 ubuntu ubuntu 2900 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/object_source_down.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282897 4 -rw-r--r-- 1 ubuntu ubuntu 1617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/thrash_pool_snaps.py 2024-03-27T21:32:59.920 INFO:teuthology.orchestra.run.smithi063.stdout: 282836 12 -rw-r--r-- 1 ubuntu ubuntu 8338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/netem.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282839 4 -rw-r--r-- 1 ubuntu ubuntu 3908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/nvme_loop.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282917 4 -rw-r--r-- 1 ubuntu ubuntu 1634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/watch_notify_stress.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282677 8 -rw-r--r-- 1 ubuntu ubuntu 6025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cbt_performance.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282764 8 -rw-r--r-- 1 ubuntu ubuntu 6262 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/divergent_priors2.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282851 16 -rw-r--r-- 1 ubuntu ubuntu 14990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/pykmip.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282846 8 -rw-r--r-- 1 ubuntu ubuntu 4571 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/osd_max_pg_per_osd.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282774 8 -rw-r--r-- 1 ubuntu ubuntu 6487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/kafka.py 2024-03-27T21:32:59.921 INFO:teuthology.orchestra.run.smithi063.stdout: 282918 16 -rw-r--r-- 1 ubuntu ubuntu 15925 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/workunit.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282785 4 -rw-r--r-- 1 ubuntu ubuntu 563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mds_pre_upgrade.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282681 36 -rw-r--r-- 1 ubuntu ubuntu 34996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_deploy.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282899 4 -rw-r--r-- 1 ubuntu ubuntu 580 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/thrashosds-health.yaml 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282778 20 -rw-r--r-- 1 ubuntu ubuntu 19665 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/kubeadm.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282877 20 -rw-r--r-- 1 ubuntu ubuntu 16450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw_multisite.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282683 4 -rw-r--r-- 1 ubuntu ubuntu 1796 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_iscsi_client.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282762 4 -rw-r--r-- 1 ubuntu ubuntu 1944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/die_on_err.py 2024-03-27T21:32:59.922 INFO:teuthology.orchestra.run.smithi063.stdout: 282671 4 -rw-r--r-- 1 ubuntu ubuntu 2064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/aver.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282896 8 -rw-r--r-- 1 ubuntu ubuntu 5001 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/tgt.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282784 4 -rw-r--r-- 1 ubuntu ubuntu 2606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mds_creation_failure.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282845 8 -rw-r--r-- 1 ubuntu ubuntu 7082 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/osd_failsafe_enospc.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282842 4 -rw-r--r-- 1 ubuntu ubuntu 2603 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/omapbench.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282750 4 -rw-r--r-- 1 ubuntu ubuntu 2149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs_mirror.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282776 16 -rw-r--r-- 1 ubuntu ubuntu 16012 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/keycloak.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282863 4 -rw-r--r-- 1 ubuntu ubuntu 3591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rbd_fsx.py 2024-03-27T21:32:59.923 INFO:teuthology.orchestra.run.smithi063.stdout: 282676 16 -rw-r--r-- 1 ubuntu ubuntu 12957 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cbt.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282859 40 -rw-r--r-- 1 ubuntu ubuntu 37554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/radosgw_admin_rest.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282875 4 -rw-r--r-- 1 ubuntu ubuntu 1375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw_module.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282756 8 -rw-r--r-- 1 ubuntu ubuntu 5402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cram.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282876 0 lrwxrwxrwx 1 ubuntu ubuntu 28 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw_multi -> ../../src/test/rgw/rgw_multi 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282916 4 -rw-r--r-- 1 ubuntu ubuntu 3242 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/watch_notify_same_primary.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282832 4 -rw-r--r-- 1 ubuntu ubuntu 2165 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mon_clock_skew_check.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282885 4 -rw-r--r-- 1 ubuntu ubuntu 2662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/scrub.py 2024-03-27T21:32:59.924 INFO:teuthology.orchestra.run.smithi063.stdout: 282687 4 -rw-r--r-- 1 ubuntu ubuntu 2438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephadm.conf 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282871 4 -rw-r--r-- 1 ubuntu ubuntu 2881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/resolve_stuck_peering.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282852 4 -rw-r--r-- 1 ubuntu ubuntu 1122 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/python.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282898 4 -rw-r--r-- 1 ubuntu ubuntu 290 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/thrasher.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282753 4 -rw-r--r-- 1 ubuntu ubuntu 1422 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs_upgrade_snap.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282835 4 -rw-r--r-- 1 ubuntu ubuntu 1511 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/multibench.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282684 128 -rw-r--r-- 1 ubuntu ubuntu 127109 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_manager.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282902 4 -rw-r--r-- 1 ubuntu ubuntu 1161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/userdata_setup.yaml 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282884 8 -rw-r--r-- 1 ubuntu ubuntu 7830 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/samba.py 2024-03-27T21:32:59.925 INFO:teuthology.orchestra.run.smithi063.stdout: 282787 4 -rw-r--r-- 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/metadata.yaml 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282834 16 -rw-r--r-- 1 ubuntu ubuntu 15102 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mon_thrash.py 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282844 4 -rw-r--r-- 1 ubuntu ubuntu 2599 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/osd_backfill.py 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282904 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282909 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/test 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282911 4 -rw-r--r-- 1 ubuntu ubuntu 1568 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/test/test_rados.py 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282910 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/test/__init__.py 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282912 4 -rw-r--r-- 1 ubuntu ubuntu 2378 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/workunit.py 2024-03-27T21:32:59.926 INFO:teuthology.orchestra.run.smithi063.stdout: 282908 4 -rw-r--r-- 1 ubuntu ubuntu 2967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/rgw.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282905 4 -rw-r--r-- 1 ubuntu ubuntu 1049 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/__init__.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282907 8 -rw-r--r-- 1 ubuntu ubuntu 4305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/rados.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282906 8 -rw-r--r-- 1 ubuntu ubuntu 4893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/util/chacra.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282872 24 -rw-r--r-- 1 ubuntu ubuntu 22411 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rgw.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282669 8 -rw-r--r-- 1 ubuntu ubuntu 6476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/admin_socket.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282879 4 -rw-r--r-- 1 ubuntu ubuntu 935 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rook-ceph.conf 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282679 68 -rw-r--r-- 1 ubuntu ubuntu 67412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282840 8 -rw-r--r-- 1 ubuntu ubuntu 6172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/nvmeof.py 2024-03-27T21:32:59.927 INFO:teuthology.orchestra.run.smithi063.stdout: 282668 4 -rw-r--r-- 1 ubuntu ubuntu 167 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/__init__.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282915 56 -rw-r--r-- 1 ubuntu ubuntu 55127 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/vstart_runner.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282758 8 -rw-r--r-- 1 ubuntu ubuntu 4963 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/d4ntests.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282854 4 -rw-r--r-- 1 ubuntu ubuntu 3662 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rabbitmq.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282752 8 -rw-r--r-- 1 ubuntu ubuntu 6319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephfs_test_runner.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282675 4 -rw-r--r-- 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/boto.cfg.template 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282868 8 -rw-r--r-- 1 ubuntu ubuntu 7953 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/reg11184.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282772 4 -rw-r--r-- 1 ubuntu ubuntu 2333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/immutable_object_cache.py 2024-03-27T21:32:59.928 INFO:teuthology.orchestra.run.smithi063.stdout: 282866 4 -rw-r--r-- 1 ubuntu ubuntu 3188 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rbd_pwl_cache_recovery.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282860 16 -rw-r--r-- 1 ubuntu ubuntu 12875 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ragweed.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282849 4 -rw-r--r-- 1 ubuntu ubuntu 2303 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/peering_speed_test.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282856 8 -rw-r--r-- 1 ubuntu ubuntu 4728 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/radosbench.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282674 4 -rw-r--r-- 1 ubuntu ubuntu 2821 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/blktrace.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282769 4 -rw-r--r-- 1 ubuntu ubuntu 1899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/exec_on_cleanup.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282755 4 -rw-r--r-- 1 ubuntu ubuntu 3758 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cifs_mount.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282688 76 -rw-r--r-- 1 ubuntu ubuntu 75219 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/cephadm.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282838 12 -rw-r--r-- 1 ubuntu ubuntu 11584 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/notification_tests.py 2024-03-27T21:32:59.929 INFO:teuthology.orchestra.run.smithi063.stdout: 282680 4 -rw-r--r-- 1 ubuntu ubuntu 1501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_client.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282855 12 -rw-r--r-- 1 ubuntu ubuntu 10733 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rados.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282786 20 -rw-r--r-- 1 ubuntu ubuntu 17999 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/mds_thrash.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282913 12 -rw-r--r-- 1 ubuntu ubuntu 9344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/vault.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282685 28 -rw-r--r-- 1 ubuntu ubuntu 26396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_objectstore_tool.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282870 12 -rw-r--r-- 1 ubuntu ubuntu 9443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/repair_test.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282686 16 -rw-r--r-- 1 ubuntu ubuntu 14055 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_test_case.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282887 8 -rw-r--r-- 1 ubuntu ubuntu 5784 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/systemd.py 2024-03-27T21:32:59.930 INFO:teuthology.orchestra.run.smithi063.stdout: 282864 4 -rw-r--r-- 1 ubuntu ubuntu 3719 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rbd_mirror.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282843 12 -rw-r--r-- 1 ubuntu ubuntu 9344 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/openssl_keys.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282682 8 -rw-r--r-- 1 ubuntu ubuntu 5946 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph_fuse.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282881 12 -rw-r--r-- 1 ubuntu ubuntu 8766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/s3a_hadoop.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282865 8 -rw-r--r-- 1 ubuntu ubuntu 7125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/rbd_mirror_thrash.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282857 8 -rw-r--r-- 1 ubuntu ubuntu 7667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/radosbenchsweep.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282781 8 -rw-r--r-- 1 ubuntu ubuntu 5993 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/lost_unfound.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282882 32 -rw-r--r-- 1 ubuntu ubuntu 29084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/s3tests.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282848 4 -rw-r--r-- 1 ubuntu ubuntu 2457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/peer.py 2024-03-27T21:32:59.931 INFO:teuthology.orchestra.run.smithi063.stdout: 282678 4 -rw-r--r-- 1 ubuntu ubuntu 2919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ceph.conf.template 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282759 8 -rw-r--r-- 1 ubuntu ubuntu 5606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/daemonwatchdog.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282771 8 -rw-r--r-- 1 ubuntu ubuntu 5083 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/fwd_scrub.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282847 8 -rw-r--r-- 1 ubuntu ubuntu 5337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/osd_recovery.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282768 8 -rw-r--r-- 1 ubuntu ubuntu 5320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/ec_lost_unfound.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282760 12 -rw-r--r-- 1 ubuntu ubuntu 8576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/deduplication.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282837 4 -rw-r--r-- 1 ubuntu ubuntu 2437 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/netsplit.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282757 4 -rw-r--r-- 1 ubuntu ubuntu 2499 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/create_verify_lfn_objects.py 2024-03-27T21:32:59.932 INFO:teuthology.orchestra.run.smithi063.stdout: 282754 8 -rw-r--r-- 1 ubuntu ubuntu 4748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/check_counter.py 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 282858 44 -rw-r--r-- 1 ubuntu ubuntu 44474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/radosgw_admin.py 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 282766 8 -rw-r--r-- 1 ubuntu ubuntu 4415 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/tasks/dump_stuck.py 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278677 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/machine_types 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278678 4 -rwxr-xr-x 1 ubuntu ubuntu 1217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/machine_types/schedule_rados_ovh.sh 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278679 4 -rw-r--r-- 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/machine_types/vps.yaml 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278671 4 -rwxr-xr-x 1 ubuntu ubuntu 120 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/find-used-ports.sh 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278720 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278726 4 -rw-r--r-- 1 ubuntu ubuntu 1226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-hybrid.yaml 2024-03-27T21:32:59.933 INFO:teuthology.orchestra.run.smithi063.stdout: 278727 4 -rw-r--r-- 1 ubuntu ubuntu 801 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-low-osd-mem-target.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278723 4 -rw-r--r-- 1 ubuntu ubuntu 772 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-comp-snappy.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278724 4 -rw-r--r-- 1 ubuntu ubuntu 770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-comp-zlib.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278721 4 -rw-r--r-- 1 ubuntu ubuntu 1327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-bitmap.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278725 4 -rw-r--r-- 1 ubuntu ubuntu 770 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-comp-zstd.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278722 4 -rw-r--r-- 1 ubuntu ubuntu 769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-comp-lz4.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278728 4 -rw-r--r-- 1 ubuntu ubuntu 1327 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_debug/bluestore-stupid.yaml 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278432 4 -rw-r--r-- 1 ubuntu ubuntu 26 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/.gitignore 2024-03-27T21:32:59.934 INFO:teuthology.orchestra.run.smithi063.stdout: 278698 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon_election 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 278700 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon_election/connectivity.yaml 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 278699 4 -rw-r--r-- 1 ubuntu ubuntu 83 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/mon_election/classic.yaml 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 282926 4 drwxr-xr-x 25 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 283241 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 283251 4 -rwxr-xr-x 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 283244 4 -rwxr-xr-x 1 ubuntu ubuntu 2474 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/cephfs_journal_tool_smoke.sh 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 283252 4 -rwxr-xr-x 1 ubuntu ubuntu 283 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iogen.sh 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 283246 4 -rwxr-xr-x 1 ubuntu ubuntu 49 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-03-27T21:32:59.935 INFO:teuthology.orchestra.run.smithi063.stdout: 283250 4 -rwxr-xr-x 1 ubuntu ubuntu 403 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283256 4 -rw-r--r-- 1 ubuntu ubuntu 1345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283255 4 -rwxr-xr-x 1 ubuntu ubuntu 269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283247 4 -rwxr-xr-x 1 ubuntu ubuntu 464 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283253 4 -rwxr-xr-x 1 ubuntu ubuntu 656 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone-sync.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283248 4 -rwxr-xr-x 1 ubuntu ubuntu 791 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fio.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283242 4 -rwxr-xr-x 1 ubuntu ubuntu 320 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/blogbench.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283245 4 -rwxr-xr-x 1 ubuntu ubuntu 39 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench-short.sh 2024-03-27T21:32:59.936 INFO:teuthology.orchestra.run.smithi063.stdout: 283243 4 -rwxr-xr-x 1 ubuntu ubuntu 193 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/bonnie.sh 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283254 4 -rwxr-xr-x 1 ubuntu ubuntu 179 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283249 4 -rwxr-xr-x 1 ubuntu ubuntu 319 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283177 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rest 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283178 4 -rwxr-xr-x 1 ubuntu ubuntu 233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rest/test-restful.sh 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283179 4 -rwxr-xr-x 1 ubuntu ubuntu 2963 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rest/test_mgr_rest_api.py 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283050 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283052 4 -rwxr-xr-x 1 ubuntu ubuntu 624 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr/test_per_module_finisher.sh 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283051 4 -rwxr-xr-x 1 ubuntu ubuntu 459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mgr/test_localpool.sh 2024-03-27T21:32:59.937 INFO:teuthology.orchestra.run.smithi063.stdout: 283165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283167 4 -rwxr-xr-x 1 ubuntu ubuntu 550 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/dir_pri_nul.sh 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283166 4 -rwxr-xr-x 1 ubuntu ubuntu 861 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/all.sh 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283173 4 -rwxr-xr-x 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/pri_rem.sh 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283169 4 -rw-r--r-- 1 ubuntu ubuntu 1911 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/plan.txt 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283171 4 -rwxr-xr-x 1 ubuntu ubuntu 125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/pri_nul.sh 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283168 4 -rwxr-xr-x 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/dir_pri_pri.sh 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283174 4 -rwxr-xr-x 1 ubuntu ubuntu 368 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/rem_nul.sh 2024-03-27T21:32:59.938 INFO:teuthology.orchestra.run.smithi063.stdout: 283170 4 -rwxr-xr-x 1 ubuntu ubuntu 604 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/prepare.sh 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283176 4 -rwxr-xr-x 1 ubuntu ubuntu 963 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/rem_rem.sh 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283172 4 -rwxr-xr-x 1 ubuntu ubuntu 172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/pri_pri.sh 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283175 4 -rwxr-xr-x 1 ubuntu ubuntu 392 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rename/rem_pri.sh 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283069 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/objectstore 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283070 8 -rwxr-xr-x 1 ubuntu ubuntu 4352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/objectstore/test_fuse.sh 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 282982 4 drwxr-xr-x 9 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 282998 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283010 4 -rwxr-xr-x 1 ubuntu ubuntu 1836 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/rstats.sh 2024-03-27T21:32:59.939 INFO:teuthology.orchestra.run.smithi063.stdout: 283008 4 -rwxr-xr-x 1 ubuntu ubuntu 285 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/mkpool_layout_vxattrs.sh 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283000 4 -rwxr-xr-x 1 ubuntu ubuntu 1039 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283006 4 -rwxr-xr-x 1 ubuntu ubuntu 423 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/i_complete_vs_rename.sh 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283002 4 -rwxr-xr-x 1 ubuntu ubuntu 1025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283012 4 -rwxr-xr-x 1 ubuntu ubuntu 224 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/xattrs.sh 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283009 4 -rwxr-xr-x 1 ubuntu ubuntu 644 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283005 4 -rwxr-xr-x 1 ubuntu ubuntu 2299 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_interrupt.py 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283001 4 -rwxr-xr-x 1 ubuntu ubuntu 322 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-03-27T21:32:59.940 INFO:teuthology.orchestra.run.smithi063.stdout: 283011 4 -rwxr-xr-x 1 ubuntu ubuntu 59 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 283007 8 -rwxr-xr-x 1 ubuntu ubuntu 4935 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 283004 4 -rwxr-xr-x 1 ubuntu ubuntu 1475 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_deadlock.py 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 282999 4 -rwxr-xr-x 1 ubuntu ubuntu 919 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 283003 4 -rwxr-xr-x 1 ubuntu ubuntu 605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 283018 4 -rwxr-xr-x 1 ubuntu ubuntu 589 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snap-hierarchy.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 283042 4 -rwxr-xr-x 1 ubuntu ubuntu 216 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_python.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 282985 4 -rwxr-xr-x 1 ubuntu ubuntu 1541 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/cephfs_mirror_ha_gen.sh 2024-03-27T21:32:59.941 INFO:teuthology.orchestra.run.smithi063.stdout: 283019 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283022 4 -rwxr-xr-x 1 ubuntu ubuntu 1522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283031 4 -rwxr-xr-x 1 ubuntu ubuntu 628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283032 4 -rwxr-xr-x 1 ubuntu ubuntu 351 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-name-limits.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283030 4 -rwxr-xr-x 1 ubuntu ubuntu 265 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-intodir.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283023 4 -rwxr-xr-x 1 ubuntu ubuntu 129 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283028 4 -rwxr-xr-x 1 ubuntu ubuntu 915 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283036 4 -rwxr-xr-x 1 ubuntu ubuntu 407 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-snap-rm-cmp.sh 2024-03-27T21:32:59.942 INFO:teuthology.orchestra.run.smithi063.stdout: 283029 4 -rwxr-xr-x 1 ubuntu ubuntu 295 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-hardlink.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283034 4 -rwxr-xr-x 1 ubuntu ubuntu 388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-realm-split.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283033 4 -rwxr-xr-x 1 ubuntu ubuntu 1043 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-parents.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283020 4 -rwxr-xr-x 1 ubuntu ubuntu 244 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283027 4 -rwxr-xr-x 1 ubuntu ubuntu 178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283039 4 -rwxr-xr-x 1 ubuntu ubuntu 298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283035 4 -rwxr-xr-x 1 ubuntu ubuntu 893 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-snap-rename.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283026 4 -rwxr-xr-x 1 ubuntu ubuntu 346 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283038 4 -rwxr-xr-x 1 ubuntu ubuntu 569 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-xattrwb.sh 2024-03-27T21:32:59.943 INFO:teuthology.orchestra.run.smithi063.stdout: 283025 4 -rwxr-xr-x 1 ubuntu ubuntu 178 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 283024 4 -rwxr-xr-x 1 ubuntu ubuntu 492 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 283021 4 -rwxr-xr-x 1 ubuntu ubuntu 402 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 283037 4 -rwxr-xr-x 1 ubuntu ubuntu 496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-upchildrealms.sh 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 283013 4 -rwxr-xr-x 1 ubuntu ubuntu 854 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/multiclient_sync_read_eof.py 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 282986 4 -rwxr-xr-x 1 ubuntu ubuntu 1223 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/cephfs_mirror_ha_verify.sh 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 283041 4 -rwxr-xr-x 1 ubuntu ubuntu 78 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 282984 4 -rw-r--r-- 1 ubuntu ubuntu 134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/Makefile 2024-03-27T21:32:59.944 INFO:teuthology.orchestra.run.smithi063.stdout: 282992 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282995 4 -rwxr-xr-x 1 ubuntu ubuntu 2596 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_snapshot_rm.sh 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282993 4 -rwxr-xr-x 1 ubuntu ubuntu 3667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_clone.sh 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282994 4 -rwxr-xr-x 1 ubuntu ubuntu 1764 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/full/subvolume_rm.sh 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282996 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/maxentries 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282997 4 -rwxr-xr-x 1 ubuntu ubuntu 2730 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/maxentries/maxentries.sh 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282991 4 -rwxr-xr-x 1 ubuntu ubuntu 2581 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/fscrypt.sh 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282987 4 -rw-r--r-- 1 ubuntu ubuntu 1289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/cephfs_mirror_helpers.sh 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282988 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/damage 2024-03-27T21:32:59.945 INFO:teuthology.orchestra.run.smithi063.stdout: 282990 8 -rwxr-xr-x 1 ubuntu ubuntu 4385 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/damage/test-first-damage.sh 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 282989 8 -rwxr-xr-x 1 ubuntu ubuntu 4269 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/damage/test-first-damage-lost-found.sh 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 283016 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 283017 4 -rwxr-xr-x 1 ubuntu ubuntu 3702 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 283014 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 283015 4 -rwxr-xr-x 1 ubuntu ubuntu 376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 283040 4 -rw-r--r-- 1 ubuntu ubuntu 851 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.c 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 282983 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/.gitignore 2024-03-27T21:32:59.946 INFO:teuthology.orchestra.run.smithi063.stdout: 283074 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283078 4 -rwxr-xr-x 1 ubuntu ubuntu 207 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-mix-small.sh 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283081 4 -rwxr-xr-x 1 ubuntu ubuntu 128 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/stress_watch.sh 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283091 8 -rwxr-xr-x 1 ubuntu ubuntu 4467 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_large_omap_detection.py 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283077 4 -rwxr-xr-x 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-mix-small-long.sh 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283083 8 -rwxr-xr-x 1 ubuntu ubuntu 4881 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_alloc_hint.sh 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283097 4 -rwxr-xr-x 1 ubuntu ubuntu 1338 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_rados_timeouts.sh 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283093 4 -rwxr-xr-x 1 ubuntu ubuntu 2134 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_librados_build.sh 2024-03-27T21:32:59.947 INFO:teuthology.orchestra.run.smithi063.stdout: 283080 4 -rwxr-xr-x 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-mostlyread.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283084 8 -rwxr-xr-x 1 ubuntu ubuntu 5597 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_cache_pool.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283096 4 -rwxr-xr-x 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283099 4 -rwxr-xr-x 1 ubuntu ubuntu 998 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/version_number_sanity.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283082 4 -rwxr-xr-x 1 ubuntu ubuntu 1979 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283087 24 -rwxr-xr-x 1 ubuntu ubuntu 21829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_dedup_tool.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283095 4 -rwxr-xr-x 1 ubuntu ubuntu 1210 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283090 4 -rwxr-xr-x 1 ubuntu ubuntu 1899 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_health_warnings.sh 2024-03-27T21:32:59.948 INFO:teuthology.orchestra.run.smithi063.stdout: 283079 4 -rwxr-xr-x 1 ubuntu ubuntu 208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-mix.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283094 4 -rwxr-xr-x 1 ubuntu ubuntu 2235 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_access.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283085 4 -rwxr-xr-x 1 ubuntu ubuntu 1406 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_crash.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283092 4 -rwxr-xr-x 1 ubuntu ubuntu 2769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_libcephsqlite.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283086 4 -rwxr-xr-x 1 ubuntu ubuntu 3064 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_crushdiff.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283098 32 -rwxr-xr-x 1 ubuntu ubuntu 31345 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_rados_tool.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283076 4 -rwxr-xr-x 1 ubuntu ubuntu 218 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/load-gen-big.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283088 4 -rwxr-xr-x 1 ubuntu ubuntu 2690 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh 2024-03-27T21:32:59.949 INFO:teuthology.orchestra.run.smithi063.stdout: 283075 4 -rwxr-xr-x 1 ubuntu ubuntu 298 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/clone.sh 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 283089 4 -rwxr-xr-x 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_hang.sh 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 282942 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 282943 104 -rwxr-xr-x 1 ubuntu ubuntu 106106 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 282945 4 -rwxr-xr-x 1 ubuntu ubuntu 1976 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_kvstore_tool.sh 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 282944 4 -rwxr-xr-x 1 ubuntu ubuntu 1184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test_daemon.sh 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 283053 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 283054 4 -rwxr-xr-x 1 ubuntu ubuntu 2610 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/auth_caps.sh 2024-03-27T21:32:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 283066 16 -rwxr-xr-x 1 ubuntu ubuntu 15314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_config_key.py 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283059 12 -rwxr-xr-x 1 ubuntu ubuntu 8549 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283068 4 -rwxr-xr-x 1 ubuntu ubuntu 2617 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_noautoscale_flag.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283061 8 -rwxr-xr-x 1 ubuntu ubuntu 5383 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283058 8 -rwxr-xr-x 1 ubuntu ubuntu 4685 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/config.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283067 8 -rwxr-xr-x 1 ubuntu ubuntu 5230 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283065 8 -rwxr-xr-x 1 ubuntu ubuntu 7172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_config_key_caps.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283060 4 -rwxr-xr-x 1 ubuntu ubuntu 326 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/osd.sh 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283056 12 -rw-r--r-- 1 ubuntu ubuntu 9820 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.py 2024-03-27T21:32:59.951 INFO:teuthology.orchestra.run.smithi063.stdout: 283062 4 -rwxr-xr-x 1 ubuntu ubuntu 3047 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/ping.py 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283063 4 -rwxr-xr-x 1 ubuntu ubuntu 3062 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pool_ops.sh 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283055 4 -rwxr-xr-x 1 ubuntu ubuntu 1642 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/auth_key_rotation.sh 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283064 4 -rwxr-xr-x 1 ubuntu ubuntu 2217 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/rbd_snaps_ops.sh 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283057 4 -rwxr-xr-x 1 ubuntu ubuntu 2743 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283260 4 -rwxr-xr-x 1 ubuntu ubuntu 1025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_quincy_x.sh 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283259 4 -rwxr-xr-x 1 ubuntu ubuntu 1239 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_quincy.sh 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283182 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-27T21:32:59.952 INFO:teuthology.orchestra.run.smithi063.stdout: 283231 12 -rwxr-xr-x 1 ubuntu ubuntu 9117 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283224 12 -rwxr-xr-x 1 ubuntu ubuntu 11479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283227 8 -rw-r--r-- 1 ubuntu ubuntu 6010 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_utilities.pm 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283233 8 -rwxr-xr-x 1 ubuntu ubuntu 6865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283219 4 -rwxr-xr-x 1 ubuntu ubuntu 257 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-d4n.sh 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283222 4 -rwxr-xr-x 1 ubuntu ubuntu 846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-s3tests.sh 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283220 4 -rwxr-xr-x 1 ubuntu ubuntu 337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283228 8 -rwxr-xr-x 1 ubuntu ubuntu 6300 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test-keystone-service-token.py 2024-03-27T21:32:59.953 INFO:teuthology.orchestra.run.smithi063.stdout: 283216 4 -rw-r--r-- 1 ubuntu ubuntu 115 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283184 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283190 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/README.md 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283197 12 -rwxr-xr-x 1 ubuntu ubuntu 11289 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/mvnw 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283191 0 -rw-r--r-- 1 ubuntu ubuntu 0 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/file-0b 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283201 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283208 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283209 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/java 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283210 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/java/io 2024-03-27T21:32:59.954 INFO:teuthology.orchestra.run.smithi063.stdout: 283211 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/java/io/ceph 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283212 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/java/io/ceph/jcksum 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283213 12 -rw-r--r-- 1 ubuntu ubuntu 9530 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/java/io/ceph/jcksum/PutObjects.java 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283202 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283203 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/java 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283204 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/java/io 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283205 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/java/io/ceph 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283206 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/java/io/ceph/jcksum 2024-03-27T21:32:59.955 INFO:teuthology.orchestra.run.smithi063.stdout: 283207 16 -rw-r--r-- 1 ubuntu ubuntu 16148 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/java/io/ceph/jcksum/jcksum.java 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283195 256 -rw-r--r-- 1 ubuntu ubuntu 262144 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/file-256k 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283199 4 -rw-r--r-- 1 ubuntu ubuntu 1496 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/pom-SNAPSHOT.xml 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283192 1024 -rw-r--r-- 1 ubuntu ubuntu 1048576 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/file-1m 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283193 4 -rw-r--r-- 1 ubuntu ubuntu 200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/file-200b 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283196 4 -rw-r--r-- 1 ubuntu ubuntu 8 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/file-8b 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283185 4 -rw-r--r-- 1 ubuntu ubuntu 164 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/.gitignore 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283186 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/.mvn 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283187 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/.mvn/wrapper 2024-03-27T21:32:59.956 INFO:teuthology.orchestra.run.smithi063.stdout: 283188 64 -rw-r--r-- 1 ubuntu ubuntu 62547 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/.mvn/wrapper/maven-wrapper.jar 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283189 4 -rw-r--r-- 1 ubuntu ubuntu 1018 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/.mvn/wrapper/maven-wrapper.properties 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283194 24 -rw-r--r-- 1 ubuntu ubuntu 21983 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/file-21983b 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283200 8 -rw-r--r-- 1 ubuntu ubuntu 4116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/pom.xml 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283198 8 -rw-r--r-- 1 ubuntu ubuntu 7591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/mvnw.cmd 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283217 4 -rw-r--r-- 1 ubuntu ubuntu 71 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283235 4 -rwxr-xr-x 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283215 4 -rwxr-xr-x 1 ubuntu ubuntu 978 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/keystone-service-token.sh 2024-03-27T21:32:59.957 INFO:teuthology.orchestra.run.smithi063.stdout: 283218 4 -rwxr-xr-x 1 ubuntu ubuntu 337 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283239 4 -rwxr-xr-x 1 ubuntu ubuntu 2838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283238 4 -rwxr-xr-x 1 ubuntu ubuntu 3705 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.py 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283225 8 -rwxr-xr-x 1 ubuntu ubuntu 4108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283221 4 -rwxr-xr-x 1 ubuntu ubuntu 479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283183 4 -rwxr-xr-x 1 ubuntu ubuntu 3934 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/common.py 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283229 4 -rwxr-xr-x 1 ubuntu ubuntu 1459 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283223 4 -rwxr-xr-x 1 ubuntu ubuntu 335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283230 4 -rwxr-xr-x 1 ubuntu ubuntu 2254 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-03-27T21:32:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 283237 16 -rwxr-xr-x 1 ubuntu ubuntu 14105 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 283214 8 -rwxr-xr-x 1 ubuntu ubuntu 5898 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/keystone-fake-server.py 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 283240 8 -rwxr-xr-x 1 ubuntu ubuntu 5386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 283236 16 -rwxr-xr-x 1 ubuntu ubuntu 12507 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_orphan_list.sh 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 283226 8 -rwxr-xr-x 1 ubuntu ubuntu 5454 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_user_quota.pl 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 283232 12 -rw-r--r-- 1 ubuntu ubuntu 8640 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_d4n.py 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 283234 4 -rwxr-xr-x 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 282928 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/caps 2024-03-27T21:32:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: 282929 4 -rwxr-xr-x 1 ubuntu ubuntu 1352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/caps/mon_commands.sh 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283262 4 -rwxr-xr-x 1 ubuntu ubuntu 986 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_reef_x.sh 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283258 4 -rwxr-xr-x 1 ubuntu ubuntu 1374 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_pacific_x.sh 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283180 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/restart 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283181 8 -rwxr-xr-x 1 ubuntu ubuntu 6980 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/restart/test-backtraces.py 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 282927 4 -rw-r--r-- 1 ubuntu ubuntu 81 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/Makefile 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283264 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283265 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/libvirt_vm 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283270 8 -rw-r--r-- 1 ubuntu ubuntu 4579 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/libvirt_vm/utils.ps1 2024-03-27T21:32:59.960 INFO:teuthology.orchestra.run.smithi063.stdout: 283268 4 -rw-r--r-- 1 ubuntu ubuntu 1485 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/libvirt_vm/setup.ps1 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 283266 8 -rw-r--r-- 1 ubuntu ubuntu 5931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/libvirt_vm/autounattend.xml 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 283267 4 -rw-r--r-- 1 ubuntu ubuntu 1763 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/libvirt_vm/first-logon.ps1 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 283269 8 -rwxr-xr-x 1 ubuntu ubuntu 5714 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/libvirt_vm/setup.sh 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 283273 32 -rw-r--r-- 1 ubuntu ubuntu 31172 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/test_rbd_wnbd.py 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 283271 4 -rw-r--r-- 1 ubuntu ubuntu 1163 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/run-tests.ps1 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 283272 4 -rw-r--r-- 1 ubuntu ubuntu 305 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/windows/run-tests.sh 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 282963 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io 2024-03-27T21:32:59.961 INFO:teuthology.orchestra.run.smithi063.stdout: 282967 12 -rw-r--r-- 1 ubuntu ubuntu 9251 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/direct_io_test.c 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 282970 8 -rw-r--r-- 1 ubuntu ubuntu 5551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_sync_io.c 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 282968 4 -rwxr-xr-x 1 ubuntu ubuntu 466 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/misc.sh 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 282966 4 -rwxr-xr-x 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/big.sh 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 282965 4 -rw-r--r-- 1 ubuntu ubuntu 169 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/Makefile 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 282969 4 -rw-r--r-- 1 ubuntu ubuntu 1168 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/test_short_dio_read.c 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 282964 4 -rw-r--r-- 1 ubuntu ubuntu 51 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io/.gitignore 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 283043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/hadoop 2024-03-27T21:32:59.962 INFO:teuthology.orchestra.run.smithi063.stdout: 283045 4 -rwxr-xr-x 1 ubuntu ubuntu 2189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/hadoop/terasort.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283046 4 -rwxr-xr-x 1 ubuntu ubuntu 968 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/hadoop/wordcount.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283044 4 -rwxr-xr-x 1 ubuntu ubuntu 1154 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/hadoop/repl.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283261 4 -rwxr-xr-x 1 ubuntu ubuntu 1191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_reef.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283257 4 -rwxr-xr-x 1 ubuntu ubuntu 573 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/test_telemetry_pacific.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283047 4 -rwxr-xr-x 1 ubuntu ubuntu 329 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 282930 4 -rwxr-xr-x 1 ubuntu ubuntu 3944 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/ceph-helpers-root.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283048 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 283049 4 -rwxr-xr-x 1 ubuntu ubuntu 209 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh 2024-03-27T21:32:59.963 INFO:teuthology.orchestra.run.smithi063.stdout: 282981 4 -rw-r--r-- 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/false.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283073 4 -rwxr-xr-x 1 ubuntu ubuntu 137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/post-file.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283100 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283114 12 -rwxr-xr-x 1 ubuntu ubuntu 8280 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/journal.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283103 4 -rwxr-xr-x 1 ubuntu ubuntu 2931 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/compare_mirror_image_alternate_primary.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283138 4 -rwxr-xr-x 1 ubuntu ubuntu 1664 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/nvmeof_setup_subsystem.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283112 12 -rwxr-xr-x 1 ubuntu ubuntu 8814 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/import_export.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283143 4 -rwxr-xr-x 1 ubuntu ubuntu 3502 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qos.sh 2024-03-27T21:32:59.964 INFO:teuthology.orchestra.run.smithi063.stdout: 283133 8 -rwxr-xr-x 1 ubuntu ubuntu 7100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/merge_diff.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283126 4 -rwxr-xr-x 1 ubuntu ubuntu 2397 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_netns.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283130 8 -rwxr-xr-x 1 ubuntu ubuntu 6933 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/luks-encryption.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283105 12 -rwxr-xr-x 1 ubuntu ubuntu 9823 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283129 4 -rwxr-xr-x 1 ubuntu ubuntu 1208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_watch_errors.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283128 4 -rwxr-xr-x 1 ubuntu ubuntu 751 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_wac.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283162 8 -rwxr-xr-x 1 ubuntu ubuntu 7928 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_rbd_tasks.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283123 4 -rwxr-xr-x 1 ubuntu ubuntu 2666 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_stable_writes.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283159 4 -rwxr-xr-x 1 ubuntu ubuntu 333 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh 2024-03-27T21:32:59.965 INFO:teuthology.orchestra.run.smithi063.stdout: 283108 4 -rwxr-xr-x 1 ubuntu ubuntu 1373 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283131 4 -rwxr-xr-x 1 ubuntu ubuntu 352 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/map-snapshot-io.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283104 8 -rwxr-xr-x 1 ubuntu ubuntu 4514 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/compare_mirror_images.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283157 4 -rwxr-xr-x 1 ubuntu ubuntu 3611 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_admin_socket.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283161 4 -rwxr-xr-x 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_rbd_mirror.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283124 4 -rwxr-xr-x 1 ubuntu ubuntu 1248 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283111 20 -rwxr-xr-x 1 ubuntu ubuntu 17897 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/image_read.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283152 40 -rwxr-xr-x 1 ubuntu ubuntu 40061 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror_helpers.sh 2024-03-27T21:32:59.966 INFO:teuthology.orchestra.run.smithi063.stdout: 283135 4 -rwxr-xr-x 1 ubuntu ubuntu 107 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/notify_slave.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283146 8 -rwxr-xr-x 1 ubuntu ubuntu 5078 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_groups.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283136 4 -rwxr-xr-x 1 ubuntu ubuntu 1901 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/nvmeof_basic_tests.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283141 4 -rwxr-xr-x 1 ubuntu ubuntu 1067 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_dynamic_features.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283150 4 -rwxr-xr-x 1 ubuntu ubuntu 228 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283125 4 -rwxr-xr-x 1 ubuntu ubuntu 639 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_netlink_enobufs.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283140 4 -rwxr-xr-x 1 ubuntu ubuntu 1334 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu-iotests.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283142 4 -rwxr-xr-x 1 ubuntu ubuntu 769 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu_rebuild_object_map.sh 2024-03-27T21:32:59.967 INFO:teuthology.orchestra.run.smithi063.stdout: 283163 4 -rwxr-xr-x 1 ubuntu ubuntu 1208 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_rbdmap_RBDMAPFILE.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283106 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283107 4 -rwxr-xr-x 1 ubuntu ubuntu 1632 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283132 4 -rwxr-xr-x 1 ubuntu ubuntu 793 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/map-unmap.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283160 4 -rwxr-xr-x 1 ubuntu ubuntu 1150 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_lock_fence.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283149 4 -rwxr-xr-x 1 ubuntu ubuntu 1151 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror_fsx_compare.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283102 12 -rwxr-xr-x 1 ubuntu ubuntu 9606 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283144 8 -rwxr-xr-x 1 ubuntu ubuntu 6519 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd-ggate.sh 2024-03-27T21:32:59.968 INFO:teuthology.orchestra.run.smithi063.stdout: 283137 4 -rwxr-xr-x 1 ubuntu ubuntu 1996 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/nvmeof_fio_test.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283139 12 -rwxr-xr-x 1 ubuntu ubuntu 9384 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/permissions.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283145 20 -rwxr-xr-x 1 ubuntu ubuntu 16545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd-nbd.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283154 4 -rwxr-xr-x 1 ubuntu ubuntu 2735 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_support_module_recovery.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283147 32 -rwxr-xr-x 1 ubuntu ubuntu 32626 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283117 8 -rwxr-xr-x 1 ubuntu ubuntu 6079 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283101 60 -rwxr-xr-x 1 ubuntu ubuntu 61271 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283121 8 -rwxr-xr-x 1 ubuntu ubuntu 4226 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_namespaces.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283110 4 -rwxr-xr-x 1 ubuntu ubuntu 1342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/huge-tickets.sh 2024-03-27T21:32:59.969 INFO:teuthology.orchestra.run.smithi063.stdout: 283155 4 -rwxr-xr-x 1 ubuntu ubuntu 1557 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/read-flags.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283122 4 -rwxr-xr-x 1 ubuntu ubuntu 2500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_rxbounce.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283113 4 -rwxr-xr-x 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/issue-20295.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283164 4 -rwxr-xr-x 1 ubuntu ubuntu 634 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/verify_pool.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283127 4 -rwxr-xr-x 1 ubuntu ubuntu 2375 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_symlinks.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283158 4 -rwxr-xr-x 1 ubuntu ubuntu 183 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283115 4 -rwxr-xr-x 1 ubuntu ubuntu 2952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/kernel.sh 2024-03-27T21:32:59.970 INFO:teuthology.orchestra.run.smithi063.stdout: 283148 4 -rwxr-xr-x 1 ubuntu ubuntu 2591 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror_bootstrap.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283156 4 -rwxr-xr-x 1 ubuntu ubuntu 196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/simple_big.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283151 8 -rwxr-xr-x 1 ubuntu ubuntu 5136 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror_ha.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283120 4 -rwxr-xr-x 1 ubuntu ubuntu 471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_latest_osdmap_on_map.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283118 4 -rwxr-xr-x 1 ubuntu ubuntu 4056 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_fallocate.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283116 8 -rwxr-xr-x 1 ubuntu ubuntu 6189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_data_pool.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283119 4 -rwxr-xr-x 1 ubuntu ubuntu 1487 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_huge_osdmap.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283134 4 -rwxr-xr-x 1 ubuntu ubuntu 108 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/notify_master.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283109 4 -rwxr-xr-x 1 ubuntu ubuntu 3089 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/diff_continuous.sh 2024-03-27T21:32:59.971 INFO:teuthology.orchestra.run.smithi063.stdout: 283153 8 -rwxr-xr-x 1 ubuntu ubuntu 6284 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/rbd_mirror_stress.sh 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282946 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/client 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282947 4 -rwxr-xr-x 1 ubuntu ubuntu 37 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/client/test.sh 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282933 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282936 16 -rwxr-xr-x 1 ubuntu ubuntu 15287 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282939 4 -rwxr-xr-x 1 ubuntu ubuntu 819 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_etc_hosts.sh 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282937 8 -rwxr-xr-x 1 ubuntu ubuntu 5756 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm_timeout.py 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282935 4 -rwxr-xr-x 1 ubuntu ubuntu 1838 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh 2024-03-27T21:32:59.972 INFO:teuthology.orchestra.run.smithi063.stdout: 282940 4 -rwxr-xr-x 1 ubuntu ubuntu 1060 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_iscsi_pids_limit.sh 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 282938 8 -rwxr-xr-x 1 ubuntu ubuntu 4325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 282934 4 -rwxr-xr-x 1 ubuntu ubuntu 1325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/create_iscsi_disks.sh 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 282941 4 -rwxr-xr-x 1 ubuntu ubuntu 1249 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 283071 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/osdc 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 283072 4 -rwxr-xr-x 1 ubuntu ubuntu 793 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/osdc/stress_objectcacher.sh 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 282971 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 282978 124 -rw-r--r-- 1 ubuntu ubuntu 122971 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/jquery.flot.js 2024-03-27T21:32:59.973 INFO:teuthology.orchestra.run.smithi063.stdout: 282974 8 -rwxr-xr-x 1 ubuntu ubuntu 5694 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/bench.sh 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282973 4 -rw-r--r-- 1 ubuntu ubuntu 1168 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/bench.html 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282976 4 -rw-r--r-- 1 ubuntu ubuntu 1738 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/examples.css 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282980 4 -rw-r--r-- 1 ubuntu ubuntu 2027 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/plot.js 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282975 4 -rwxr-xr-x 1 ubuntu ubuntu 1196 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/encode-decode-non-regression.sh 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282972 4 -rw-r--r-- 1 ubuntu ubuntu 12 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/.gitignore 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282979 260 -rw-r--r-- 1 ubuntu ubuntu 266057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/jquery.js 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282977 8 -rw-r--r-- 1 ubuntu ubuntu 6033 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/erasure-code/jquery.flot.categories.js 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282931 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/ceph-tests 2024-03-27T21:32:59.974 INFO:teuthology.orchestra.run.smithi063.stdout: 282932 4 -rwxr-xr-x 1 ubuntu ubuntu 125 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/ceph-tests/ceph-admin-commands.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 283263 4 -rwxr-xr-x 1 ubuntu ubuntu 20 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/true.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282948 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282960 4 -rwxr-xr-x 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282959 4 -rwxr-xr-x 1 ubuntu ubuntu 114 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282955 4 -rwxr-xr-x 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282951 4 -rwxr-xr-x 1 ubuntu ubuntu 44 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282962 4 -rwxr-xr-x 1 ubuntu ubuntu 40 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_sdk.sh 2024-03-27T21:32:59.975 INFO:teuthology.orchestra.run.smithi063.stdout: 282961 4 -rwxr-xr-x 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282958 4 -rwxr-xr-x 1 ubuntu ubuntu 45 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282953 4 -rwxr-xr-x 1 ubuntu ubuntu 119 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_journal.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282952 4 -rwxr-xr-x 1 ubuntu ubuntu 42 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_hello.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282956 4 -rwxr-xr-x 1 ubuntu ubuntu 43 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_numops.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282957 4 -rwxr-xr-x 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282949 4 -rwxr-xr-x 1 ubuntu ubuntu 46 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282954 4 -rwxr-xr-x 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 282950 4 -rwxr-xr-x 1 ubuntu ubuntu 111 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cas.sh 2024-03-27T21:32:59.976 INFO:teuthology.orchestra.run.smithi063.stdout: 278560 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/config 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278562 4 -rw-r--r-- 1 ubuntu ubuntu 396 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/config/rados.yaml 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278561 4 -rw-r--r-- 1 ubuntu ubuntu 335 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/config/crimson_qa_overrides.yaml 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278563 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/crontab 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278564 8 -rw-r--r-- 1 ubuntu ubuntu 8174 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/crontab/teuthology-cronjobs 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278437 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/archs 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278441 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/archs/x86_64.yaml 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278439 4 -rw-r--r-- 1 ubuntu ubuntu 13 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/archs/armv7.yaml 2024-03-27T21:32:59.977 INFO:teuthology.orchestra.run.smithi063.stdout: 278438 4 -rw-r--r-- 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/archs/aarch64.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278440 4 -rw-r--r-- 1 ubuntu ubuntu 11 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/archs/i686.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278657 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278662 4 -rw-r--r-- 1 ubuntu ubuntu 484 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278670 4 -rw-r--r-- 1 ubuntu ubuntu 431 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-sequential.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278664 4 -rw-r--r-- 1 ubuntu ubuntu 1057 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=jerasure-k=2-m=2-crush.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278666 4 -rw-r--r-- 1 ubuntu ubuntu 555 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=jerasure-k=4-m=2.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278667 4 -rw-r--r-- 1 ubuntu ubuntu 1084 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=jerasure-k=8-m=6-crush.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278661 4 -rw-r--r-- 1 ubuntu ubuntu 472 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=clay-k=4-m=2.yaml 2024-03-27T21:32:59.978 INFO:teuthology.orchestra.run.smithi063.stdout: 278665 4 -rw-r--r-- 1 ubuntu ubuntu 706 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278660 4 -rw-r--r-- 1 ubuntu ubuntu 427 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-parallel.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278663 4 -rw-r--r-- 1 ubuntu ubuntu 480 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278659 4 -rw-r--r-- 1 ubuntu ubuntu 388 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-default.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278658 4 -rw-r--r-- 1 ubuntu ubuntu 2094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-feature-plugins-v2.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278669 4 -rw-r--r-- 1 ubuntu ubuntu 450 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278668 4 -rw-r--r-- 1 ubuntu ubuntu 448 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278718 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_cephfs 2024-03-27T21:32:59.979 INFO:teuthology.orchestra.run.smithi063.stdout: 278719 0 lrwxrwxrwx 1 ubuntu ubuntu 36 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/objectstore_cephfs/bluestore-bitmap.yaml -> ../objectstore/bluestore-bitmap.yaml 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 278828 12 -rw-r--r-- 1 ubuntu ubuntu 12288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/qa/run_xfstests-obsolete.sh 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277245 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph-object-corpus 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277208 8 -rw-r--r-- 1 ubuntu ubuntu 5100 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.peoplemap 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277204 4 -rw-r--r-- 1 ubuntu ubuntu 785 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.gitmodule_mirrors 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277246 84 -rw-r--r-- 1 ubuntu ubuntu 85438 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/ceph.spec.in 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277442 4 -rwxr-xr-x 1 ubuntu ubuntu 2522 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/do_freebsd.sh 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277213 12 -rw-r--r-- 1 ubuntu ubuntu 8405 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/COPYING 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277144 4 drwxr-xr-x 8 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git 2024-03-27T21:32:59.980 INFO:teuthology.orchestra.run.smithi063.stdout: 277163 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/refs 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/refs/tags 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277174 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/refs/remotes 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/refs/remotes/origin 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277177 4 -rw-r--r-- 1 ubuntu ubuntu 30 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/refs/remotes/origin/HEAD 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/refs/heads 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277184 4 -rw-r--r-- 1 ubuntu ubuntu 41 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/refs/heads/main 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277166 1412 -rw-r--r-- 1 ubuntu ubuntu 1442590 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/index 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277167 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/objects 2024-03-27T21:32:59.981 INFO:teuthology.orchestra.run.smithi063.stdout: 277169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/objects/pack 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277172 35588 -r--r--r-- 1 ubuntu ubuntu 36438200 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/objects/pack/pack-2e2d6bd3bed5aa6a3fd539e587cde70cd31df6f2.idx 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277168 758288 -r--r--r-- 1 ubuntu ubuntu 776479190 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/objects/pack/pack-2e2d6bd3bed5aa6a3fd539e587cde70cd31df6f2.pack 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277170 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/objects/info 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277145 4 -rw-r--r-- 1 ubuntu ubuntu 73 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/description 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277183 4 -rw-r--r-- 1 ubuntu ubuntu 21 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/HEAD 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277146 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/info 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277147 4 -rw-r--r-- 1 ubuntu ubuntu 240 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/info/exclude 2024-03-27T21:32:59.982 INFO:teuthology.orchestra.run.smithi063.stdout: 277148 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277149 4 -rwxr-xr-x 1 ubuntu ubuntu 1647 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/pre-commit.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277150 4 -rwxr-xr-x 1 ubuntu ubuntu 1496 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/prepare-commit-msg.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277151 4 -rwxr-xr-x 1 ubuntu ubuntu 2787 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/push-to-checkout.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277152 8 -rwxr-xr-x 1 ubuntu ubuntu 4726 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/fsmonitor-watchman.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277153 8 -rwxr-xr-x 1 ubuntu ubuntu 4902 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/pre-rebase.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277154 4 -rwxr-xr-x 1 ubuntu ubuntu 482 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/applypatch-msg.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277155 4 -rwxr-xr-x 1 ubuntu ubuntu 548 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/pre-receive.sample 2024-03-27T21:32:59.983 INFO:teuthology.orchestra.run.smithi063.stdout: 277156 4 -rwxr-xr-x 1 ubuntu ubuntu 193 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/post-update.sample 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277157 4 -rwxr-xr-x 1 ubuntu ubuntu 3654 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/update.sample 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277158 4 -rwxr-xr-x 1 ubuntu ubuntu 1378 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/pre-push.sample 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277159 4 -rwxr-xr-x 1 ubuntu ubuntu 900 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/commit-msg.sample 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277160 4 -rwxr-xr-x 1 ubuntu ubuntu 428 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/pre-applypatch.sample 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277161 4 -rwxr-xr-x 1 ubuntu ubuntu 420 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/hooks/pre-merge-commit.sample 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:31 /home/ubuntu/cephtest/clone.client.0/.git/branches 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277178 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs 2024-03-27T21:32:59.984 INFO:teuthology.orchestra.run.smithi063.stdout: 277179 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/refs 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277180 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/refs/remotes 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/refs/remotes/origin 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277182 4 -rw-r--r-- 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/refs/remotes/origin/HEAD 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277186 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/refs/heads 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277187 4 -rw-r--r-- 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/refs/heads/main 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277185 4 -rw-r--r-- 1 ubuntu ubuntu 191 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/logs/HEAD 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277175 56 -rw-r--r-- 1 ubuntu ubuntu 55347 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/packed-refs 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 277171 4 -rw-r--r-- 1 ubuntu ubuntu 253 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.git/config 2024-03-27T21:32:59.985 INFO:teuthology.orchestra.run.smithi063.stdout: 278216 4 -rw-r--r-- 1 ubuntu ubuntu 116 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/doc_deps.deb.txt 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 291476 12 -rwxr-xr-x 1 ubuntu ubuntu 11605 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/win32_deps_build.sh 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277247 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277248 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277251 12 -rw-r--r-- 1 ubuntu ubuntu 11325 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildBoost.cmake 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277331 4 -rw-r--r-- 1 ubuntu ubuntu 655 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findzfs.cmake 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277281 4 -rw-r--r-- 1 ubuntu ubuntu 967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindJeMalloc.cmake 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277300 4 -rw-r--r-- 1 ubuntu ubuntu 478 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindSQLite3.cmake 2024-03-27T21:32:59.986 INFO:teuthology.orchestra.run.smithi063.stdout: 277319 4 -rw-r--r-- 1 ubuntu ubuntu 2094 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findpmdk.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277307 4 -rw-r--r-- 1 ubuntu ubuntu 1155 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findblkid.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277320 4 -rw-r--r-- 1 ubuntu ubuntu 766 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findrdmacm.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277272 20 -rw-r--r-- 1 ubuntu ubuntu 17149 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindArrow.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277263 4 -rw-r--r-- 1 ubuntu ubuntu 2233 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Buildpmdk.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277334 4 -rw-r--r-- 1 ubuntu ubuntu 1829 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/LimitJobs.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277310 4 -rw-r--r-- 1 ubuntu ubuntu 1554 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Finddaxctl.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277270 4 -rw-r--r-- 1 ubuntu ubuntu 1990 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/CheckNasm.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277249 8 -rw-r--r-- 1 ubuntu ubuntu 5323 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/AddCephTest.cmake 2024-03-27T21:32:59.987 INFO:teuthology.orchestra.run.smithi063.stdout: 277325 4 -rw-r--r-- 1 ubuntu ubuntu 3795 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findutf8proc.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277309 4 -rw-r--r-- 1 ubuntu ubuntu 723 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findcap.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277316 4 -rw-r--r-- 1 ubuntu ubuntu 1476 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findmotr.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277274 116 -rw-r--r-- 1 ubuntu ubuntu 117846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindBoost.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277280 4 -rw-r--r-- 1 ubuntu ubuntu 579 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindGSSApi.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277287 4 -rw-r--r-- 1 ubuntu ubuntu 443 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindNUMA.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277311 4 -rw-r--r-- 1 ubuntu ubuntu 1500 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Finddml.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277256 4 -rw-r--r-- 1 ubuntu ubuntu 1908 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildQATzip.cmake 2024-03-27T21:32:59.988 INFO:teuthology.orchestra.run.smithi063.stdout: 277294 4 -rw-r--r-- 1 ubuntu ubuntu 1189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindQAT.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277335 4 -rw-r--r-- 1 ubuntu ubuntu 3462 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/SIMDExt.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277326 4 -rw-r--r-- 1 ubuntu ubuntu 563 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Finduuid.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277295 4 -rw-r--r-- 1 ubuntu ubuntu 989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindQATzip.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277262 4 -rw-r--r-- 1 ubuntu ubuntu 952 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Buildc-ares.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277277 4 -rw-r--r-- 1 ubuntu ubuntu 1989 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindDAOS.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277327 4 -rw-r--r-- 1 ubuntu ubuntu 1110 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findverbs.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277297 4 -rw-r--r-- 1 ubuntu ubuntu 998 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindRDKafka.cmake 2024-03-27T21:32:59.989 INFO:teuthology.orchestra.run.smithi063.stdout: 277282 4 -rw-r--r-- 1 ubuntu ubuntu 2545 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindLMDB.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277257 8 -rw-r--r-- 1 ubuntu ubuntu 5066 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildRocksDB.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277264 4 -rw-r--r-- 1 ubuntu ubuntu 1602 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Builduring.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277279 4 -rw-r--r-- 1 ubuntu ubuntu 638 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindGMock.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277283 8 -rw-r--r-- 1 ubuntu ubuntu 4137 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindLTTngUST.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277313 4 -rw-r--r-- 1 ubuntu ubuntu 3077 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findgperftools.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277318 4 -rw-r--r-- 1 ubuntu ubuntu 1510 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findnl.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277330 4 -rw-r--r-- 1 ubuntu ubuntu 457 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findzbd.cmake 2024-03-27T21:32:59.990 INFO:teuthology.orchestra.run.smithi063.stdout: 277260 4 -rw-r--r-- 1 ubuntu ubuntu 2967 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildUtf8proc.cmake 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277276 4 -rw-r--r-- 1 ubuntu ubuntu 540 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindCython.cmake 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277267 4 -rw-r--r-- 1 ubuntu ubuntu 3 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/CephCheck_link.map 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277301 4 -rw-r--r-- 1 ubuntu ubuntu 3189 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindSanitizers.cmake 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277315 4 -rw-r--r-- 1 ubuntu ubuntu 843 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findlibcryptsetup.cmake 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277261 4 -rw-r--r-- 1 ubuntu ubuntu 998 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildZstd.cmake 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277338 4 -rwxr-xr-x 1 ubuntu ubuntu 1272 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/patch-dpdk-conf.sh 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277289 4 -rw-r--r-- 1 ubuntu ubuntu 1376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindOpenLDAP.cmake 2024-03-27T21:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout: 277296 8 -rw-r--r-- 1 ubuntu ubuntu 4194 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindQatDrv.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277252 8 -rw-r--r-- 1 ubuntu ubuntu 6288 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildDPDK.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277284 4 -rw-r--r-- 1 ubuntu ubuntu 1296 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindLZ4.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277265 4 -rw-r--r-- 1 ubuntu ubuntu 1748 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/CTags.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277329 4 -rw-r--r-- 1 ubuntu ubuntu 1732 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findyaml-cpp.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277304 4 -rw-r--r-- 1 ubuntu ubuntu 1544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindZstd.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277254 4 -rw-r--r-- 1 ubuntu ubuntu 4032 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildOpentelemetry.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277285 4 -rw-r--r-- 1 ubuntu ubuntu 471 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindLinuxZNS.cmake 2024-03-27T21:32:59.992 INFO:teuthology.orchestra.run.smithi063.stdout: 277288 4 -rw-r--r-- 1 ubuntu ubuntu 884 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindOATH.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277278 4 -rw-r--r-- 1 ubuntu ubuntu 2342 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindFUSE.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277268 8 -rw-r--r-- 1 ubuntu ubuntu 6357 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/CephChecks.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277321 4 -rw-r--r-- 1 ubuntu ubuntu 1025 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findsnappy.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277306 4 -rw-r--r-- 1 ubuntu ubuntu 846 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findbabeltrace.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277266 4 -rw-r--r-- 1 ubuntu ubuntu 14 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/CephCheck_link.c 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277317 4 -rw-r--r-- 1 ubuntu ubuntu 1506 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findndctl.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277299 4 -rw-r--r-- 1 ubuntu ubuntu 1667 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindRocksDB.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277258 4 -rw-r--r-- 1 ubuntu ubuntu 2940 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildSPDK.cmake 2024-03-27T21:32:59.993 INFO:teuthology.orchestra.run.smithi063.stdout: 277305 4 -rw-r--r-- 1 ubuntu ubuntu 436 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findaio.cmake 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277332 4 -rw-r--r-- 1 ubuntu ubuntu 3960 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/GetGitRevisionDescription.cmake 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277275 4 -rw-r--r-- 1 ubuntu ubuntu 479 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindCUnit.cmake 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277286 4 -rw-r--r-- 1 ubuntu ubuntu 717 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindMake.cmake 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277273 4 -rw-r--r-- 1 ubuntu ubuntu 3771 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindBacktrace.cmake 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277323 4 -rw-r--r-- 1 ubuntu ubuntu 1142 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findudev.cmake 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277303 4 -rw-r--r-- 1 ubuntu ubuntu 139 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindStdFilesystem_test.cc 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindPython 2024-03-27T21:32:59.994 INFO:teuthology.orchestra.run.smithi063.stdout: 277292 200 -rw-r--r-- 1 ubuntu ubuntu 202007 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindPython/Support.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277328 4 -rw-r--r-- 1 ubuntu ubuntu 832 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findxfs.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277293 20 -rw-r--r-- 1 ubuntu ubuntu 18592 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindPython3.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277308 4 -rw-r--r-- 1 ubuntu ubuntu 947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findc-ares.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277290 8 -rw-r--r-- 1 ubuntu ubuntu 5501 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindParquet.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277259 4 -rw-r--r-- 1 ubuntu ubuntu 628 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildUBBD.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277312 4 -rw-r--r-- 1 ubuntu ubuntu 3376 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Finddpdk.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277333 4 -rw-r--r-- 1 ubuntu ubuntu 1587 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/GetGitRevisionDescription.cmake.in 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277250 8 -rw-r--r-- 1 ubuntu ubuntu 7184 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildArrow.cmake 2024-03-27T21:32:59.995 INFO:teuthology.orchestra.run.smithi063.stdout: 277271 8 -rw-r--r-- 1 ubuntu ubuntu 6865 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Distutils.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277269 4 -rw-r--r-- 1 ubuntu ubuntu 2070 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/CheckCxxAtomic.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277324 4 -rw-r--r-- 1 ubuntu ubuntu 703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Finduring.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277314 4 -rw-r--r-- 1 ubuntu ubuntu 859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findkeyutils.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277255 4 -rw-r--r-- 1 ubuntu ubuntu 1889 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildQAT.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277253 4 -rw-r--r-- 1 ubuntu ubuntu 1544 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/BuildFIO.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277302 4 -rw-r--r-- 1 ubuntu ubuntu 1750 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindStdFilesystem.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277298 4 -rw-r--r-- 1 ubuntu ubuntu 551 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/FindRabbitMQ.cmake 2024-03-27T21:32:59.996 INFO:teuthology.orchestra.run.smithi063.stdout: 277322 4 -rw-r--r-- 1 ubuntu ubuntu 1126 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/Findthrift.cmake 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/code_tests 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277337 4 -rw-r--r-- 1 ubuntu ubuntu 314 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/cmake/modules/code_tests/Sanitizers_fiber_test.cc 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277202 4 -rw-r--r-- 1 ubuntu ubuntu 1503 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.gitignore 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277441 4 -rwxr-xr-x 1 ubuntu ubuntu 2412 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/do_cmake.sh 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277226 16 -rw-r--r-- 1 ubuntu ubuntu 12859 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/SubmittingPatches-kernel.rst 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277235 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/bin 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 277236 12 -rwxr-xr-x 1 ubuntu ubuntu 9140 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/bin/git-archive-all.sh 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 278430 8 -rw-r--r-- 1 ubuntu ubuntu 4386 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/pom.xml 2024-03-27T21:32:59.997 INFO:teuthology.orchestra.run.smithi063.stdout: 283274 4 -rwxr-xr-x 1 ubuntu ubuntu 3014 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/run-make-check.sh 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 277227 12 -rw-r--r-- 1 ubuntu ubuntu 11947 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/SubmittingPatches.rst 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 291444 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/sudoers.d 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 291445 4 -rw-r--r-- 1 ubuntu ubuntu 202 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/sudoers.d/ceph-smartctl 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 277203 4 -rw-r--r-- 1 ubuntu ubuntu 161 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/.gitleaks.toml 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 277225 20 -rw-r--r-- 1 ubuntu ubuntu 18703 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/SubmittingPatches-backports.rst 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 278316 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/man 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 278320 4 -rw-r--r-- 1 ubuntu ubuntu 2065 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/man/conf.py 2024-03-27T21:32:59.998 INFO:teuthology.orchestra.run.smithi063.stdout: 278318 4 -rw-r--r-- 1 ubuntu ubuntu 94 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/man/CMakeLists.txt 2024-03-27T21:32:59.999 INFO:teuthology.orchestra.run.smithi063.stdout: 278319 12 -rw-r--r-- 1 ubuntu ubuntu 8726 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/man/ceph_selinux.8 2024-03-27T21:32:59.999 INFO:teuthology.orchestra.run.smithi063.stdout: 278317 4 -rw-r--r-- 1 ubuntu ubuntu 15 Mar 27 21:32 /home/ubuntu/cephtest/clone.client.0/man/.gitignore 2024-03-27T21:33:00.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:33:00.000 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-03-27T21:33:00.000 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi063 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-27T21:33:00.009 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-27T21:33:00.025 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-27T21:33:00.073 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi063 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-27T21:33:00.073 INFO:teuthology.nuke:Checking targets against current locks 2024-03-27T21:33:00.101 DEBUG:teuthology.nuke:shortname: smithi028 2024-03-27T21:33:00.102 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T21:33:00.121 DEBUG:teuthology.nuke:shortname: smithi063 2024-03-27T21:33:00.121 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T21:33:00.128 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 21:13:34.359988', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF2k0LwIjq/fgl0fdo5xEusdHz5tJkemKU4cg3A1mzgcunXPrxs+Y8QaeICjOSTPRMFUGMCIJPxld02Cy03Q7YQ='} 2024-03-27T21:33:00.142 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-27_14:58:57-rados-wip-yuri4-testing-2024-03-26-1132-reef-distro-default-smithi/7626525', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 21:13:34.358445', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNouEqEVlmR8flsVmVtdMzxVEKwNhbUVb9+Ff0BZiAJRrQdKBZ0auUrtt31tPbbyACpWX3x7lTrhAJ0TNtqJtq8='} 2024-03-27T21:33:00.173 INFO:teuthology.orchestra.console.smithi028:Power off 2024-03-27T21:33:00.173 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T21:33:00.193 INFO:teuthology.orchestra.console.smithi063:Power off 2024-03-27T21:33:00.194 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T21:33:00.203 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2024-03-27T21:33:00.203 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:33:00.216 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2024-03-27T21:33:00.216 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:33:00.225 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-03-27T21:33:00.239 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-03-27T21:33:04.227 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:33:04.240 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:33:04.337 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-03-27T21:33:04.352 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-03-27T21:33:08.341 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:33:08.352 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:33:08.453 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-03-27T21:33:08.463 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-03-27T21:33:08.554 INFO:teuthology.orchestra.console.smithi028:Power off completed 2024-03-27T21:33:08.564 INFO:teuthology.orchestra.console.smithi063:Power off completed 2024-03-27T21:33:08.669 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_api_tests} duration: 610.9422733783722 failure_reason: 'Command failed on smithi063 with status 128: ''rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7c37d80f7a88f4eb561c4fe02558660a650b10ac''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=478edac61e49456c8d770bd701f809b7 status: fail success: false 2024-03-27T21:33:08.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T21:33:08.744 INFO:teuthology.run:FAIL